-- Logs begin at Sat 2022-09-24 19:05:02 UTC, end at Sat 2022-09-24 20:21:34 UTC. -- Sep 24 19:36:43.605832 dv-cinder-859191-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 24 19:36:43.614705 dv-cinder-859191-1-smb devstack@keystone.service[93389]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 24 19:36:43.616826 dv-cinder-859191-1-smb devstack@keystone.service[93389]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Sep 24 19:36:43 2022] *** Sep 24 19:36:43.616826 dv-cinder-859191-1-smb devstack@keystone.service[93389]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 24 19:36:43.616826 dv-cinder-859191-1-smb devstack@keystone.service[93389]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 24 19:36:43.616826 dv-cinder-859191-1-smb devstack@keystone.service[93389]: nodename: dv-cinder-859191-1-smb Sep 24 19:36:43.616826 dv-cinder-859191-1-smb devstack@keystone.service[93389]: machine: x86_64 Sep 24 19:36:43.616826 dv-cinder-859191-1-smb devstack@keystone.service[93389]: clock source: unix Sep 24 19:36:43.616826 dv-cinder-859191-1-smb devstack@keystone.service[93389]: pcre jit disabled Sep 24 19:36:43.616826 dv-cinder-859191-1-smb devstack@keystone.service[93389]: detected number of CPU cores: 4 Sep 24 19:36:43.616826 dv-cinder-859191-1-smb devstack@keystone.service[93389]: current working directory: / Sep 24 19:36:43.616826 dv-cinder-859191-1-smb devstack@keystone.service[93389]: detected binary path: /usr/bin/uwsgi-core Sep 24 19:36:43.616826 dv-cinder-859191-1-smb devstack@keystone.service[93389]: your processes number limit is 47680 Sep 24 19:36:43.617413 dv-cinder-859191-1-smb devstack@keystone.service[93389]: your memory page size is 4096 bytes Sep 24 19:36:43.617413 dv-cinder-859191-1-smb devstack@keystone.service[93389]: detected max file descriptor number: 2048 Sep 24 19:36:43.617413 dv-cinder-859191-1-smb devstack@keystone.service[93389]: lock engine: pthread robust mutexes Sep 24 19:36:43.617413 dv-cinder-859191-1-smb devstack@keystone.service[93389]: thunder lock: enabled Sep 24 19:36:43.617413 dv-cinder-859191-1-smb devstack@keystone.service[93389]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 24 19:36:43.617413 dv-cinder-859191-1-smb devstack@keystone.service[93389]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 24 19:36:43.656254 dv-cinder-859191-1-smb devstack@keystone.service[93389]: Python main interpreter initialized at 0x5605e6e7f9c0 Sep 24 19:36:43.656254 dv-cinder-859191-1-smb devstack@keystone.service[93389]: python threads support enabled Sep 24 19:36:43.656254 dv-cinder-859191-1-smb devstack@keystone.service[93389]: your server socket listen backlog is limited to 100 connections Sep 24 19:36:43.656254 dv-cinder-859191-1-smb devstack@keystone.service[93389]: your mercy for graceful operations on workers is 90 seconds Sep 24 19:36:43.656636 dv-cinder-859191-1-smb devstack@keystone.service[93389]: mapped 403077 bytes (393 KB) for 2 cores Sep 24 19:36:43.656711 dv-cinder-859191-1-smb devstack@keystone.service[93389]: *** Operational MODE: preforking *** Sep 24 19:36:43.656967 dv-cinder-859191-1-smb devstack@keystone.service[93389]: *** uWSGI is running in multiple interpreter mode *** Sep 24 19:36:43.656967 dv-cinder-859191-1-smb devstack@keystone.service[93389]: spawned uWSGI master process (pid: 93389) Sep 24 19:36:43.657182 dv-cinder-859191-1-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 24 19:36:43.658074 dv-cinder-859191-1-smb devstack@keystone.service[93389]: spawned uWSGI worker 1 (pid: 93399, cores: 1) Sep 24 19:36:43.658177 dv-cinder-859191-1-smb devstack@keystone.service[93389]: spawned uWSGI worker 2 (pid: 93400, cores: 1) Sep 24 19:36:43.658315 dv-cinder-859191-1-smb devstack@keystone.service[93389]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 24 19:36:48.110330 dv-cinder-859191-1-smb devstack@keystone.service[93399]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 19:36:48.110330 dv-cinder-859191-1-smb devstack@keystone.service[93399]: from cryptography.utils import int_from_bytes Sep 24 19:36:48.111177 dv-cinder-859191-1-smb devstack@keystone.service[93399]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 19:36:48.111177 dv-cinder-859191-1-smb devstack@keystone.service[93399]: from cryptography.utils import int_from_bytes Sep 24 19:36:48.129227 dv-cinder-859191-1-smb devstack@keystone.service[93400]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 19:36:48.129227 dv-cinder-859191-1-smb devstack@keystone.service[93400]: from cryptography.utils import int_from_bytes Sep 24 19:36:48.129865 dv-cinder-859191-1-smb devstack@keystone.service[93400]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 19:36:48.129865 dv-cinder-859191-1-smb devstack@keystone.service[93400]: from cryptography.utils import int_from_bytes Sep 24 19:36:48.167333 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 24 19:36:48.167519 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 24 19:36:48.167699 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] command line args: [] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 24 19:36:48.167976 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 24 19:36:48.168156 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] ================================================================================ {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 24 19:36:48.168416 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] admin_token = **** {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.168667 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] config_dir = [] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.168858 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.169044 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] config_source = [] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.169228 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] debug = True {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.169437 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.169834 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.170011 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] insecure_debug = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.170440 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.170700 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.170954 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] list_limit = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.171209 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] log_config_append = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.171393 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.171574 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] log_dir = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.171755 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] log_file = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.171994 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.172246 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.172496 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.172746 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.172928 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.173109 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.173357 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.173638 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.173875 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.174111 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.174347 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.174582 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.174835 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.175083 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] notification_format = cadf {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.175364 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.175865 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.60/identity {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.176053 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] publish_errors = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.176291 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.176528 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.176710 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.176963 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.177290 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.177469 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] standard_threads = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.177731 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] strict_password_check = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.177982 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.178163 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] use_eventlog = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.178342 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] use_journal = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.178519 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] use_json = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.178696 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] use_stderr = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.178873 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] use_syslog = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.179107 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] watch_log_file = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.179374 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.179616 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.179880 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.180122 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.180375 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.180615 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.180864 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.181752 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.182011 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.182262 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.182515 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.182764 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.183009 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.183249 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.183498 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.183748 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.183987 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.184243 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.184499 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.184745 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.184981 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.185237 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.185516 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.185775 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 24 19:36:48.186028 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.186163 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 24 19:36:48.186239 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.186308 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] command line args: [] {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 24 19:36:48.186375 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.186454 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 24 19:36:48.186541 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.186622 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] ================================================================================ {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 24 19:36:48.186691 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.186822 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] admin_token = **** {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.186904 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.187069 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] config_dir = [] {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.187146 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.187258 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.187379 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.187456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] config_source = [] {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.187636 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] debug = True {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.187767 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.187866 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.187993 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.188072 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.188130 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.188252 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] insecure_debug = False {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.188332 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.188492 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.188569 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.188743 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.188824 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.188966 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] list_limit = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.189039 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.189143 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] log_config_append = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.189240 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.189322 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.189478 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.189591 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] log_dir = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.189669 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] log_file = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.189743 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.189905 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.189981 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.190156 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.190243 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.190400 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.190475 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.190639 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.190715 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.190817 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.190903 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.190997 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.191108 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.191244 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.191346 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.191491 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.191574 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.191726 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.191802 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.191962 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.192038 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.192197 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.192274 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.192433 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.192514 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.192685 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.192760 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.192926 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.193002 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] notification_format = cadf {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.193164 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.193246 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.193403 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.193664 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.193756 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.60/identity {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.193897 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] publish_errors = False {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.193972 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.194148 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.194300 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.194374 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.194448 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.194522 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.194597 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.194763 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.194851 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.195028 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.195126 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.195263 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] standard_threads = False {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.195371 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.195503 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.195588 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] strict_password_check = False {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.195742 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.195818 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.195966 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] use_eventlog = False {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.196046 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.196145 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] use_journal = False {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.196237 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.196388 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] use_json = False {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.196468 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.196526 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] use_stderr = False {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.197366 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.197516 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] use_syslog = False {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.201702 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.201702 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.201857 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] watch_log_file = False {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:48.201926 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.201994 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.202067 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.202145 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.202253 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] cache.enabled = True {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.202349 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.202442 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.202567 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.202672 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.202777 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.202871 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.202979 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.203073 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.203165 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.203258 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.203383 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.203446 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.203502 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.203598 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.203709 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.203790 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.203790 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.203973 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.204093 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.204173 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.204244 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.204307 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.204422 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.204504 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.204575 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.204687 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.204687 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.204869 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.204950 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.205028 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.205099 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.205211 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.205285 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.205397 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.205397 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.205665 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.205844 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.205924 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.205984 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.206104 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.206218 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.206301 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.206416 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.206496 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.206616 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.206690 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.206759 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.206880 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.206958 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.207028 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.207140 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.207213 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.207271 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.207337 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.207443 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.207521 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.207634 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.207707 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.207772 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.207849 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.207919 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.207996 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.208072 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] auth.external = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.208143 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.208255 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] auth.mapped = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.208337 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.208408 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.208483 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.208603 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.208683 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.208753 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] auth.password = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.208896 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.208970 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] auth.token = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.209038 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.209106 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.209180 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.209249 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] catalog.caching = True {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.209332 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.209414 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.209486 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.209574 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.209643 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.209712 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.209780 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.209860 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.209933 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.210012 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.210082 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.210230 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] credential.caching = True {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.210350 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.210439 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] credential.driver = sql {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.210518 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.210590 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.210713 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.210797 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.210929 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.211021 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.211083 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.211152 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.211221 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.211289 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.211357 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.211434 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.211584 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.211664 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.211734 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.211803 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.211872 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.211949 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.212020 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.212020 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.212145 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.212249 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.212332 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.212404 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.212474 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.212548 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.212626 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.212849 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.213090 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] federation.caching = True {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.213174 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.213330 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.213410 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.213613 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] federation.driver = sql {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.213695 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.213865 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.213955 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.214099 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.214176 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.214341 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.214422 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.214577 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.214660 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.214830 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.214908 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.215072 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.215190 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.215328 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.215565 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.215813 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.216048 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] identity.caching = True {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.216359 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.216587 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.216826 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.217063 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.217311 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] identity.driver = sql {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.217566 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.217807 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.218057 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.218309 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.218543 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.218776 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.219008 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.219254 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.219529 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.219764 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.219847 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.220030 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.220115 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.220279 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.220358 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.220551 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.220632 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.220791 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.220870 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.221030 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.221107 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] cache.enabled = True {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.221262 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.221345 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.221510 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.221602 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.221754 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.221831 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.221990 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.222075 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.222233 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.222313 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.222473 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.222557 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.222756 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.222843 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.222993 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.223070 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.223195 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.223274 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.223444 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.223528 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.223680 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.223760 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.224067 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.224321 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.224426 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.224505 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.224585 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.224658 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.224728 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.224798 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.224868 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] ldap.password = **** {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.224937 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.225048 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.225150 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.225284 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.225394 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.225666 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.225748 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.225909 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.225989 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.226146 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.226223 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.226397 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.226519 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.226628 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.226779 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.226857 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.227015 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.227093 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.227247 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.227333 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.227500 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.227578 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.227749 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.227875 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.228097 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.228339 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.228578 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.228677 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.228864 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] ldap.user = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.228954 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.229056 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.229190 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.229316 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.229432 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] auth.external = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.229574 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.229699 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] auth.mapped = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.229855 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.230006 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.230107 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.230246 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.230355 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.230485 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] auth.password = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.230592 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.230722 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] auth.token = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.230809 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.230968 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.231045 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.231206 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] catalog.caching = True {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.231284 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.231458 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.231538 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.231693 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.231771 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.231945 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.232023 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.232189 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.232267 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.232422 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.232498 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.232662 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] credential.caching = True {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.232783 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.232957 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.233035 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] credential.driver = sql {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.233127 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.233206 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.233374 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.233461 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.233637 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.233718 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.233875 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.233952 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.234112 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.238774 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.238969 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.239065 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.239138 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.239208 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.239278 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.239362 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.239436 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.239512 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.239585 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] policy.driver = sql {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.239654 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.239724 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.239801 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.239873 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.239942 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.240012 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.240081 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.240150 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] receipt.caching = True {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.240227 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.240299 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.240369 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] federation.caching = True {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.240445 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.240517 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.240587 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.240668 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] federation.driver = sql {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.240741 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.240816 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.240888 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.240958 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.241028 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] resource.caching = True {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.241106 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.241185 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.241257 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.241327 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] resource.driver = sql {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.241397 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.241468 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.241620 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.241699 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.241699 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.241834 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.241906 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] revoke.caching = True {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.241976 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.242070 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.242194 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.242274 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.242333 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] identity.caching = True {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.242403 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] role.cache_time = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.242473 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.242553 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] role.caching = True {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.242625 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.242696 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] role.driver = sql {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.242765 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.242841 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] role.list_limit = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.242913 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.242991 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.243063 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] identity.driver = sql {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.243133 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.243203 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.243273 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.243343 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.243421 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.244228 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.244314 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.244387 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.244581 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.244684 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.244830 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.244936 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.245011 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.245081 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.245150 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.245220 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.245299 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.245371 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.245441 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.245533 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.245607 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.245677 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.245760 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.245833 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.245904 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.245904 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.246020 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.246096 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.246168 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.246237 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.246306 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.246376 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.246445 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.246521 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.246592 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.246661 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.246730 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.246799 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.246867 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.246867 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.247002 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.247072 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.247141 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.247141 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.247266 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.247409 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.247484 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.247554 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.247630 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.247701 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.247771 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.247847 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.247918 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.247987 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.248058 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.248127 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.248196 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.248271 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.248343 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.248503 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] token.cache_time = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.248584 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.248740 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] token.caching = True {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.248822 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] ldap.password = **** {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.248978 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.249058 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.249220 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.249296 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] token.provider = fernet {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.249454 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.249549 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.249718 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.249796 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.249959 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.250036 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.250221 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.250311 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.250476 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.250556 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.250714 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.250792 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.250950 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.251027 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] trust.driver = sql {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.251203 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.251284 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.251442 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.251520 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.251680 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.251764 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.251916 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.251995 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.252155 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.252233 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.252390 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] ldap.user = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.252468 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.252634 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.252725 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.252897 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.252976 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.253132 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.253210 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] database.connection = **** {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.253383 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.253479 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.253655 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.253733 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.253896 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.253973 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.254134 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.254222 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.254368 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.254446 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.254605 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.254731 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.254838 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.254922 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.255073 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.255150 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.255307 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.255384 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.255541 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.255626 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.255797 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.255927 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.256077 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.256150 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.256280 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.256378 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.256513 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.256592 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.256744 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.256819 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.256975 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.257060 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.257215 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.257293 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.257450 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.257547 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.257646 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 24 19:36:48.257794 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.257941 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.258189 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.258568 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.258811 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.259827 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] policy.driver = sql {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.260495 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.261019 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.261267 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.261532 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] receipt.caching = True {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.261780 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.262035 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.265388 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.265388 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.265388 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.265388 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] resource.caching = True {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.265388 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.265388 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] resource.driver = sql {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.265388 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.265388 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.265388 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.266024 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] revoke.caching = True {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.266024 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.266024 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.266024 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] role.cache_time = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.266024 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] role.caching = True {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.266024 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] role.driver = sql {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.266024 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] role.list_limit = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.266024 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.266447 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.266524 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.266752 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.267004 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.267254 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.267506 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.267759 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.267996 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.268247 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.268497 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.268752 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.269027 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.269456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.269722 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.269978 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.270232 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.270484 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.270738 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.270976 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.271237 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.271495 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.271738 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.271974 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.272211 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.272447 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.272701 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.272959 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.273210 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.273450 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.273711 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.273945 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] token.cache_time = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.274184 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] token.caching = True {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.274425 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.274690 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] token.provider = fernet {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.275352 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.275621 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.275876 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.276121 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.276371 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.276622 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.276874 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] trust.driver = sql {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.277115 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.277356 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.277619 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.277872 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.278162 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.278397 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.278652 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.278922 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.279186 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] database.connection = **** {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.279432 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.279683 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.279923 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.280244 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.280426 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.280667 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.280906 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.281145 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.281394 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.281662 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.281913 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.282152 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.282403 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.282641 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.282905 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.283121 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.283364 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.283603 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:48.283776 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 24 19:36:48.288299 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=93399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:36:48.288542 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=93399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:36:48.288769 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=93399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:36:48.297604 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=93399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:36:48.317834 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=93400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:36:48.321370 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=93400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:36:48.321370 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=93400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:36:48.328991 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=93399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:36:48.329222 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=93399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:36:48.332602 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=93400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:36:48.353334 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=93400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:36:48.353768 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=93400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:36:48.392090 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=93399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:36:48.398200 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=93400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:36:48.450103 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=93400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:36:48.450312 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=93400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:36:48.450537 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=93399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:36:48.450853 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=93399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:36:48.614476 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:36:48.614702 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=93400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:36:48.614848 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:36:48.614937 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=93400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:36:48.615112 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=93399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:36:48.615204 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=93400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:36:48.615390 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=93399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:36:48.615477 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=93400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:36:48.615611 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=93400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:36:48.615719 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=93399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:36:48.615968 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=93399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:36:48.616200 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=93399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:36:48.645481 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:36:48.645667 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:36:48.645741 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=93400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:36:48.645819 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=93399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:36:48.645894 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=93400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:36:48.646054 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=93399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:36:48.646139 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=93400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:36:48.646286 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=93399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:36:48.646368 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=93400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:36:48.646511 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=93400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:36:48.646606 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=93399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:36:48.646731 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:36:48.646812 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=93399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:36:48.646947 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:36:48.658906 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=93400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:36:48.659419 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=93399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:36:48.672587 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:36:48.672879 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=93400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:36:48.673055 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=93400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:36:48.673243 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:36:48.673336 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=93400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:36:48.673554 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=93400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:36:48.673641 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=93399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:36:48.673705 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=93400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:36:48.673766 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=93399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:36:48.673994 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93400) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:36:48.674088 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=93399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:36:48.674154 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=93399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:36:48.674368 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=93399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:36:48.674787 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:36:48.702120 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.702337 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 24 19:36:48.702658 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.702857 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 24 19:36:48.702951 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.703074 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 24 19:36:48.703206 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.703378 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.703462 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.703611 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 24 19:36:48.703690 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.703885 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.703973 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.704150 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.704444 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.704704 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.714055 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.714337 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.714607 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.714887 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.715532 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.715846 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.716124 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.716415 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.721902 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=93400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:36:48.723616 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=93399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:36:48.724782 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=93400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:36:48.725071 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.725357 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.725677 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.725962 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.726228 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.726502 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.726597 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=93399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:36:48.726775 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.726895 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.727044 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.727185 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.727318 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.727474 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.727585 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.727763 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.729241 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.729550 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.729839 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.730121 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.730432 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.730708 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.750800 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.752283 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=93400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:36:48.752570 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.754286 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.755825 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=93399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:36:48.756162 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.758973 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=93400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:36:48.758973 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.758973 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.761993 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=93399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:36:48.762302 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.762587 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.764486 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=93400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:36:48.764780 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.768710 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=93400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:36:48.769005 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.769087 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=93399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:36:48.769293 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.769377 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.769604 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.769883 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.772045 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.772333 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.772617 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.776358 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=93399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:36:48.776659 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.776957 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.777253 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.777566 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.777854 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.778130 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.778404 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.788669 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.788963 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.793456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=93400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:36:48.795206 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.795497 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.796545 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.796858 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.799355 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=93399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:36:48.801159 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=93400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:36:48.802576 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.802883 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.804297 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=93400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:36:48.808105 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.808282 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=93399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:36:48.808411 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.808699 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.808987 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.809264 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.809695 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.811392 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=93399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:36:48.814723 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.815163 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.815355 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.815658 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.815963 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.816258 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.825406 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=93400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:36:48.825719 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.825990 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.826254 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.832752 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=93399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:36:48.832922 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.833050 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.833323 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.833645 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.834621 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.836150 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.836433 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.839660 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=93400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:36:48.839947 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.840231 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.840518 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.840811 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.841343 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.842916 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.844460 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.844776 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.847531 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=93399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:36:48.847823 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.848113 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.848400 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.848800 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.852015 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=93400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:36:48.858859 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.858859 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.858859 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.858859 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.858859 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.858859 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.861317 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=93399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:36:48.861631 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.861914 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.862201 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.862588 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.862904 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.863191 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.869691 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=93400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:36:48.872708 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=93400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:36:48.875609 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.877029 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.878526 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=93400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:36:48.878821 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.879115 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.879317 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=93399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:36:48.882359 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=93399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:36:48.886045 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.886202 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.887484 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=93400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:36:48.887688 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.889157 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=93399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:36:48.889456 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.889883 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.890393 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.890682 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.890967 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.891244 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.896435 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.897913 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=93399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:36:48.899106 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=93400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:36:48.899409 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.900482 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.901891 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.902290 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.902585 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.902870 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.907397 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=93400) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:36:48.907688 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.907971 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.908246 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.908516 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.908786 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.909063 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.909348 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.909641 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.909928 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.910208 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.910469 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.910740 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.910822 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=93399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:36:48.911006 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=93400) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.911098 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.911380 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.919550 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=93399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:36:48.919843 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.920131 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.920494 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.920714 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.921003 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.921283 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.921593 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.921873 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.922156 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.922451 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.922718 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.922999 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.923313 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=93399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:36:48.945399 dv-cinder-859191-1-smb devstack@keystone.service[93400]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5605e6e7f9c0 pid: 93400 (default app) Sep 24 19:36:48.949253 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd33612-28b9-40a4-9b95-471c5a8b7963 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:36:48.949563 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd33612-28b9-40a4-9b95-471c5a8b7963 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:36:48.949840 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd33612-28b9-40a4-9b95-471c5a8b7963 None None] PATH_INFO: `/v3` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:36:48.954035 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1/1] 10.222.0.60 () {50 vars in 791 bytes} [Sat Sep 24 19:36:48 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:36:48.959013 dv-cinder-859191-1-smb devstack@keystone.service[93399]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5605e6e7f9c0 pid: 93399 (default app) Sep 24 19:36:56.963360 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25b67c-1e7c-447e-94d6-d9a1797a5772 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:36:56.963898 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25b67c-1e7c-447e-94d6-d9a1797a5772 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:36:56.963898 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25b67c-1e7c-447e-94d6-d9a1797a5772 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:36:56.965133 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 2/2] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:36:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:36:56.972615 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24127366-e559-4cab-9c5b-57f0e0b79cbe None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:36:56.973149 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24127366-e559-4cab-9c5b-57f0e0b79cbe None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:36:56.973149 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24127366-e559-4cab-9c5b-57f0e0b79cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:36:57.047474 dv-cinder-859191-1-smb devstack@keystone.service[93399]: INFO dbcounter [None req-24127366-e559-4cab-9c5b-57f0e0b79cbe None None] Registered counter for database keystone Sep 24 19:36:57.068449 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG oslo_db.sqlalchemy.engines [None req-24127366-e559-4cab-9c5b-57f0e0b79cbe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93399) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 19:36:57.074705 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writer thread running {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 19:36:57.263626 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG passlib.handlers.bcrypt [None req-24127366-e559-4cab-9c5b-57f0e0b79cbe None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=93399) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 24 19:36:57.263925 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG passlib.handlers.bcrypt [None req-24127366-e559-4cab-9c5b-57f0e0b79cbe None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=93399) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 24 19:36:57.325251 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-24127366-e559-4cab-9c5b-57f0e0b79cbe None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:36:57.326996 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-24127366-e559-4cab-9c5b-57f0e0b79cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:36:57.460628 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1/3] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:36:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 491 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 24 19:36:57.947703 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b25b67c-1e7c-447e-94d6-d9a1797a5772 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:36:58.016984 dv-cinder-859191-1-smb devstack@keystone.service[93400]: INFO dbcounter [None req-4b25b67c-1e7c-447e-94d6-d9a1797a5772 None None] Registered counter for database keystone Sep 24 19:36:58.036475 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG oslo_db.sqlalchemy.engines [None req-4b25b67c-1e7c-447e-94d6-d9a1797a5772 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93400) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 19:36:58.042914 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writer thread running {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 19:36:58.162319 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b25b67c-1e7c-447e-94d6-d9a1797a5772 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:36:58.167251 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba248c4b-39c5-49a2-bdc3-f1dd22424a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:36:58.167875 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba248c4b-39c5-49a2-bdc3-f1dd22424a95 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:36:58.168156 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba248c4b-39c5-49a2-bdc3-f1dd22424a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:36:58.168428 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba248c4b-39c5-49a2-bdc3-f1dd22424a95 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:36:58.176933 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba248c4b-39c5-49a2-bdc3-f1dd22424a95 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:36:58.229597 dv-cinder-859191-1-smb devstack@keystone.service[93400]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ba248c4b-39c5-49a2-bdc3-f1dd22424a95 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 24 19:36:58.229854 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba248c4b-39c5-49a2-bdc3-f1dd22424a95 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:36:58.240507 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 3/4] 10.222.0.60 () {58 vars in 1324 bytes} [Sat Sep 24 19:36:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 24 19:36:58.247290 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24127366-e559-4cab-9c5b-57f0e0b79cbe None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:36:58.262952 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24127366-e559-4cab-9c5b-57f0e0b79cbe None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:36:58.267337 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b778f02c-dec1-4806-adf9-78cb9865c5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:36:58.268449 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778f02c-dec1-4806-adf9-78cb9865c5c7 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:36:58.268726 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778f02c-dec1-4806-adf9-78cb9865c5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:36:58.268992 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778f02c-dec1-4806-adf9-78cb9865c5c7 admin admin] PATH_INFO: `/v3/projects/1efc13c179384208b08c31d1589c351f` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:36:58.270456 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b778f02c-dec1-4806-adf9-78cb9865c5c7 admin admin] RBAC: Authorizing `identity:get_project(project_id=1efc13c179384208b08c31d1589c351f)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:36:58.324302 dv-cinder-859191-1-smb devstack@keystone.service[93399]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b778f02c-dec1-4806-adf9-78cb9865c5c7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 24 19:36:58.324644 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b778f02c-dec1-4806-adf9-78cb9865c5c7 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:36:58.329366 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 2/5] 10.222.0.60 () {56 vars in 1207 bytes} [Sat Sep 24 19:36:58 2022] GET /identity/v3/projects/1efc13c179384208b08c31d1589c351f => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:00.480780 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58101709-64aa-472b-9be9-f3f272362b3a None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:00.481348 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58101709-64aa-472b-9be9-f3f272362b3a None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:00.481348 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58101709-64aa-472b-9be9-f3f272362b3a None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:00.485454 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 4/6] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:37:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:37:00.490999 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e039a41-d8a3-4055-b40d-12dca3a5c591 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:00.491448 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e039a41-d8a3-4055-b40d-12dca3a5c591 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:00.491596 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e039a41-d8a3-4055-b40d-12dca3a5c591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:00.515068 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-4e039a41-d8a3-4055-b40d-12dca3a5c591 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:37:00.516695 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-4e039a41-d8a3-4055-b40d-12dca3a5c591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:37:00.525324 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 3/7] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:37:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 24 19:37:00.802445 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58101709-64aa-472b-9be9-f3f272362b3a None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:00.815445 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58101709-64aa-472b-9be9-f3f272362b3a None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:00.819723 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b70e75-24ca-48e2-9c74-3d483f8fd8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:00.820333 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b70e75-24ca-48e2-9c74-3d483f8fd8cb admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:00.820618 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b70e75-24ca-48e2-9c74-3d483f8fd8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:00.820896 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b70e75-24ca-48e2-9c74-3d483f8fd8cb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:00.829726 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b70e75-24ca-48e2-9c74-3d483f8fd8cb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:00.831509 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b70e75-24ca-48e2-9c74-3d483f8fd8cb admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:00.840398 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 5/8] 10.222.0.60 () {58 vars in 1324 bytes} [Sat Sep 24 19:37:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 24 19:37:00.846254 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e039a41-d8a3-4055-b40d-12dca3a5c591 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:00.855801 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e039a41-d8a3-4055-b40d-12dca3a5c591 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:00.860188 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67915f29-bfc4-4457-9507-db8b08b0b30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:00.860825 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67915f29-bfc4-4457-9507-db8b08b0b30f admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:00.861105 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67915f29-bfc4-4457-9507-db8b08b0b30f admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:00.861378 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67915f29-bfc4-4457-9507-db8b08b0b30f admin admin] PATH_INFO: `/v3/users/3ee86ed717254b8d8e892338e3d639aa` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:00.862733 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67915f29-bfc4-4457-9507-db8b08b0b30f admin admin] RBAC: Authorizing `identity:get_user(user_id=3ee86ed717254b8d8e892338e3d639aa)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:00.864573 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67915f29-bfc4-4457-9507-db8b08b0b30f admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:00.866175 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 4/9] 10.222.0.60 () {56 vars in 1198 bytes} [Sat Sep 24 19:37:00 2022] GET /identity/v3/users/3ee86ed717254b8d8e892338e3d639aa => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:03.109813 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d97ab8-6dfb-40ea-89ff-8e4f2b178a22 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:03.110341 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d97ab8-6dfb-40ea-89ff-8e4f2b178a22 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:03.110341 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d97ab8-6dfb-40ea-89ff-8e4f2b178a22 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:03.111692 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 6/10] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:37:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:37:03.117152 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0e574-9058-49f3-9639-eb40c82badd6 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:03.117698 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0e574-9058-49f3-9639-eb40c82badd6 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:03.118278 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0e574-9058-49f3-9639-eb40c82badd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:03.146283 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-64f0e574-9058-49f3-9639-eb40c82badd6 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:37:03.147549 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-64f0e574-9058-49f3-9639-eb40c82badd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:37:03.233715 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 5/11] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:37:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 19:37:03.260053 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99d08e-3923-4c65-897c-985e7237887f None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:03.260605 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99d08e-3923-4c65-897c-985e7237887f None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:03.260874 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99d08e-3923-4c65-897c-985e7237887f None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:03.262246 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 7/12] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:37:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:37:03.268520 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf970f2-8b28-4f65-bfe9-34997647f09d None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:03.268812 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf970f2-8b28-4f65-bfe9-34997647f09d None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:03.269092 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf970f2-8b28-4f65-bfe9-34997647f09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:03.289181 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-2cf970f2-8b28-4f65-bfe9-34997647f09d None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:37:03.291069 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-2cf970f2-8b28-4f65-bfe9-34997647f09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:37:03.308960 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:03.364230 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 6/13] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:37:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:37:03.507009 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e99d08e-3923-4c65-897c-985e7237887f None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:03.637204 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf970f2-8b28-4f65-bfe9-34997647f09d None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:03.654070 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e99d08e-3923-4c65-897c-985e7237887f None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:03.692938 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86904acb-4acc-4fa0-bda1-b12db9c1ac3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:03.693838 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86904acb-4acc-4fa0-bda1-b12db9c1ac3b None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:03.694122 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86904acb-4acc-4fa0-bda1-b12db9c1ac3b None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:03.694398 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86904acb-4acc-4fa0-bda1-b12db9c1ac3b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:03.706724 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86904acb-4acc-4fa0-bda1-b12db9c1ac3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:37:03.716988 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-86904acb-4acc-4fa0-bda1-b12db9c1ac3b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:37:03.716988 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:37:03.716988 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:37:03.716988 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:37:03.716988 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:37:03.716988 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:37:03.716988 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:37:03.716988 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:37:03.716988 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:37:03.716988 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:37:03.716988 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:37:03.716988 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:37:03.716988 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:37:03.716988 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:37:03.716988 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:37:03.716988 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:37:03.718029 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:37:03.718029 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:37:03.718029 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:37:03.718029 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:37:03.718029 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:37:03.718029 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:37:03.718029 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:37:03.718029 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:37:03.718029 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:37:03.718029 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:37:03.718029 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:37:03.718029 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:37:03.718029 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:37:03.718029 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:37:03.718029 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:37:03.718029 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:37:03.719135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:37:03.719135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:37:03.719135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:37:03.719135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:37:03.719135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:37:03.719135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:37:03.719135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:37:03.719135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:37:03.719135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:37:03.719135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:37:03.719135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:37:03.719135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:37:03.719135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 8/14] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Sep 24 19:37:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:37:03.724167 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86904acb-4acc-4fa0-bda1-b12db9c1ac3b None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:03.749123 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf970f2-8b28-4f65-bfe9-34997647f09d None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:03.760794 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:03.798837 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ad7f5b-d2e0-4312-9cb6-f28aa30eac0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:03.799453 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad7f5b-d2e0-4312-9cb6-f28aa30eac0d None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:03.799827 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad7f5b-d2e0-4312-9cb6-f28aa30eac0d None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:03.800034 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad7f5b-d2e0-4312-9cb6-f28aa30eac0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:03.821873 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:03.832937 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86904acb-4acc-4fa0-bda1-b12db9c1ac3b None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:03.867628 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a44e049-5f7d-4b20-b8f5-854dd2640733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:03.868258 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44e049-5f7d-4b20-b8f5-854dd2640733 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:03.868530 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44e049-5f7d-4b20-b8f5-854dd2640733 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:03.868671 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ad7f5b-d2e0-4312-9cb6-f28aa30eac0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:03.868801 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44e049-5f7d-4b20-b8f5-854dd2640733 None admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:03.869459 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a44e049-5f7d-4b20-b8f5-854dd2640733 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:37:03.869788 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a44e049-5f7d-4b20-b8f5-854dd2640733 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:03.870204 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ad7f5b-d2e0-4312-9cb6-f28aa30eac0d None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:03.871148 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a44e049-5f7d-4b20-b8f5-854dd2640733 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:03.884169 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 9/15] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Sep 24 19:37:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:37:03.890120 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a44e049-5f7d-4b20-b8f5-854dd2640733 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:03.970106 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 7/16] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Sep 24 19:37:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 24 19:37:03.975691 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ad7f5b-d2e0-4312-9cb6-f28aa30eac0d None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:03.989760 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:03.995392 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a44e049-5f7d-4b20-b8f5-854dd2640733 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:04.030687 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:04.031157 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88c4cf-7ba0-4c78-97a9-175fe690ae91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:04.031836 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88c4cf-7ba0-4c78-97a9-175fe690ae91 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:04.032144 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88c4cf-7ba0-4c78-97a9-175fe690ae91 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:04.032425 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88c4cf-7ba0-4c78-97a9-175fe690ae91 None admin] PATH_INFO: `/v3/users/3ee86ed717254b8d8e892338e3d639aa` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:04.034044 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a88c4cf-7ba0-4c78-97a9-175fe690ae91 None admin] RBAC: Authorizing `identity:get_user(user_id=3ee86ed717254b8d8e892338e3d639aa)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:04.035490 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a88c4cf-7ba0-4c78-97a9-175fe690ae91 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:04.037071 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 10/17] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Sep 24 19:37:03 2022] GET /identity/v3/users/3ee86ed717254b8d8e892338e3d639aa => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:37:04.043787 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88c4cf-7ba0-4c78-97a9-175fe690ae91 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:04.080434 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ad7f5b-d2e0-4312-9cb6-f28aa30eac0d None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:04.114287 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d68e1d9-d10d-44d3-b6cb-01a58374bd6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:04.114928 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68e1d9-d10d-44d3-b6cb-01a58374bd6b None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:04.115201 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68e1d9-d10d-44d3-b6cb-01a58374bd6b None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:04.115477 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68e1d9-d10d-44d3-b6cb-01a58374bd6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:04.127291 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d68e1d9-d10d-44d3-b6cb-01a58374bd6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:04.128793 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d68e1d9-d10d-44d3-b6cb-01a58374bd6b None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:04.146247 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88c4cf-7ba0-4c78-97a9-175fe690ae91 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:04.147625 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-5d68e1d9-d10d-44d3-b6cb-01a58374bd6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:37:04.147625 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:37:04.147625 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:37:04.147625 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:37:04.147625 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:37:04.147625 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:37:04.147625 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:37:04.147625 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:37:04.147625 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:37:04.147625 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:37:04.147625 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:37:04.147625 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:37:04.147625 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:37:04.147625 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:37:04.147625 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:37:04.147625 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:37:04.149487 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:37:04.149487 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:37:04.149487 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:37:04.149487 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:37:04.149487 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:37:04.149487 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:37:04.149487 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:37:04.149487 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:37:04.149487 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:37:04.149487 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:37:04.149487 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:37:04.149487 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:37:04.149487 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:37:04.149487 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:37:04.149487 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:37:04.149487 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:37:04.149487 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:37:04.150795 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:37:04.150795 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:37:04.150795 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:37:04.150795 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 8/18] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:37:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:37:04.155354 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d68e1d9-d10d-44d3-b6cb-01a58374bd6b None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:04.185575 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c106ea-3052-4ed6-b507-e0cd19f97903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:04.186220 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c106ea-3052-4ed6-b507-e0cd19f97903 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:04.186499 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c106ea-3052-4ed6-b507-e0cd19f97903 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:04.186779 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c106ea-3052-4ed6-b507-e0cd19f97903 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:04.187996 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c106ea-3052-4ed6-b507-e0cd19f97903 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:04.189447 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c106ea-3052-4ed6-b507-e0cd19f97903 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:04.191054 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 11/19] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:37:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:37:04.197589 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c106ea-3052-4ed6-b507-e0cd19f97903 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:04.232404 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:04.268204 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d68e1d9-d10d-44d3-b6cb-01a58374bd6b None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:04.270820 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:04.307679 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c106ea-3052-4ed6-b507-e0cd19f97903 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:04.308330 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10156281-22cc-4d8e-b6ff-8a756c917f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:04.309384 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10156281-22cc-4d8e-b6ff-8a756c917f27 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:04.309917 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10156281-22cc-4d8e-b6ff-8a756c917f27 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:04.310357 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10156281-22cc-4d8e-b6ff-8a756c917f27 None admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:04.311454 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10156281-22cc-4d8e-b6ff-8a756c917f27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:37:04.312655 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10156281-22cc-4d8e-b6ff-8a756c917f27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:04.313306 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10156281-22cc-4d8e-b6ff-8a756c917f27 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:04.342760 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 9/20] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:37:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:37:04.343667 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e13d62-b748-436b-8275-fb115c5f1390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:04.344306 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e13d62-b748-436b-8275-fb115c5f1390 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:04.344583 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e13d62-b748-436b-8275-fb115c5f1390 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:04.344849 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e13d62-b748-436b-8275-fb115c5f1390 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:04.345671 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e13d62-b748-436b-8275-fb115c5f1390 None admin] RBAC: Adding query filter params (role.id=f022705fa6ce43828345ef50b3f7efc9, scope.domain.id=default, user.id=3ee86ed717254b8d8e892338e3d639aa) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:37:04.345953 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e13d62-b748-436b-8275-fb115c5f1390 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:04.347452 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e13d62-b748-436b-8275-fb115c5f1390 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:04.357568 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 12/21] 10.222.0.60 () {56 vars in 1322 bytes} [Sat Sep 24 19:37:04 2022] GET /identity/v3/role_assignments?user.id=3ee86ed717254b8d8e892338e3d639aa&scope.domain.id=default&role.id=f022705fa6ce43828345ef50b3f7efc9 => generated 233 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:37:07.097187 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229964e-a85d-45b5-8a97-694505741822 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:07.097728 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229964e-a85d-45b5-8a97-694505741822 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:07.097830 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229964e-a85d-45b5-8a97-694505741822 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:07.099119 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 10/22] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:37:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:37:07.115259 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a84c3-0625-4ca6-94a3-c5315db392b0 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:07.115800 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a84c3-0625-4ca6-94a3-c5315db392b0 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:07.115800 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a84c3-0625-4ca6-94a3-c5315db392b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:07.138910 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG passlib.handlers.bcrypt [None req-276a84c3-0625-4ca6-94a3-c5315db392b0 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=93400) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 24 19:37:07.139296 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG passlib.handlers.bcrypt [None req-276a84c3-0625-4ca6-94a3-c5315db392b0 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=93400) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 24 19:37:07.197189 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-276a84c3-0625-4ca6-94a3-c5315db392b0 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:37:07.198857 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-276a84c3-0625-4ca6-94a3-c5315db392b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:37:07.259594 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd7281-ba6e-4b19-aacc-020f297cb79c None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:07.260474 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd7281-ba6e-4b19-aacc-020f297cb79c None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:07.260962 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd7281-ba6e-4b19-aacc-020f297cb79c None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:07.262540 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 11/23] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:37:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:37:07.268288 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f57a63-d8ae-4cc6-a66a-f824b7eaf031 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:07.268862 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f57a63-d8ae-4cc6-a66a-f824b7eaf031 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:07.269328 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f57a63-d8ae-4cc6-a66a-f824b7eaf031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:07.300128 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-d6f57a63-d8ae-4cc6-a66a-f824b7eaf031 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:37:07.304620 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-d6f57a63-d8ae-4cc6-a66a-f824b7eaf031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:37:07.333603 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 13/24] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:37:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:37:07.339276 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbf617-cca0-457d-af83-ff2d3269fd9f None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:07.340131 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbf617-cca0-457d-af83-ff2d3269fd9f None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:07.340407 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbf617-cca0-457d-af83-ff2d3269fd9f None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:07.353052 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 14/25] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:37:07 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:37:07.357061 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4d95d-6121-4327-b302-1442bbb8c4bc None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:07.357350 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4d95d-6121-4327-b302-1442bbb8c4bc None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:07.357658 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4d95d-6121-4327-b302-1442bbb8c4bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:07.395276 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-a7c4d95d-6121-4327-b302-1442bbb8c4bc None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:37:07.396527 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-a7c4d95d-6121-4327-b302-1442bbb8c4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:37:07.438083 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:07.452313 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 12/26] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:37:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 19:37:07.528315 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 15/27] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:37:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:37:07.845243 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f57a63-d8ae-4cc6-a66a-f824b7eaf031 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:07.855995 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c4d95d-6121-4327-b302-1442bbb8c4bc None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:08.023740 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c4d95d-6121-4327-b302-1442bbb8c4bc None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:08.042851 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:08.054183 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f57a63-d8ae-4cc6-a66a-f824b7eaf031 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:08.093388 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b45559-8c3e-4dfb-8228-93d8e16ab865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:08.094365 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b45559-8c3e-4dfb-8228-93d8e16ab865 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:08.094674 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b45559-8c3e-4dfb-8228-93d8e16ab865 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:08.094972 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b45559-8c3e-4dfb-8228-93d8e16ab865 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:08.108615 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb4f1b4-6b58-4cd4-b3ef-6dad06e55830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:08.109107 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b45559-8c3e-4dfb-8228-93d8e16ab865 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:37:08.109307 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4f1b4-6b58-4cd4-b3ef-6dad06e55830 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:08.109556 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4f1b4-6b58-4cd4-b3ef-6dad06e55830 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:08.109835 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4f1b4-6b58-4cd4-b3ef-6dad06e55830 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:08.115126 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-48b45559-8c3e-4dfb-8228-93d8e16ab865 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:37:08.115126 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:37:08.115126 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:37:08.115126 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:37:08.115126 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:37:08.115126 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:37:08.115126 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:37:08.115126 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:37:08.115126 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:37:08.115126 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:37:08.115126 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:37:08.115126 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:37:08.115126 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:37:08.115126 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:37:08.115126 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:37:08.115126 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:37:08.116341 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:37:08.116341 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:37:08.116341 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:37:08.116341 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:37:08.116341 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:37:08.116341 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:37:08.116341 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:37:08.116341 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:37:08.116341 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:37:08.116341 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:37:08.116341 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:37:08.116341 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:37:08.116341 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:37:08.116341 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:37:08.116341 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:37:08.116341 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:37:08.117090 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:37:08.117090 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:37:08.117090 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:37:08.117090 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:37:08.117090 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:37:08.117090 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:37:08.117090 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:37:08.117090 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:37:08.117090 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:37:08.117090 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:37:08.117090 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:37:08.117090 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:37:08.117090 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 16/28] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Sep 24 19:37:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:37:08.120415 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273562d-2012-4e71-9def-68c08fb294cc None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:08.120747 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273562d-2012-4e71-9def-68c08fb294cc None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:08.121585 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273562d-2012-4e71-9def-68c08fb294cc None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:08.122066 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb4f1b4-6b58-4cd4-b3ef-6dad06e55830 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:08.123175 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 17/29] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:37:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:37:08.123679 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb4f1b4-6b58-4cd4-b3ef-6dad06e55830 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:08.123901 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6273562d-2012-4e71-9def-68c08fb294cc None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:08.143774 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-5eb4f1b4-6b58-4cd4-b3ef-6dad06e55830 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:37:08.143774 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:37:08.143774 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:37:08.143774 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:37:08.143774 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:37:08.143774 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:37:08.143774 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:37:08.143774 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:37:08.143774 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:37:08.143774 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:37:08.143774 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:37:08.143774 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:37:08.143774 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:37:08.143774 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:37:08.143774 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:37:08.143774 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:37:08.146220 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:37:08.146220 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:37:08.146220 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:37:08.146220 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:37:08.146220 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:37:08.146220 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:37:08.146220 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:37:08.146220 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:37:08.146220 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:37:08.146220 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:37:08.146220 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:37:08.146220 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:37:08.146220 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:37:08.146220 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:37:08.146220 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:37:08.146220 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:37:08.146220 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:37:08.148055 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:37:08.148055 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:37:08.148055 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:37:08.148055 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 13/30] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:37:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:37:08.148055 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb4f1b4-6b58-4cd4-b3ef-6dad06e55830 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:08.148687 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:08.257717 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6273562d-2012-4e71-9def-68c08fb294cc None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:08.273196 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb4f1b4-6b58-4cd4-b3ef-6dad06e55830 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:08.295178 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f0fad-130a-4fc9-a134-7aea9328efca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:08.295796 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f0fad-130a-4fc9-a134-7aea9328efca None admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:08.296082 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f0fad-130a-4fc9-a134-7aea9328efca None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:08.296360 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f0fad-130a-4fc9-a134-7aea9328efca None admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:08.297032 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133f0fad-130a-4fc9-a134-7aea9328efca None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:08.298515 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133f0fad-130a-4fc9-a134-7aea9328efca None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:08.313881 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc87bc47-cbd0-4424-811d-8bad1815da69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:08.319346 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc87bc47-cbd0-4424-811d-8bad1815da69 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:08.319346 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc87bc47-cbd0-4424-811d-8bad1815da69 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:08.319346 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc87bc47-cbd0-4424-811d-8bad1815da69 None admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:08.319346 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc87bc47-cbd0-4424-811d-8bad1815da69 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:37:08.319346 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc87bc47-cbd0-4424-811d-8bad1815da69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:08.319346 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc87bc47-cbd0-4424-811d-8bad1815da69 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:08.331166 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 14/31] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Sep 24 19:37:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:08.332643 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2cc25-20d2-4e7b-8f0d-5d49cb82b7da None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:08.332998 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2cc25-20d2-4e7b-8f0d-5d49cb82b7da None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:08.333343 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2cc25-20d2-4e7b-8f0d-5d49cb82b7da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:08.355932 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-7ae2cc25-20d2-4e7b-8f0d-5d49cb82b7da None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:37:08.357242 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-7ae2cc25-20d2-4e7b-8f0d-5d49cb82b7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:37:08.359573 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:08.438196 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 15/32] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:37:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:37:08.439339 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae2cc25-20d2-4e7b-8f0d-5d49cb82b7da None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:08.559972 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae2cc25-20d2-4e7b-8f0d-5d49cb82b7da None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:08.685880 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 18/33] 10.222.0.60 () {60 vars in 1131 bytes} [Sat Sep 24 19:37:08 2022] POST /identity/v3/roles => generated 219 bytes in 457 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:37:08.685880 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f0fad-130a-4fc9-a134-7aea9328efca None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:08.686619 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e872c8-847e-40bf-ae9f-61e1d7ee85c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:08.686619 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e872c8-847e-40bf-ae9f-61e1d7ee85c0 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:08.686619 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e872c8-847e-40bf-ae9f-61e1d7ee85c0 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:08.686619 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e872c8-847e-40bf-ae9f-61e1d7ee85c0 None admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:08.686891 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e872c8-847e-40bf-ae9f-61e1d7ee85c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:37:08.686891 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e872c8-847e-40bf-ae9f-61e1d7ee85c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:08.686891 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e872c8-847e-40bf-ae9f-61e1d7ee85c0 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:08.686891 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:08.686891 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 16/34] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:37:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:08.686891 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cbf153-c958-436a-8183-43dfa4577a30 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:08.686891 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cbf153-c958-436a-8183-43dfa4577a30 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:08.687374 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cbf153-c958-436a-8183-43dfa4577a30 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:08.687374 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 17/35] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:37:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:37:08.687374 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d27c59-50d7-4b58-8162-1584c974a391 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:08.687374 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d27c59-50d7-4b58-8162-1584c974a391 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:08.687374 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d27c59-50d7-4b58-8162-1584c974a391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:08.722876 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-91d27c59-50d7-4b58-8162-1584c974a391 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:37:08.724107 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-91d27c59-50d7-4b58-8162-1584c974a391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:37:08.759305 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:08.809040 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f0fad-130a-4fc9-a134-7aea9328efca None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:08.853824 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 18/36] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:37:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:37:08.854610 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d27c59-50d7-4b58-8162-1584c974a391 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:08.863225 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98431f5-d150-4691-822f-ce19b2cd6c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:08.864277 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98431f5-d150-4691-822f-ce19b2cd6c94 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:08.864829 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98431f5-d150-4691-822f-ce19b2cd6c94 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:08.865355 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98431f5-d150-4691-822f-ce19b2cd6c94 None admin] PATH_INFO: `/v3/users/3ee86ed717254b8d8e892338e3d639aa` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:08.867525 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98431f5-d150-4691-822f-ce19b2cd6c94 None admin] RBAC: Authorizing `identity:get_user(user_id=3ee86ed717254b8d8e892338e3d639aa)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:08.869502 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98431f5-d150-4691-822f-ce19b2cd6c94 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:08.871720 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 19/37] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Sep 24 19:37:08 2022] GET /identity/v3/users/3ee86ed717254b8d8e892338e3d639aa => generated 247 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:08.872887 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98431f5-d150-4691-822f-ce19b2cd6c94 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:08.994358 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d27c59-50d7-4b58-8162-1584c974a391 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:09.023150 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98431f5-d150-4691-822f-ce19b2cd6c94 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:09.025935 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:09.034820 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de021f9-dcbc-49e6-abbb-e3db7cbfdf9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:09.046016 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de021f9-dcbc-49e6-abbb-e3db7cbfdf9d None admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:09.046016 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de021f9-dcbc-49e6-abbb-e3db7cbfdf9d None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:09.046016 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de021f9-dcbc-49e6-abbb-e3db7cbfdf9d None admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:09.046016 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de021f9-dcbc-49e6-abbb-e3db7cbfdf9d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:09.046016 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de021f9-dcbc-49e6-abbb-e3db7cbfdf9d None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:09.080479 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429e6209-ab64-4121-9e20-d86b36c795c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:09.081097 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e6209-ab64-4121-9e20-d86b36c795c4 None admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:09.081376 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e6209-ab64-4121-9e20-d86b36c795c4 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:09.081688 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e6209-ab64-4121-9e20-d86b36c795c4 None admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:09.082370 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429e6209-ab64-4121-9e20-d86b36c795c4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:09.083747 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429e6209-ab64-4121-9e20-d86b36c795c4 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:09.197145 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 20/38] 10.222.0.60 () {60 vars in 1131 bytes} [Sat Sep 24 19:37:08 2022] POST /identity/v3/roles => generated 225 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:37:09.197849 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429e6209-ab64-4121-9e20-d86b36c795c4 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:09.201772 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:09.274464 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 19/39] 10.222.0.60 () {60 vars in 1141 bytes} [Sat Sep 24 19:37:08 2022] POST /identity/v3/projects => generated 301 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:37:09.274464 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab410e-d3fc-4aec-b9ab-90664bf6bd36 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:09.274464 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab410e-d3fc-4aec-b9ab-90664bf6bd36 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:09.274464 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab410e-d3fc-4aec-b9ab-90664bf6bd36 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:09.274464 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 20/40] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:37:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:37:09.274464 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab410e-d3fc-4aec-b9ab-90664bf6bd36 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:09.339344 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429e6209-ab64-4121-9e20-d86b36c795c4 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:09.386134 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9f19a8-6b87-40a1-b13c-d58ad20162a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:09.386986 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9f19a8-6b87-40a1-b13c-d58ad20162a9 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:09.387341 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9f19a8-6b87-40a1-b13c-d58ad20162a9 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:09.387697 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9f19a8-6b87-40a1-b13c-d58ad20162a9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:09.389335 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9f19a8-6b87-40a1-b13c-d58ad20162a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:09.391129 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9f19a8-6b87-40a1-b13c-d58ad20162a9 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:09.393034 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 21/41] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:37:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:09.394525 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec8e60-1a57-479e-a3b0-6eee07f34389 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:09.394883 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec8e60-1a57-479e-a3b0-6eee07f34389 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:09.395230 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec8e60-1a57-479e-a3b0-6eee07f34389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:09.417148 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-73ec8e60-1a57-479e-a3b0-6eee07f34389 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:37:09.418796 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-73ec8e60-1a57-479e-a3b0-6eee07f34389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:37:09.509127 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 22/42] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:37:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:37:09.510203 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec8e60-1a57-479e-a3b0-6eee07f34389 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:09.512639 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:09.530150 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab410e-d3fc-4aec-b9ab-90664bf6bd36 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:09.579144 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956acba6-8f3a-4981-bcff-77031b5cf257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:09.579775 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956acba6-8f3a-4981-bcff-77031b5cf257 None admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:09.580062 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956acba6-8f3a-4981-bcff-77031b5cf257 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:09.580337 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956acba6-8f3a-4981-bcff-77031b5cf257 None admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:09.581050 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956acba6-8f3a-4981-bcff-77031b5cf257 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:09.582661 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956acba6-8f3a-4981-bcff-77031b5cf257 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:09.628919 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec8e60-1a57-479e-a3b0-6eee07f34389 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:09.666586 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d327bbd5-1863-4266-9253-608115bed905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:09.682009 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327bbd5-1863-4266-9253-608115bed905 None admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:09.682009 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327bbd5-1863-4266-9253-608115bed905 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:09.682009 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327bbd5-1863-4266-9253-608115bed905 None admin] PATH_INFO: `/v3/domains/default/users/3ee86ed717254b8d8e892338e3d639aa/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:09.682009 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d327bbd5-1863-4266-9253-608115bed905 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=3ee86ed717254b8d8e892338e3d639aa, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:09.682009 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d327bbd5-1863-4266-9253-608115bed905 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:09.722133 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 21/43] 10.222.0.60 () {60 vars in 1131 bytes} [Sat Sep 24 19:37:09 2022] POST /identity/v3/roles => generated 223 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:37:09.789931 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956acba6-8f3a-4981-bcff-77031b5cf257 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:09.801668 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 23/44] 10.222.0.60 () {58 vars in 1361 bytes} [Sat Sep 24 19:37:09 2022] PUT /identity/v3/domains/default/users/3ee86ed717254b8d8e892338e3d639aa/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:37:09.845476 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:09.927769 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956acba6-8f3a-4981-bcff-77031b5cf257 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:09.972305 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc56abd-0358-435c-adbc-2877b6a5a9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:09.972978 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc56abd-0358-435c-adbc-2877b6a5a9de None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:09.973263 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc56abd-0358-435c-adbc-2877b6a5a9de None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:09.973572 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc56abd-0358-435c-adbc-2877b6a5a9de None admin] PATH_INFO: `/v3/domains/default` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:09.974877 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc56abd-0358-435c-adbc-2877b6a5a9de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:09.976371 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc56abd-0358-435c-adbc-2877b6a5a9de None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:09.978444 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 22/45] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:37:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:37:09.984569 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d327bbd5-1863-4266-9253-608115bed905 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:10.049273 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:10.088886 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d327bbd5-1863-4266-9253-608115bed905 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:10.123238 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90239d90-10f9-4fb3-a021-b78f60d3c671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:10.123858 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90239d90-10f9-4fb3-a021-b78f60d3c671 None admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:10.124142 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90239d90-10f9-4fb3-a021-b78f60d3c671 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:10.124413 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90239d90-10f9-4fb3-a021-b78f60d3c671 None admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:10.125077 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90239d90-10f9-4fb3-a021-b78f60d3c671 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:10.126568 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90239d90-10f9-4fb3-a021-b78f60d3c671 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:10.232126 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 24/46] 10.222.0.60 () {60 vars in 1141 bytes} [Sat Sep 24 19:37:09 2022] POST /identity/v3/projects => generated 312 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:37:12.014993 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d568b-c1bd-4d57-b147-6223ee5ad23e None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:12.015519 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d568b-c1bd-4d57-b147-6223ee5ad23e None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:12.015519 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d568b-c1bd-4d57-b147-6223ee5ad23e None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:12.016779 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 23/47] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:37:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:37:12.022490 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85088a-a784-4dc3-99ef-3f14386859e4 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:12.022954 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85088a-a784-4dc3-99ef-3f14386859e4 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:12.023039 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85088a-a784-4dc3-99ef-3f14386859e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:12.042374 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-2d85088a-a784-4dc3-99ef-3f14386859e4 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:37:12.043605 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-2d85088a-a784-4dc3-99ef-3f14386859e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:37:12.221559 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 25/48] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:37:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:37:12.427090 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d60a2e-d14a-4edb-ad17-791009d8df33 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:12.427382 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d60a2e-d14a-4edb-ad17-791009d8df33 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:12.427665 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d60a2e-d14a-4edb-ad17-791009d8df33 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:12.429029 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 24/49] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:37:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:37:12.434960 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62d70d-94a9-4a2c-af55-ad8ed48962c9 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:12.435252 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62d70d-94a9-4a2c-af55-ad8ed48962c9 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:12.435531 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62d70d-94a9-4a2c-af55-ad8ed48962c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:12.454066 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-1d62d70d-94a9-4a2c-af55-ad8ed48962c9 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:37:12.455257 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-1d62d70d-94a9-4a2c-af55-ad8ed48962c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:37:12.493280 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d60a2e-d14a-4edb-ad17-791009d8df33 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:12.496711 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:12.525678 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 26/50] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:37:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:37:12.599237 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d60a2e-d14a-4edb-ad17-791009d8df33 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:12.609124 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:12.635303 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470a72a-0e78-4271-a5cb-c36d79f7e4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:12.635957 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470a72a-0e78-4271-a5cb-c36d79f7e4e5 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:12.636234 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470a72a-0e78-4271-a5cb-c36d79f7e4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:12.636503 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470a72a-0e78-4271-a5cb-c36d79f7e4e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:12.649375 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8470a72a-0e78-4271-a5cb-c36d79f7e4e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:37:12.656565 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-8470a72a-0e78-4271-a5cb-c36d79f7e4e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:37:12.656565 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:37:12.656565 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:37:12.656565 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:37:12.656565 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:37:12.656565 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:37:12.656565 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:37:12.656565 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:37:12.656565 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:37:12.656565 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:37:12.656565 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:37:12.656565 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:37:12.656565 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:37:12.656565 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:37:12.656565 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:37:12.656565 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:37:12.657510 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:37:12.657510 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:37:12.657510 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:37:12.657510 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:37:12.657510 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:37:12.657510 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:37:12.657510 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:37:12.657510 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:37:12.657510 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:37:12.657510 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:37:12.657510 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:37:12.657510 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:37:12.657510 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:37:12.657510 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:37:12.657510 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:37:12.657510 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:37:12.658310 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:37:12.658310 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:37:12.658310 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:37:12.658310 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:37:12.658310 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:37:12.658310 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:37:12.658310 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:37:12.658310 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:37:12.658310 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:37:12.658310 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:37:12.658310 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:37:12.658310 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:37:12.658310 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 25/51] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Sep 24 19:37:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:37:12.663913 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d62d70d-94a9-4a2c-af55-ad8ed48962c9 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:12.770952 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d62d70d-94a9-4a2c-af55-ad8ed48962c9 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:12.796298 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470a72a-0e78-4271-a5cb-c36d79f7e4e5 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:12.810874 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23547eb-644b-4ab7-970a-00a0b6baaa39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:12.811514 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23547eb-644b-4ab7-970a-00a0b6baaa39 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:12.811799 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23547eb-644b-4ab7-970a-00a0b6baaa39 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:12.812080 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23547eb-644b-4ab7-970a-00a0b6baaa39 None admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:12.812761 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23547eb-644b-4ab7-970a-00a0b6baaa39 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:37:12.813073 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23547eb-644b-4ab7-970a-00a0b6baaa39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:12.814505 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23547eb-644b-4ab7-970a-00a0b6baaa39 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:12.823816 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 27/52] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Sep 24 19:37:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:12.829679 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23547eb-644b-4ab7-970a-00a0b6baaa39 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:12.864727 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:12.906328 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470a72a-0e78-4271-a5cb-c36d79f7e4e5 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:12.935590 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23547eb-644b-4ab7-970a-00a0b6baaa39 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:12.947829 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be6e3c-ec6f-43c1-aefd-3922794d2e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:12.947829 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be6e3c-ec6f-43c1-aefd-3922794d2e4d None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:12.947829 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be6e3c-ec6f-43c1-aefd-3922794d2e4d None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:12.947829 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be6e3c-ec6f-43c1-aefd-3922794d2e4d None admin] PATH_INFO: `/v3/domains/default` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:12.948284 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be6e3c-ec6f-43c1-aefd-3922794d2e4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:12.949327 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be6e3c-ec6f-43c1-aefd-3922794d2e4d None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:12.950969 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 26/53] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:37:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:37:12.956389 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be6e3c-ec6f-43c1-aefd-3922794d2e4d None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:12.974070 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf514624-54bc-44c9-a84d-22de916bcdba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:12.975413 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf514624-54bc-44c9-a84d-22de916bcdba None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:12.975413 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf514624-54bc-44c9-a84d-22de916bcdba None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:12.975584 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf514624-54bc-44c9-a84d-22de916bcdba None admin] PATH_INFO: `/v3/users/3ee86ed717254b8d8e892338e3d639aa` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:12.976624 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf514624-54bc-44c9-a84d-22de916bcdba None admin] RBAC: Authorizing `identity:get_user(user_id=3ee86ed717254b8d8e892338e3d639aa)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:12.978149 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf514624-54bc-44c9-a84d-22de916bcdba None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:12.979804 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 28/54] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Sep 24 19:37:12 2022] GET /identity/v3/users/3ee86ed717254b8d8e892338e3d639aa => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:37:12.985190 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf514624-54bc-44c9-a84d-22de916bcdba None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:13.000136 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:13.069362 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be6e3c-ec6f-43c1-aefd-3922794d2e4d None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:13.106186 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d82e63-53d4-4928-b76f-c12b7f5b2a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:13.106583 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf514624-54bc-44c9-a84d-22de916bcdba None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:13.107262 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d82e63-53d4-4928-b76f-c12b7f5b2a6a None admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:13.107262 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d82e63-53d4-4928-b76f-c12b7f5b2a6a None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:13.107634 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d82e63-53d4-4928-b76f-c12b7f5b2a6a None admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:13.108363 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d82e63-53d4-4928-b76f-c12b7f5b2a6a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:13.109059 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:13.110011 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d82e63-53d4-4928-b76f-c12b7f5b2a6a None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:13.145188 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff2785f-20f7-479f-a3bb-145b459b17be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:13.145865 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2785f-20f7-479f-a3bb-145b459b17be None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:13.146149 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2785f-20f7-479f-a3bb-145b459b17be None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:13.146423 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2785f-20f7-479f-a3bb-145b459b17be None admin] PATH_INFO: `/v3/domains/default` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:13.147573 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff2785f-20f7-479f-a3bb-145b459b17be None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:13.149022 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff2785f-20f7-479f-a3bb-145b459b17be None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:13.150659 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 29/55] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:37:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:37:13.156339 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff2785f-20f7-479f-a3bb-145b459b17be None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:13.225130 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 27/56] 10.222.0.60 () {60 vars in 1140 bytes} [Sat Sep 24 19:37:12 2022] POST /identity/v3/projects => generated 298 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 19:37:13.264189 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff2785f-20f7-479f-a3bb-145b459b17be None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:13.302728 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daea519-8966-450f-9ca7-b1274b30d43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:13.303367 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daea519-8966-450f-9ca7-b1274b30d43d None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:13.303652 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daea519-8966-450f-9ca7-b1274b30d43d None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:13.303930 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daea519-8966-450f-9ca7-b1274b30d43d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:13.304681 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daea519-8966-450f-9ca7-b1274b30d43d None admin] RBAC: Adding query filter params (role.id=f022705fa6ce43828345ef50b3f7efc9, scope.domain.id=default, user.id=3ee86ed717254b8d8e892338e3d639aa) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:37:13.305821 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daea519-8966-450f-9ca7-b1274b30d43d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:13.307248 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daea519-8966-450f-9ca7-b1274b30d43d None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:13.313945 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 30/57] 10.222.0.60 () {56 vars in 1322 bytes} [Sat Sep 24 19:37:13 2022] GET /identity/v3/role_assignments?user.id=3ee86ed717254b8d8e892338e3d639aa&scope.domain.id=default&role.id=f022705fa6ce43828345ef50b3f7efc9 => generated 530 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:37:15.463526 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603fb28-9003-426f-80b0-08e215633184 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:15.464078 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603fb28-9003-426f-80b0-08e215633184 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:15.464078 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603fb28-9003-426f-80b0-08e215633184 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:15.465401 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 28/58] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:37:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:37:15.471082 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc365ee8-5e2e-4738-86da-9d998ca8e11d None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:15.471558 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc365ee8-5e2e-4738-86da-9d998ca8e11d None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:15.471652 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc365ee8-5e2e-4738-86da-9d998ca8e11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:15.490333 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-fc365ee8-5e2e-4738-86da-9d998ca8e11d None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:37:15.491533 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-fc365ee8-5e2e-4738-86da-9d998ca8e11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:37:15.523763 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:15.562609 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 31/59] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:37:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:37:15.831954 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7603fb28-9003-426f-80b0-08e215633184 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:15.922881 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:15.935435 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7603fb28-9003-426f-80b0-08e215633184 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:15.971069 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b959e0d-73bc-4c5c-8654-60d5c424e58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:15.971717 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b959e0d-73bc-4c5c-8654-60d5c424e58e None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:15.972002 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b959e0d-73bc-4c5c-8654-60d5c424e58e None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:15.972278 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b959e0d-73bc-4c5c-8654-60d5c424e58e None admin] PATH_INFO: `/v3/domains/default` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:15.973422 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b959e0d-73bc-4c5c-8654-60d5c424e58e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:15.974922 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b959e0d-73bc-4c5c-8654-60d5c424e58e None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:15.976537 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 29/60] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:37:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:15.982703 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc365ee8-5e2e-4738-86da-9d998ca8e11d None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:16.084453 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc365ee8-5e2e-4738-86da-9d998ca8e11d None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:16.118696 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f3b444-df75-42b4-a702-601aabcd81e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:16.119310 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f3b444-df75-42b4-a702-601aabcd81e8 None admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:16.119598 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f3b444-df75-42b4-a702-601aabcd81e8 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:16.119876 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f3b444-df75-42b4-a702-601aabcd81e8 None admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:16.120558 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f3b444-df75-42b4-a702-601aabcd81e8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:16.122042 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f3b444-df75-42b4-a702-601aabcd81e8 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:16.235709 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 32/61] 10.222.0.60 () {60 vars in 1132 bytes} [Sat Sep 24 19:37:15 2022] POST /identity/v3/users => generated 275 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:37:19.409451 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d91d1-7ff1-4417-917a-d21cadb69ce5 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:19.409451 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d91d1-7ff1-4417-917a-d21cadb69ce5 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:19.409451 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d91d1-7ff1-4417-917a-d21cadb69ce5 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:19.410636 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 30/62] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:37:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:37:19.417397 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae263966-58eb-4034-8738-bb77cf77e238 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:19.418343 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae263966-58eb-4034-8738-bb77cf77e238 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:19.418829 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae263966-58eb-4034-8738-bb77cf77e238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:19.446692 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-ae263966-58eb-4034-8738-bb77cf77e238 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:37:19.447936 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-ae263966-58eb-4034-8738-bb77cf77e238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:37:19.466753 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:19.547865 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 33/63] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:37:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 19:37:19.751660 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a4dc7-43db-4aee-a50b-9145027067f0 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:19.752370 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a4dc7-43db-4aee-a50b-9145027067f0 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:19.752834 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a4dc7-43db-4aee-a50b-9145027067f0 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:19.754429 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 31/64] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:37:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:37:19.761081 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5784880-2050-4aec-8586-f73dabc8401b None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:19.761377 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5784880-2050-4aec-8586-f73dabc8401b None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:19.761698 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5784880-2050-4aec-8586-f73dabc8401b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:19.767877 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca19c57-a60e-4ec3-8a70-7247a47b9295 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:19.768419 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca19c57-a60e-4ec3-8a70-7247a47b9295 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:19.768903 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca19c57-a60e-4ec3-8a70-7247a47b9295 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:19.770766 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 32/65] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:37:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:37:19.776455 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c144490e-04d9-478e-a3a7-736935031d88 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:19.776748 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c144490e-04d9-478e-a3a7-736935031d88 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:19.777027 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c144490e-04d9-478e-a3a7-736935031d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:19.795933 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-b5784880-2050-4aec-8586-f73dabc8401b None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:37:19.797141 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-b5784880-2050-4aec-8586-f73dabc8401b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:37:19.806353 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-c144490e-04d9-478e-a3a7-736935031d88 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:37:19.808016 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-c144490e-04d9-478e-a3a7-736935031d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:37:19.914597 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 34/66] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:37:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 19:37:19.938941 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 33/67] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:37:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:37:19.968126 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5784880-2050-4aec-8586-f73dabc8401b None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:20.080562 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:20.105777 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5784880-2050-4aec-8586-f73dabc8401b None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:20.158667 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d9004-d9b2-4f41-8bcc-f19313b861d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:20.159322 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d9004-d9b2-4f41-8bcc-f19313b861d9 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:20.159602 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d9004-d9b2-4f41-8bcc-f19313b861d9 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:20.159876 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d9004-d9b2-4f41-8bcc-f19313b861d9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:20.176111 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d9004-d9b2-4f41-8bcc-f19313b861d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:37:20.186347 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-607d9004-d9b2-4f41-8bcc-f19313b861d9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:37:20.186347 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:37:20.186347 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:37:20.186347 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:37:20.186347 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:37:20.186347 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:37:20.186347 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:37:20.186347 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:37:20.186347 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:37:20.186347 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:37:20.186347 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:37:20.186347 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:37:20.186347 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:37:20.186347 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:37:20.186347 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:37:20.186347 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:37:20.187240 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:37:20.187240 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:37:20.187240 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:37:20.187240 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:37:20.187240 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:37:20.187240 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:37:20.187240 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:37:20.187240 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:37:20.187240 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:37:20.187240 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:37:20.187240 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:37:20.187240 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:37:20.187240 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:37:20.187240 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:37:20.187240 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:37:20.187240 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:37:20.188420 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:37:20.188420 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:37:20.188420 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:37:20.188420 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:37:20.188420 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:37:20.188420 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:37:20.188420 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:37:20.188420 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:37:20.188420 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:37:20.188420 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:37:20.188420 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:37:20.188420 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:37:20.188420 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 35/68] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Sep 24 19:37:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:37:20.195680 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c144490e-04d9-478e-a3a7-736935031d88 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:20.258369 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d9004-d9b2-4f41-8bcc-f19313b861d9 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:20.325956 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:20.364177 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c144490e-04d9-478e-a3a7-736935031d88 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:20.430870 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d9004-d9b2-4f41-8bcc-f19313b861d9 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:20.431590 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a350b-f571-49e2-9e18-f992f4bb17ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:20.432227 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a350b-f571-49e2-9e18-f992f4bb17ad None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:20.432506 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a350b-f571-49e2-9e18-f992f4bb17ad None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:20.432779 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a350b-f571-49e2-9e18-f992f4bb17ad None admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:20.433452 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a350b-f571-49e2-9e18-f992f4bb17ad None admin] RBAC: Adding query filter params (name=member) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:37:20.433800 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a350b-f571-49e2-9e18-f992f4bb17ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:20.436494 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a350b-f571-49e2-9e18-f992f4bb17ad None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:20.452539 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 34/69] 10.222.0.60 () {56 vars in 1101 bytes} [Sat Sep 24 19:37:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:37:20.453477 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a350b-f571-49e2-9e18-f992f4bb17ad None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:20.487352 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191f265-9ea5-4c77-a7d4-9beccd61b937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:20.488009 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191f265-9ea5-4c77-a7d4-9beccd61b937 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:20.488293 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191f265-9ea5-4c77-a7d4-9beccd61b937 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:20.488567 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191f265-9ea5-4c77-a7d4-9beccd61b937 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:20.503136 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4191f265-9ea5-4c77-a7d4-9beccd61b937 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:37:20.512197 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-4191f265-9ea5-4c77-a7d4-9beccd61b937 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:37:20.512197 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:37:20.512197 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:37:20.512197 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:37:20.512197 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:37:20.512197 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:37:20.512197 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:37:20.512197 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:37:20.512197 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:37:20.512197 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:37:20.512197 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:37:20.512197 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:37:20.512197 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:37:20.512197 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:37:20.512197 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:37:20.512197 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:37:20.513118 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:37:20.513118 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:37:20.513118 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:37:20.513118 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:37:20.513118 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:37:20.513118 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:37:20.513118 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:37:20.513118 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:37:20.513118 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:37:20.513118 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:37:20.513118 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:37:20.513118 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:37:20.513118 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:37:20.513118 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:37:20.513118 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:37:20.513118 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:37:20.513906 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:37:20.513906 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:37:20.513906 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:37:20.513906 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:37:20.513906 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:37:20.513906 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:37:20.513906 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:37:20.513906 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:37:20.513906 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:37:20.513906 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:37:20.513906 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:37:20.513906 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:37:20.513906 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 36/70] 10.222.0.60 () {56 vars in 1114 bytes} [Sat Sep 24 19:37:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:37:20.513906 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191f265-9ea5-4c77-a7d4-9beccd61b937 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:20.525350 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:20.584965 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a350b-f571-49e2-9e18-f992f4bb17ad None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:20.629374 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b677f-61cf-4c62-bcc3-fe2b2f92fa9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:20.630154 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b677f-61cf-4c62-bcc3-fe2b2f92fa9a None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:20.630443 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b677f-61cf-4c62-bcc3-fe2b2f92fa9a None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:20.630749 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b677f-61cf-4c62-bcc3-fe2b2f92fa9a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:20.638232 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191f265-9ea5-4c77-a7d4-9beccd61b937 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:20.646047 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8b677f-61cf-4c62-bcc3-fe2b2f92fa9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:37:20.653127 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-aa8b677f-61cf-4c62-bcc3-fe2b2f92fa9a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:37:20.653127 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:37:20.653127 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:37:20.653127 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:37:20.653127 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:37:20.653127 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:37:20.653127 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:37:20.653127 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:37:20.653127 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:37:20.653127 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:37:20.653127 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:37:20.653127 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:37:20.653127 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:37:20.653127 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:37:20.653127 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:37:20.653127 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:37:20.654232 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:37:20.654232 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:37:20.654232 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:37:20.654232 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:37:20.654232 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:37:20.654232 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:37:20.654232 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:37:20.654232 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:37:20.654232 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:37:20.654232 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:37:20.654232 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:37:20.654232 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:37:20.654232 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:37:20.654232 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:37:20.654232 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:37:20.654232 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:37:20.655109 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:37:20.655109 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:37:20.655109 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:37:20.655109 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:37:20.655109 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:37:20.655109 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:37:20.655109 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:37:20.655109 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:37:20.655109 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:37:20.655109 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:37:20.655109 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:37:20.655109 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:37:20.655109 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 35/71] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Sep 24 19:37:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:37:20.657292 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a96dc-404d-4441-bab7-505abd015308 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:20.657615 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a96dc-404d-4441-bab7-505abd015308 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:20.657894 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a96dc-404d-4441-bab7-505abd015308 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:20.659291 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 36/72] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:37:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:37:20.660020 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a96dc-404d-4441-bab7-505abd015308 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:20.673436 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:20.691157 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25c5fac-5133-4025-a753-cf676d68c572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:20.691901 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c5fac-5133-4025-a753-cf676d68c572 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:20.692186 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c5fac-5133-4025-a753-cf676d68c572 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:20.692456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c5fac-5133-4025-a753-cf676d68c572 None admin] PATH_INFO: `/v3/users/517c8b8a3dbb4c26bb946e9641d03bb6` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:20.710328 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25c5fac-5133-4025-a753-cf676d68c572 None admin] RBAC: Authorizing `identity:get_user(user_id=517c8b8a3dbb4c26bb946e9641d03bb6)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:20.711794 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25c5fac-5133-4025-a753-cf676d68c572 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:20.719736 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 37/73] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Sep 24 19:37:20 2022] GET /identity/v3/users/517c8b8a3dbb4c26bb946e9641d03bb6 => generated 275 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:20.719736 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200ad0e-3cd9-4ac2-b63e-35eca05b513c None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:20.719736 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200ad0e-3cd9-4ac2-b63e-35eca05b513c None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:20.719736 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200ad0e-3cd9-4ac2-b63e-35eca05b513c None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:20.719736 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 38/74] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:37:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:37:20.719736 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200ad0e-3cd9-4ac2-b63e-35eca05b513c None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:20.787381 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a96dc-404d-4441-bab7-505abd015308 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:20.789731 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:20.827154 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a8658-90d8-4e11-bcb5-8efeb0203f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:20.828100 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a8658-90d8-4e11-bcb5-8efeb0203f5a None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:20.828553 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a8658-90d8-4e11-bcb5-8efeb0203f5a None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:20.828900 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a8658-90d8-4e11-bcb5-8efeb0203f5a None admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:20.829688 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a8658-90d8-4e11-bcb5-8efeb0203f5a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:37:20.830092 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a8658-90d8-4e11-bcb5-8efeb0203f5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:20.831747 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a8658-90d8-4e11-bcb5-8efeb0203f5a None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:20.832557 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200ad0e-3cd9-4ac2-b63e-35eca05b513c None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:20.842116 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 37/75] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Sep 24 19:37:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:20.843391 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa627b-97b4-4780-abd3-26f7540606c2 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:20.843676 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa627b-97b4-4780-abd3-26f7540606c2 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:20.843946 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa627b-97b4-4780-abd3-26f7540606c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:20.862631 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-4aaa627b-97b4-4780-abd3-26f7540606c2 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:37:20.863828 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-4aaa627b-97b4-4780-abd3-26f7540606c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:37:20.870421 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d356e5b-7d31-48b5-b2b9-079522490c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:20.871042 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d356e5b-7d31-48b5-b2b9-079522490c10 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:20.871320 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d356e5b-7d31-48b5-b2b9-079522490c10 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:20.871592 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d356e5b-7d31-48b5-b2b9-079522490c10 None admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:20.872270 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d356e5b-7d31-48b5-b2b9-079522490c10 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:37:20.872569 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d356e5b-7d31-48b5-b2b9-079522490c10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:20.873988 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d356e5b-7d31-48b5-b2b9-079522490c10 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:20.882712 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 39/76] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Sep 24 19:37:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:20.883734 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d356e5b-7d31-48b5-b2b9-079522490c10 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:20.935210 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:20.940399 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 38/77] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:37:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:37:20.942571 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd3511-3dd6-4838-98fa-1e763cab59f4 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:20.952029 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd3511-3dd6-4838-98fa-1e763cab59f4 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:20.952029 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd3511-3dd6-4838-98fa-1e763cab59f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:20.975829 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-26fd3511-3dd6-4838-98fa-1e763cab59f4 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:37:20.977726 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-26fd3511-3dd6-4838-98fa-1e763cab59f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:37:20.990662 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d356e5b-7d31-48b5-b2b9-079522490c10 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:21.017418 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:21.031348 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25475803-2c5c-4b5b-8706-d6227e80295a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:21.032090 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25475803-2c5c-4b5b-8706-d6227e80295a None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:21.032373 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25475803-2c5c-4b5b-8706-d6227e80295a None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:21.032647 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25475803-2c5c-4b5b-8706-d6227e80295a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:21.052271 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 39/78] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:37:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:37:21.052948 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd3511-3dd6-4838-98fa-1e763cab59f4 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:21.134824 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25475803-2c5c-4b5b-8706-d6227e80295a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:21.137199 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25475803-2c5c-4b5b-8706-d6227e80295a None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:21.191999 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd3511-3dd6-4838-98fa-1e763cab59f4 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:21.231376 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:21.238145 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ffb6e-5da8-4486-ac38-5fa6437b0989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:21.238965 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ffb6e-5da8-4486-ac38-5fa6437b0989 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:21.239258 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ffb6e-5da8-4486-ac38-5fa6437b0989 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:21.239530 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ffb6e-5da8-4486-ac38-5fa6437b0989 None admin] PATH_INFO: `/v3/users/517c8b8a3dbb4c26bb946e9641d03bb6` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:21.240785 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ffb6e-5da8-4486-ac38-5fa6437b0989 None admin] RBAC: Authorizing `identity:get_user(user_id=517c8b8a3dbb4c26bb946e9641d03bb6)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:21.242820 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ffb6e-5da8-4486-ac38-5fa6437b0989 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:21.244800 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 40/79] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Sep 24 19:37:21 2022] GET /identity/v3/users/517c8b8a3dbb4c26bb946e9641d03bb6 => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:21.245374 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ffb6e-5da8-4486-ac38-5fa6437b0989 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:21.270658 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 40/80] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Sep 24 19:37:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:37:21.271868 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25475803-2c5c-4b5b-8706-d6227e80295a None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:21.299316 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:21.371147 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ffb6e-5da8-4486-ac38-5fa6437b0989 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:21.392310 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25475803-2c5c-4b5b-8706-d6227e80295a None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:21.408157 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec1ce5-a6be-485f-9033-ac397025b626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:21.408788 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec1ce5-a6be-485f-9033-ac397025b626 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:21.409074 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec1ce5-a6be-485f-9033-ac397025b626 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:21.409350 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec1ce5-a6be-485f-9033-ac397025b626 None admin] PATH_INFO: `/v3/users/3ee86ed717254b8d8e892338e3d639aa` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:21.410580 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ec1ce5-a6be-485f-9033-ac397025b626 None admin] RBAC: Authorizing `identity:get_user(user_id=3ee86ed717254b8d8e892338e3d639aa)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:21.412065 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ec1ce5-a6be-485f-9033-ac397025b626 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:21.413719 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 41/81] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Sep 24 19:37:21 2022] GET /identity/v3/users/3ee86ed717254b8d8e892338e3d639aa => generated 247 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:21.415167 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec1ce5-a6be-485f-9033-ac397025b626 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:21.431047 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd4023-1d4d-4ae8-9e98-4a5419fdc15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:21.431690 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd4023-1d4d-4ae8-9e98-4a5419fdc15f None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:21.431969 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd4023-1d4d-4ae8-9e98-4a5419fdc15f None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:21.432245 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd4023-1d4d-4ae8-9e98-4a5419fdc15f None admin] PATH_INFO: `/v3/roles/member` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:21.442686 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dd4023-1d4d-4ae8-9e98-4a5419fdc15f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:37:21.448471 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-a3dd4023-1d4d-4ae8-9e98-4a5419fdc15f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:37:21.448471 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:37:21.448471 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:37:21.448471 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:37:21.448471 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:37:21.448471 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:37:21.448471 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:37:21.448471 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:37:21.448471 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:37:21.448471 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:37:21.448471 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:37:21.448471 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:37:21.448471 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:37:21.448471 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:37:21.448471 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:37:21.448471 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:37:21.449346 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:37:21.449346 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:37:21.449346 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:37:21.449346 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:37:21.449346 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:37:21.449346 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:37:21.449346 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:37:21.449346 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:37:21.449346 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:37:21.449346 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:37:21.449346 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:37:21.449346 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:37:21.449346 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:37:21.449346 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:37:21.449346 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:37:21.449346 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:37:21.450231 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:37:21.450231 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:37:21.450231 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:37:21.450231 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:37:21.450231 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:37:21.450231 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:37:21.450231 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:37:21.450231 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:37:21.450231 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:37:21.450231 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:37:21.450231 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:37:21.450231 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:37:21.450231 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 41/82] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Sep 24 19:37:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:37:21.450892 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd4023-1d4d-4ae8-9e98-4a5419fdc15f None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:21.489575 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:21.528583 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec1ce5-a6be-485f-9033-ac397025b626 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:21.539477 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:21.557898 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd4023-1d4d-4ae8-9e98-4a5419fdc15f None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:21.565126 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310abfa-0765-400f-a385-ea1553e5786f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:21.565765 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310abfa-0765-400f-a385-ea1553e5786f None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:21.566045 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310abfa-0765-400f-a385-ea1553e5786f None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:21.566313 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310abfa-0765-400f-a385-ea1553e5786f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:21.598787 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5608f-ac1f-41df-8ddb-254b6d9bf683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:21.599757 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5608f-ac1f-41df-8ddb-254b6d9bf683 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:21.600203 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5608f-ac1f-41df-8ddb-254b6d9bf683 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:21.600676 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5608f-ac1f-41df-8ddb-254b6d9bf683 None admin] PATH_INFO: `/v3/projects/3363e1213c7f49a4bccd9116d9d698d0` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:21.602883 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a5608f-ac1f-41df-8ddb-254b6d9bf683 None admin] RBAC: Authorizing `identity:get_project(project_id=3363e1213c7f49a4bccd9116d9d698d0)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:21.605624 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a5608f-ac1f-41df-8ddb-254b6d9bf683 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:21.613745 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 42/83] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Sep 24 19:37:21 2022] GET /identity/v3/projects/3363e1213c7f49a4bccd9116d9d698d0 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:21.613745 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5608f-ac1f-41df-8ddb-254b6d9bf683 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:21.637488 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d310abfa-0765-400f-a385-ea1553e5786f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:21.639051 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d310abfa-0765-400f-a385-ea1553e5786f None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:21.721974 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:21.735007 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5608f-ac1f-41df-8ddb-254b6d9bf683 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:21.760937 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 42/84] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Sep 24 19:37:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:37:21.761835 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310abfa-0765-400f-a385-ea1553e5786f None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:21.775053 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc003a-4ae9-45c3-8498-f6a22b6b6615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:21.775701 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc003a-4ae9-45c3-8498-f6a22b6b6615 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:21.775978 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc003a-4ae9-45c3-8498-f6a22b6b6615 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:21.776248 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc003a-4ae9-45c3-8498-f6a22b6b6615 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:21.777368 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbc003a-4ae9-45c3-8498-f6a22b6b6615 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:21.778852 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbc003a-4ae9-45c3-8498-f6a22b6b6615 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:21.780441 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 43/85] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:37:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:21.781217 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc003a-4ae9-45c3-8498-f6a22b6b6615 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:21.800900 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:21.866364 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310abfa-0765-400f-a385-ea1553e5786f None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:21.887372 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc003a-4ae9-45c3-8498-f6a22b6b6615 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:21.902154 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468dc9a0-089c-4060-a320-b5761ee89b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:21.902835 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468dc9a0-089c-4060-a320-b5761ee89b1d None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:21.903110 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468dc9a0-089c-4060-a320-b5761ee89b1d None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:21.903379 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468dc9a0-089c-4060-a320-b5761ee89b1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:21.923990 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccbc193-8177-4578-97b5-a357fe385f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:21.924613 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccbc193-8177-4578-97b5-a357fe385f3d None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:21.924896 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccbc193-8177-4578-97b5-a357fe385f3d None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:21.925172 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccbc193-8177-4578-97b5-a357fe385f3d None admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:21.925889 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccbc193-8177-4578-97b5-a357fe385f3d None admin] RBAC: Adding query filter params (name=member) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:37:21.926199 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccbc193-8177-4578-97b5-a357fe385f3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:21.927578 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccbc193-8177-4578-97b5-a357fe385f3d None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:21.937228 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 44/86] 10.222.0.60 () {56 vars in 1101 bytes} [Sat Sep 24 19:37:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:21.938113 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccbc193-8177-4578-97b5-a357fe385f3d None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:21.942617 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:21.978987 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468dc9a0-089c-4060-a320-b5761ee89b1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:21.980479 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468dc9a0-089c-4060-a320-b5761ee89b1d None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:22.030319 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:22.050398 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccbc193-8177-4578-97b5-a357fe385f3d None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:22.088754 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a7383-0e3a-4453-8f73-5d4ab07e038d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:22.089378 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a7383-0e3a-4453-8f73-5d4ab07e038d None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:22.089695 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a7383-0e3a-4453-8f73-5d4ab07e038d None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:22.089977 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a7383-0e3a-4453-8f73-5d4ab07e038d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:22.090726 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1a7383-0e3a-4453-8f73-5d4ab07e038d None admin] RBAC: Adding query filter params (role.id=3dfa1e29c6a0404388d256728d66e4a1, scope.project.id=3363e1213c7f49a4bccd9116d9d698d0, user.id=517c8b8a3dbb4c26bb946e9641d03bb6) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:37:22.091043 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1a7383-0e3a-4453-8f73-5d4ab07e038d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:22.092479 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1a7383-0e3a-4453-8f73-5d4ab07e038d None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:22.095457 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 43/87] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Sep 24 19:37:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:37:22.096308 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468dc9a0-089c-4060-a320-b5761ee89b1d None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:22.103333 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 45/88] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Sep 24 19:37:21 2022] GET /identity/v3/role_assignments?user.id=517c8b8a3dbb4c26bb946e9641d03bb6&scope.project.id=3363e1213c7f49a4bccd9116d9d698d0&role.id=3dfa1e29c6a0404388d256728d66e4a1 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:22.104164 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a7383-0e3a-4453-8f73-5d4ab07e038d None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:22.182694 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:22.234331 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468dc9a0-089c-4060-a320-b5761ee89b1d None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:22.239754 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a7383-0e3a-4453-8f73-5d4ab07e038d None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:22.276034 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99385001-26b8-4c57-a886-8a501faa78e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:22.276694 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99385001-26b8-4c57-a886-8a501faa78e0 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:22.276972 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99385001-26b8-4c57-a886-8a501faa78e0 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:22.277244 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99385001-26b8-4c57-a886-8a501faa78e0 None admin] PATH_INFO: `/v3/projects/3363e1213c7f49a4bccd9116d9d698d0` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:22.278429 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99385001-26b8-4c57-a886-8a501faa78e0 None admin] RBAC: Authorizing `identity:get_project(project_id=3363e1213c7f49a4bccd9116d9d698d0)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:22.279865 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504115f1-a52c-4bac-bcf7-48ca4e7624c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:22.279982 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99385001-26b8-4c57-a886-8a501faa78e0 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:22.280546 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504115f1-a52c-4bac-bcf7-48ca4e7624c2 None admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:22.280783 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504115f1-a52c-4bac-bcf7-48ca4e7624c2 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:22.281067 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504115f1-a52c-4bac-bcf7-48ca4e7624c2 None admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:22.281993 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 44/89] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Sep 24 19:37:22 2022] GET /identity/v3/projects/3363e1213c7f49a4bccd9116d9d698d0 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:22.282095 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504115f1-a52c-4bac-bcf7-48ca4e7624c2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:22.282826 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99385001-26b8-4c57-a886-8a501faa78e0 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:22.283217 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504115f1-a52c-4bac-bcf7-48ca4e7624c2 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:22.356313 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 46/90] 10.222.0.60 () {60 vars in 1132 bytes} [Sat Sep 24 19:37:22 2022] POST /identity/v3/users => generated 289 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:37:22.357170 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504115f1-a52c-4bac-bcf7-48ca4e7624c2 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:22.373920 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:22.435083 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99385001-26b8-4c57-a886-8a501faa78e0 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:22.488273 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4537070-4d34-4d08-aa81-a561473c0ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:22.488968 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4537070-4d34-4d08-aa81-a561473c0ddd None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:22.489343 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4537070-4d34-4d08-aa81-a561473c0ddd None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:22.489860 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4537070-4d34-4d08-aa81-a561473c0ddd None admin] PATH_INFO: `/v3/users/517c8b8a3dbb4c26bb946e9641d03bb6` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:22.491477 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4537070-4d34-4d08-aa81-a561473c0ddd None admin] RBAC: Authorizing `identity:get_user(user_id=517c8b8a3dbb4c26bb946e9641d03bb6)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:22.493333 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4537070-4d34-4d08-aa81-a561473c0ddd None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:22.495211 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 45/91] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Sep 24 19:37:22 2022] GET /identity/v3/users/517c8b8a3dbb4c26bb946e9641d03bb6 => generated 275 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:22.496140 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4537070-4d34-4d08-aa81-a561473c0ddd None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:22.501420 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:22.541189 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504115f1-a52c-4bac-bcf7-48ca4e7624c2 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:22.598714 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9529eba-c38c-44df-9b15-38f024700888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:22.600380 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9529eba-c38c-44df-9b15-38f024700888 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:22.602665 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9529eba-c38c-44df-9b15-38f024700888 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:22.603023 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9529eba-c38c-44df-9b15-38f024700888 None admin] PATH_INFO: `/v3/projects/3363e1213c7f49a4bccd9116d9d698d0` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:22.605422 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9529eba-c38c-44df-9b15-38f024700888 None admin] RBAC: Authorizing `identity:get_project(project_id=3363e1213c7f49a4bccd9116d9d698d0)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:22.606972 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9529eba-c38c-44df-9b15-38f024700888 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:22.608982 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 47/92] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Sep 24 19:37:22 2022] GET /identity/v3/projects/3363e1213c7f49a4bccd9116d9d698d0 => generated 298 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:22.609698 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9529eba-c38c-44df-9b15-38f024700888 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:22.660585 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4537070-4d34-4d08-aa81-a561473c0ddd None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:22.705585 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:22.723295 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79897d13-f9b5-4025-9b3b-ca53c65c5a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:22.723295 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79897d13-f9b5-4025-9b3b-ca53c65c5a76 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:22.723295 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79897d13-f9b5-4025-9b3b-ca53c65c5a76 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:22.723295 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79897d13-f9b5-4025-9b3b-ca53c65c5a76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:22.723950 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79897d13-f9b5-4025-9b3b-ca53c65c5a76 None admin] RBAC: Adding query filter params (role.id=dd695228990e4288afe29e3cefb75823, scope.project.id=3363e1213c7f49a4bccd9116d9d698d0, user.id=517c8b8a3dbb4c26bb946e9641d03bb6) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:37:22.723950 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79897d13-f9b5-4025-9b3b-ca53c65c5a76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:22.725289 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79897d13-f9b5-4025-9b3b-ca53c65c5a76 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:22.734615 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 46/93] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Sep 24 19:37:22 2022] GET /identity/v3/role_assignments?user.id=517c8b8a3dbb4c26bb946e9641d03bb6&scope.project.id=3363e1213c7f49a4bccd9116d9d698d0&role.id=dd695228990e4288afe29e3cefb75823 => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:22.735521 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79897d13-f9b5-4025-9b3b-ca53c65c5a76 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:22.761565 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9529eba-c38c-44df-9b15-38f024700888 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:22.821715 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451fa48-8a12-4390-90cf-752f6cc706f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:22.823025 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451fa48-8a12-4390-90cf-752f6cc706f5 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:22.823988 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451fa48-8a12-4390-90cf-752f6cc706f5 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:22.824468 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451fa48-8a12-4390-90cf-752f6cc706f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:22.869906 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:22.896403 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79897d13-f9b5-4025-9b3b-ca53c65c5a76 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:22.923361 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6451fa48-8a12-4390-90cf-752f6cc706f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:22.925065 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6451fa48-8a12-4390-90cf-752f6cc706f5 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:22.945407 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a679f5-e41c-45d9-9ae7-cef2e13612dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:22.946102 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a679f5-e41c-45d9-9ae7-cef2e13612dc None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:22.946386 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a679f5-e41c-45d9-9ae7-cef2e13612dc None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:22.946664 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a679f5-e41c-45d9-9ae7-cef2e13612dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:22.947430 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a679f5-e41c-45d9-9ae7-cef2e13612dc None admin] RBAC: Adding query filter params (role.id=f022705fa6ce43828345ef50b3f7efc9, scope.project.id=3363e1213c7f49a4bccd9116d9d698d0, user.id=3ee86ed717254b8d8e892338e3d639aa) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:37:22.947741 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a679f5-e41c-45d9-9ae7-cef2e13612dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:22.949234 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a679f5-e41c-45d9-9ae7-cef2e13612dc None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:22.956602 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 47/94] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Sep 24 19:37:22 2022] GET /identity/v3/role_assignments?user.id=3ee86ed717254b8d8e892338e3d639aa&scope.project.id=3363e1213c7f49a4bccd9116d9d698d0&role.id=f022705fa6ce43828345ef50b3f7efc9 => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:23.042209 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:23.092076 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 48/95] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Sep 24 19:37:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:37:23.109936 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a679f5-e41c-45d9-9ae7-cef2e13612dc None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:23.244903 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a679f5-e41c-45d9-9ae7-cef2e13612dc None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:23.277920 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:23.289971 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c495c-08f2-4a22-84c2-8ec1370904b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:23.290698 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c495c-08f2-4a22-84c2-8ec1370904b2 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:23.290983 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c495c-08f2-4a22-84c2-8ec1370904b2 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:23.291257 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c495c-08f2-4a22-84c2-8ec1370904b2 None admin] PATH_INFO: `/v3/projects/b098a73099e649a4b1378e3e4ecc66f1` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:23.292624 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376c495c-08f2-4a22-84c2-8ec1370904b2 None admin] RBAC: Authorizing `identity:get_project(project_id=b098a73099e649a4b1378e3e4ecc66f1)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:23.294131 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376c495c-08f2-4a22-84c2-8ec1370904b2 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:23.299215 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 48/96] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Sep 24 19:37:23 2022] GET /identity/v3/projects/b098a73099e649a4b1378e3e4ecc66f1 => generated 312 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:23.301809 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451fa48-8a12-4390-90cf-752f6cc706f5 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:23.454882 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451fa48-8a12-4390-90cf-752f6cc706f5 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:23.505163 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5261ead-2e43-486d-b229-65d390bf5a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:23.505818 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5261ead-2e43-486d-b229-65d390bf5a22 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:23.506101 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5261ead-2e43-486d-b229-65d390bf5a22 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:23.506376 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5261ead-2e43-486d-b229-65d390bf5a22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:23.507128 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5261ead-2e43-486d-b229-65d390bf5a22 None admin] RBAC: Adding query filter params (role.id=3dfa1e29c6a0404388d256728d66e4a1, scope.project.id=b098a73099e649a4b1378e3e4ecc66f1, user.id=517c8b8a3dbb4c26bb946e9641d03bb6) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:37:23.507554 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5261ead-2e43-486d-b229-65d390bf5a22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:23.509153 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5261ead-2e43-486d-b229-65d390bf5a22 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:23.519717 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 49/97] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Sep 24 19:37:23 2022] GET /identity/v3/role_assignments?user.id=517c8b8a3dbb4c26bb946e9641d03bb6&scope.project.id=b098a73099e649a4b1378e3e4ecc66f1&role.id=3dfa1e29c6a0404388d256728d66e4a1 => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:24.795056 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c572d9-99f7-4790-8222-3adcf4935a4e None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:24.795565 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c572d9-99f7-4790-8222-3adcf4935a4e None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:24.795637 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c572d9-99f7-4790-8222-3adcf4935a4e None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:24.797523 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 49/98] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:37:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:37:24.805973 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33738e8a-b5be-4f15-b66d-d89ca99ce6bc None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:24.806464 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33738e8a-b5be-4f15-b66d-d89ca99ce6bc None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:24.806534 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33738e8a-b5be-4f15-b66d-d89ca99ce6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:24.833756 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-33738e8a-b5be-4f15-b66d-d89ca99ce6bc None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:37:24.835001 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-33738e8a-b5be-4f15-b66d-d89ca99ce6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:37:24.870049 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:24.921337 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 50/99] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:37:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 19:37:25.432203 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c572d9-99f7-4790-8222-3adcf4935a4e None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:25.578438 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c572d9-99f7-4790-8222-3adcf4935a4e None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:25.618499 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe973a9a-bd36-4f0e-8c4e-2d1de7e2a3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:25.619184 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe973a9a-bd36-4f0e-8c4e-2d1de7e2a3c0 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:25.619469 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe973a9a-bd36-4f0e-8c4e-2d1de7e2a3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:25.619740 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe973a9a-bd36-4f0e-8c4e-2d1de7e2a3c0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:25.631989 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe973a9a-bd36-4f0e-8c4e-2d1de7e2a3c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:37:25.637865 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-fe973a9a-bd36-4f0e-8c4e-2d1de7e2a3c0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:37:25.637865 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:37:25.637865 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:37:25.637865 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:37:25.637865 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:37:25.637865 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:37:25.637865 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:37:25.637865 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:37:25.637865 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:37:25.637865 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:37:25.637865 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:37:25.637865 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:37:25.637865 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:37:25.637865 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:37:25.637865 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:37:25.637865 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:37:25.638778 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:37:25.638778 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:37:25.638778 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:37:25.638778 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:37:25.638778 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:37:25.638778 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:37:25.638778 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:37:25.638778 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:37:25.638778 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:37:25.638778 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:37:25.638778 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:37:25.638778 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:37:25.638778 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:37:25.638778 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:37:25.638778 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:37:25.638778 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:37:25.639962 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:37:25.639962 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:37:25.639962 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:37:25.639962 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:37:25.639962 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:37:25.639962 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:37:25.639962 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:37:25.639962 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:37:25.639962 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:37:25.639962 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:37:25.639962 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:37:25.639962 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:37:25.639962 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 50/100] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Sep 24 19:37:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:37:25.645033 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33738e8a-b5be-4f15-b66d-d89ca99ce6bc None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:25.766447 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33738e8a-b5be-4f15-b66d-d89ca99ce6bc None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:25.817565 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a329c7-deb2-4ed7-a72d-4623487962aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:25.818224 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a329c7-deb2-4ed7-a72d-4623487962aa None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:25.818503 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a329c7-deb2-4ed7-a72d-4623487962aa None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:25.818787 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a329c7-deb2-4ed7-a72d-4623487962aa None admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:25.819507 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a329c7-deb2-4ed7-a72d-4623487962aa None admin] RBAC: Adding query filter params (name=member) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:37:25.819851 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a329c7-deb2-4ed7-a72d-4623487962aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:25.822702 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a329c7-deb2-4ed7-a72d-4623487962aa None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:25.832819 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 51/101] 10.222.0.60 () {56 vars in 1101 bytes} [Sat Sep 24 19:37:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:37:25.839659 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe973a9a-bd36-4f0e-8c4e-2d1de7e2a3c0 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:25.931989 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:25.969920 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac401d-3520-44d9-8fbe-e927c37b960d None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:25.970415 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac401d-3520-44d9-8fbe-e927c37b960d None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:25.970763 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac401d-3520-44d9-8fbe-e927c37b960d None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:25.972133 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 52/102] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:37:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:37:25.978833 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e18535-9279-43f6-81a8-2691f6f6ff9d None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:25.979140 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e18535-9279-43f6-81a8-2691f6f6ff9d None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:25.979393 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e18535-9279-43f6-81a8-2691f6f6ff9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:26.009729 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-18e18535-9279-43f6-81a8-2691f6f6ff9d None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:37:26.010949 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-18e18535-9279-43f6-81a8-2691f6f6ff9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:37:26.019651 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe973a9a-bd36-4f0e-8c4e-2d1de7e2a3c0 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:26.053884 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:26.092807 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473fb93d-1e47-4d52-870e-52fb93fdb634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:26.094244 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473fb93d-1e47-4d52-870e-52fb93fdb634 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:26.095099 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473fb93d-1e47-4d52-870e-52fb93fdb634 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:26.095788 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473fb93d-1e47-4d52-870e-52fb93fdb634 None admin] PATH_INFO: `/v3/users/517c8b8a3dbb4c26bb946e9641d03bb6` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:26.097800 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473fb93d-1e47-4d52-870e-52fb93fdb634 None admin] RBAC: Authorizing `identity:get_user(user_id=517c8b8a3dbb4c26bb946e9641d03bb6)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:26.100406 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473fb93d-1e47-4d52-870e-52fb93fdb634 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:26.105857 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 51/103] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Sep 24 19:37:25 2022] GET /identity/v3/users/517c8b8a3dbb4c26bb946e9641d03bb6 => generated 275 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:26.113521 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e87014-4783-4e32-9b30-8281b1272c49 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:26.114342 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e87014-4783-4e32-9b30-8281b1272c49 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:26.115167 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e87014-4783-4e32-9b30-8281b1272c49 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:26.118465 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 52/104] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:37:26 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:37:26.123050 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e87014-4783-4e32-9b30-8281b1272c49 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:26.180182 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 53/105] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:37:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 19:37:26.184903 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01fb1b3-d04e-4023-bf97-e69a62f9b592 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:26.184903 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01fb1b3-d04e-4023-bf97-e69a62f9b592 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:26.184903 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01fb1b3-d04e-4023-bf97-e69a62f9b592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:26.221617 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-b01fb1b3-d04e-4023-bf97-e69a62f9b592 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:37:26.224443 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-b01fb1b3-d04e-4023-bf97-e69a62f9b592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:37:26.347664 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e87014-4783-4e32-9b30-8281b1272c49 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:26.393575 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:26.422717 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6625d237-5dac-480c-9e58-58555b9b4fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:26.423796 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6625d237-5dac-480c-9e58-58555b9b4fdb None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:26.424238 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6625d237-5dac-480c-9e58-58555b9b4fdb None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:26.424698 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6625d237-5dac-480c-9e58-58555b9b4fdb None admin] PATH_INFO: `/v3/projects/3363e1213c7f49a4bccd9116d9d698d0` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:26.431379 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6625d237-5dac-480c-9e58-58555b9b4fdb None admin] RBAC: Authorizing `identity:get_project(project_id=3363e1213c7f49a4bccd9116d9d698d0)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:26.433333 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6625d237-5dac-480c-9e58-58555b9b4fdb None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:26.441997 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 53/106] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Sep 24 19:37:26 2022] GET /identity/v3/projects/3363e1213c7f49a4bccd9116d9d698d0 => generated 298 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:26.447618 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6625d237-5dac-480c-9e58-58555b9b4fdb None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:26.454575 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 54/107] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:37:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:37:26.696334 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6625d237-5dac-480c-9e58-58555b9b4fdb None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:26.760551 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01fb1b3-d04e-4023-bf97-e69a62f9b592 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:26.815047 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b64569-d37a-49d8-a989-d5a49ae0c5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:26.815833 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b64569-d37a-49d8-a989-d5a49ae0c5af None admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:26.816114 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b64569-d37a-49d8-a989-d5a49ae0c5af None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:26.816569 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b64569-d37a-49d8-a989-d5a49ae0c5af None admin] PATH_INFO: `/v3/projects/3363e1213c7f49a4bccd9116d9d698d0/users/517c8b8a3dbb4c26bb946e9641d03bb6/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:26.818949 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b64569-d37a-49d8-a989-d5a49ae0c5af None admin] RBAC: Authorizing `identity:create_grant(project_id=3363e1213c7f49a4bccd9116d9d698d0, user_id=517c8b8a3dbb4c26bb946e9641d03bb6, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:26.821277 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b64569-d37a-49d8-a989-d5a49ae0c5af None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:26.933625 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 54/108] 10.222.0.60 () {58 vars in 1439 bytes} [Sat Sep 24 19:37:26 2022] PUT /identity/v3/projects/3363e1213c7f49a4bccd9116d9d698d0/users/517c8b8a3dbb4c26bb946e9641d03bb6/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:37:26.954198 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df7d0b-2f91-4e79-bbfc-2b8a2aca8ddf None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:26.954865 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df7d0b-2f91-4e79-bbfc-2b8a2aca8ddf None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:26.955352 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df7d0b-2f91-4e79-bbfc-2b8a2aca8ddf None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:26.961520 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 55/109] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:37:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:37:26.965018 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672c3b3-abe2-4292-8717-b2970337d8f1 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:26.965662 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672c3b3-abe2-4292-8717-b2970337d8f1 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:26.973662 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672c3b3-abe2-4292-8717-b2970337d8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:27.004033 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-8672c3b3-abe2-4292-8717-b2970337d8f1 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:37:27.005737 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-8672c3b3-abe2-4292-8717-b2970337d8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:37:27.072763 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:27.117171 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:27.129113 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01fb1b3-d04e-4023-bf97-e69a62f9b592 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:27.160322 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 56/110] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:37:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:37:27.162308 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672c3b3-abe2-4292-8717-b2970337d8f1 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:27.194168 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf2aea-7ad8-4e71-9b84-89bbbe7d3d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:27.196296 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf2aea-7ad8-4e71-9b84-89bbbe7d3d73 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:27.198601 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf2aea-7ad8-4e71-9b84-89bbbe7d3d73 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:27.199541 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf2aea-7ad8-4e71-9b84-89bbbe7d3d73 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:27.239424 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bf2aea-7ad8-4e71-9b84-89bbbe7d3d73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:37:27.255355 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-57bf2aea-7ad8-4e71-9b84-89bbbe7d3d73 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:37:27.255355 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:37:27.255355 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:37:27.255355 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:37:27.255355 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:37:27.255355 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:37:27.255355 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:37:27.255355 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:37:27.255355 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:37:27.255355 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:37:27.255355 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:37:27.255355 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:37:27.255355 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:37:27.255355 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:37:27.255355 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:37:27.255355 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:37:27.256986 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:37:27.256986 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:37:27.256986 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:37:27.256986 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:37:27.256986 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:37:27.256986 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:37:27.256986 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:37:27.256986 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:37:27.256986 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:37:27.256986 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:37:27.256986 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:37:27.256986 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:37:27.256986 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:37:27.256986 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:37:27.256986 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:37:27.256986 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:37:27.258768 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:37:27.258768 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:37:27.258768 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:37:27.258768 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:37:27.258768 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:37:27.258768 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:37:27.258768 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:37:27.258768 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:37:27.258768 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:37:27.258768 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:37:27.258768 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:37:27.258768 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:37:27.263609 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 55/111] 10.222.0.60 () {56 vars in 1114 bytes} [Sat Sep 24 19:37:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 505 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:37:27.269390 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4262494-5f3c-482f-9d7c-b446b6621de9 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:27.270159 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4262494-5f3c-482f-9d7c-b446b6621de9 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:27.270942 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4262494-5f3c-482f-9d7c-b446b6621de9 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:27.274511 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 56/112] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:37:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:37:27.277189 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4262494-5f3c-482f-9d7c-b446b6621de9 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:27.395202 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672c3b3-abe2-4292-8717-b2970337d8f1 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:27.443009 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4262494-5f3c-482f-9d7c-b446b6621de9 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:27.443356 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e28e2-ec59-420f-a3dc-2fae79cae8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:27.444001 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e28e2-ec59-420f-a3dc-2fae79cae8d9 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:27.444335 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e28e2-ec59-420f-a3dc-2fae79cae8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:27.445355 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e28e2-ec59-420f-a3dc-2fae79cae8d9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:27.460156 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89e28e2-ec59-420f-a3dc-2fae79cae8d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:37:27.465656 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-a89e28e2-ec59-420f-a3dc-2fae79cae8d9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 19:37:27.465656 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:37:27.465656 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:37:27.465656 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:37:27.465656 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:37:27.465656 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:37:27.465656 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:37:27.465656 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:37:27.465656 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:37:27.465656 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:37:27.465656 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:37:27.465656 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:37:27.465656 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:37:27.465656 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:37:27.465656 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:37:27.465656 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:37:27.466531 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:37:27.466531 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:37:27.466531 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:37:27.466531 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:37:27.466531 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:37:27.466531 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:37:27.466531 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:37:27.466531 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:37:27.466531 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:37:27.466531 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:37:27.466531 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:37:27.466531 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:37:27.466531 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:37:27.466531 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:37:27.466531 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:37:27.466531 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:37:27.467689 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:37:27.467689 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:37:27.467689 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:37:27.467689 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:37:27.467689 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:37:27.467689 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:37:27.467689 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:37:27.467689 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:37:27.467689 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:37:27.467689 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:37:27.467689 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 19:37:27.467689 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:37:27.467689 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 57/113] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Sep 24 19:37:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:37:27.471572 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d290346-ad78-4305-a5e9-ee6615d0232e None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:27.471572 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d290346-ad78-4305-a5e9-ee6615d0232e None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:27.471572 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d290346-ad78-4305-a5e9-ee6615d0232e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:27.489199 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-5d290346-ad78-4305-a5e9-ee6615d0232e None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:37:27.490593 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-5d290346-ad78-4305-a5e9-ee6615d0232e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:37:27.495928 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f8c3fe-ac55-44b4-aaf2-6232be920abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:27.496628 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8c3fe-ac55-44b4-aaf2-6232be920abd None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:27.496913 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8c3fe-ac55-44b4-aaf2-6232be920abd None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:27.497287 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8c3fe-ac55-44b4-aaf2-6232be920abd None admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:27.498100 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f8c3fe-ac55-44b4-aaf2-6232be920abd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:37:27.498409 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f8c3fe-ac55-44b4-aaf2-6232be920abd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:27.500547 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f8c3fe-ac55-44b4-aaf2-6232be920abd None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:27.517637 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 57/114] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Sep 24 19:37:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:27.519183 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78900371-425e-45ec-b605-3b27510d24bb None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:27.519478 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78900371-425e-45ec-b605-3b27510d24bb None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:27.519757 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78900371-425e-45ec-b605-3b27510d24bb None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:27.521108 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 58/115] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:37:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:37:27.521860 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78900371-425e-45ec-b605-3b27510d24bb None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:27.533656 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:27.552181 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:27.592401 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 58/116] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:37:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:37:27.601813 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d290346-ad78-4305-a5e9-ee6615d0232e None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:27.655231 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78900371-425e-45ec-b605-3b27510d24bb None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:27.699286 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b3484-ac21-43a0-b302-e8c97f668053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:27.700067 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b3484-ac21-43a0-b302-e8c97f668053 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:27.700447 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b3484-ac21-43a0-b302-e8c97f668053 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:27.700824 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b3484-ac21-43a0-b302-e8c97f668053 None admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:27.701748 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b3484-ac21-43a0-b302-e8c97f668053 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:37:27.702156 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b3484-ac21-43a0-b302-e8c97f668053 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:27.704022 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b3484-ac21-43a0-b302-e8c97f668053 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:27.713442 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d290346-ad78-4305-a5e9-ee6615d0232e None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:27.718152 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 59/117] 10.222.0.60 () {56 vars in 1101 bytes} [Sat Sep 24 19:37:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:27.724237 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b3484-ac21-43a0-b302-e8c97f668053 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:27.754600 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6107ddf1-9434-4c26-90e7-d9d3d577c85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:27.755443 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107ddf1-9434-4c26-90e7-d9d3d577c85f None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:27.755825 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107ddf1-9434-4c26-90e7-d9d3d577c85f None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:27.756216 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107ddf1-9434-4c26-90e7-d9d3d577c85f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:27.769097 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6107ddf1-9434-4c26-90e7-d9d3d577c85f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:37:27.775663 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-6107ddf1-9434-4c26-90e7-d9d3d577c85f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:37:27.775663 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:37:27.775663 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:37:27.775663 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:37:27.775663 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:37:27.775663 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:37:27.775663 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:37:27.775663 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:37:27.775663 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:37:27.775663 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:37:27.775663 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:37:27.775663 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:37:27.775663 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:37:27.775663 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:37:27.775663 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:37:27.775663 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:37:27.776577 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:37:27.776577 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:37:27.776577 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:37:27.776577 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:37:27.776577 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:37:27.776577 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:37:27.776577 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:37:27.776577 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:37:27.776577 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:37:27.776577 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:37:27.776577 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:37:27.776577 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:37:27.776577 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:37:27.776577 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:37:27.776577 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:37:27.776577 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:37:27.777444 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:37:27.777444 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:37:27.777444 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:37:27.777444 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:37:27.777444 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:37:27.777444 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:37:27.777444 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:37:27.777444 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:37:27.777444 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:37:27.777444 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:37:27.777444 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:37:27.777444 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:37:27.777444 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 59/118] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Sep 24 19:37:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:37:27.778623 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c909e4d-21d4-41e4-8d37-5d902a9c67cb None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:27.779068 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c909e4d-21d4-41e4-8d37-5d902a9c67cb None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:27.779425 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c909e4d-21d4-41e4-8d37-5d902a9c67cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:27.799563 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-1c909e4d-21d4-41e4-8d37-5d902a9c67cb None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:37:27.801027 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-1c909e4d-21d4-41e4-8d37-5d902a9c67cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:37:27.816875 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:27.839119 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:27.860490 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b3484-ac21-43a0-b302-e8c97f668053 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:27.895818 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 60/119] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:37:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:37:27.897547 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c909e4d-21d4-41e4-8d37-5d902a9c67cb None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:27.919078 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f3c57-cf40-4288-a72d-b41a35a3bf1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:27.919746 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f3c57-cf40-4288-a72d-b41a35a3bf1a None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:27.920036 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f3c57-cf40-4288-a72d-b41a35a3bf1a None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:27.920314 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f3c57-cf40-4288-a72d-b41a35a3bf1a None admin] PATH_INFO: `/v3/users/517c8b8a3dbb4c26bb946e9641d03bb6` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:27.921571 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f3c57-cf40-4288-a72d-b41a35a3bf1a None admin] RBAC: Authorizing `identity:get_user(user_id=517c8b8a3dbb4c26bb946e9641d03bb6)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:27.923236 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f3c57-cf40-4288-a72d-b41a35a3bf1a None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:27.929968 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 60/120] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Sep 24 19:37:27 2022] GET /identity/v3/users/517c8b8a3dbb4c26bb946e9641d03bb6 => generated 275 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:27.935756 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f3c57-cf40-4288-a72d-b41a35a3bf1a None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:28.059933 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c909e4d-21d4-41e4-8d37-5d902a9c67cb None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:28.123871 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e18269-2cf4-4b83-b405-146e09a98748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:28.124954 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e18269-2cf4-4b83-b405-146e09a98748 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:28.125433 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e18269-2cf4-4b83-b405-146e09a98748 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:28.125961 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e18269-2cf4-4b83-b405-146e09a98748 None admin] PATH_INFO: `/v3/users/8989e5b5b6f94a8a9ad90965dd6374b1` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:28.128360 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f3c57-cf40-4288-a72d-b41a35a3bf1a None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:28.151063 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e18269-2cf4-4b83-b405-146e09a98748 None admin] RBAC: Authorizing `identity:get_user(user_id=8989e5b5b6f94a8a9ad90965dd6374b1)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:28.154013 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e18269-2cf4-4b83-b405-146e09a98748 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:28.157350 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 61/121] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Sep 24 19:37:27 2022] GET /identity/v3/users/8989e5b5b6f94a8a9ad90965dd6374b1 => generated 289 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:28.159172 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e18269-2cf4-4b83-b405-146e09a98748 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:28.199281 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b15dc3-bcca-402b-9dcd-eeebe073425b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:28.201450 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b15dc3-bcca-402b-9dcd-eeebe073425b None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:28.201913 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b15dc3-bcca-402b-9dcd-eeebe073425b None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:28.202299 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b15dc3-bcca-402b-9dcd-eeebe073425b None admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:28.202907 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b15dc3-bcca-402b-9dcd-eeebe073425b None admin] RBAC: Adding query filter params (name=admin) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:37:28.203219 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b15dc3-bcca-402b-9dcd-eeebe073425b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:28.204395 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:28.204642 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b15dc3-bcca-402b-9dcd-eeebe073425b None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:28.207962 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:28.217536 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 61/122] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Sep 24 19:37:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:28.218400 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b15dc3-bcca-402b-9dcd-eeebe073425b None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:28.304000 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e18269-2cf4-4b83-b405-146e09a98748 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:28.332659 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b15dc3-bcca-402b-9dcd-eeebe073425b None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:28.347360 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa2a8c-67ed-45f2-a9d1-669e7c4f5c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:28.348115 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa2a8c-67ed-45f2-a9d1-669e7c4f5c3f None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:28.348395 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa2a8c-67ed-45f2-a9d1-669e7c4f5c3f None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:28.348667 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa2a8c-67ed-45f2-a9d1-669e7c4f5c3f None admin] PATH_INFO: `/v3/domains/default` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:28.349821 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aa2a8c-67ed-45f2-a9d1-669e7c4f5c3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:28.351635 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aa2a8c-67ed-45f2-a9d1-669e7c4f5c3f None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:28.358041 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 62/123] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:37:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:28.358906 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa2a8c-67ed-45f2-a9d1-669e7c4f5c3f None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:28.370513 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad52a2d-ea29-4197-b25a-832a2cd6d756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:28.371153 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad52a2d-ea29-4197-b25a-832a2cd6d756 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:28.371429 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad52a2d-ea29-4197-b25a-832a2cd6d756 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:28.371709 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad52a2d-ea29-4197-b25a-832a2cd6d756 None admin] PATH_INFO: `/v3/projects/3363e1213c7f49a4bccd9116d9d698d0` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:28.372839 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad52a2d-ea29-4197-b25a-832a2cd6d756 None admin] RBAC: Authorizing `identity:get_project(project_id=3363e1213c7f49a4bccd9116d9d698d0)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:28.374299 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad52a2d-ea29-4197-b25a-832a2cd6d756 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:28.375922 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 62/124] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Sep 24 19:37:28 2022] GET /identity/v3/projects/3363e1213c7f49a4bccd9116d9d698d0 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:28.376683 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad52a2d-ea29-4197-b25a-832a2cd6d756 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:28.462543 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:28.479025 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:28.489839 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa2a8c-67ed-45f2-a9d1-669e7c4f5c3f None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:28.505085 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad52a2d-ea29-4197-b25a-832a2cd6d756 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:28.531148 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b6d74a-4956-4547-86e6-cd6f31d36fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:28.531769 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6d74a-4956-4547-86e6-cd6f31d36fa8 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:28.532052 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6d74a-4956-4547-86e6-cd6f31d36fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:28.532324 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6d74a-4956-4547-86e6-cd6f31d36fa8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:28.546379 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa313f5-dbed-45c7-b3e1-fb34091dabf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:28.547033 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa313f5-dbed-45c7-b3e1-fb34091dabf4 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:28.547321 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa313f5-dbed-45c7-b3e1-fb34091dabf4 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:28.547602 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa313f5-dbed-45c7-b3e1-fb34091dabf4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:28.560792 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa313f5-dbed-45c7-b3e1-fb34091dabf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:37:28.566426 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-0fa313f5-dbed-45c7-b3e1-fb34091dabf4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:37:28.566426 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:37:28.566426 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:37:28.566426 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:37:28.566426 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:37:28.566426 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:37:28.566426 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:37:28.566426 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:37:28.566426 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:37:28.566426 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:37:28.566426 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:37:28.566426 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:37:28.566426 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:37:28.566426 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:37:28.566426 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:37:28.566426 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:37:28.567308 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:37:28.567308 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:37:28.567308 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:37:28.567308 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:37:28.567308 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:37:28.567308 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:37:28.567308 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:37:28.567308 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:37:28.567308 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:37:28.567308 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:37:28.567308 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:37:28.567308 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:37:28.567308 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:37:28.567308 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:37:28.567308 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:37:28.567308 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:37:28.568086 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:37:28.568086 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:37:28.568086 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:37:28.568086 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:37:28.568086 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:37:28.568086 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:37:28.568086 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:37:28.568086 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:37:28.568086 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:37:28.568086 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:37:28.568086 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:37:28.568086 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:37:28.568086 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 63/125] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Sep 24 19:37:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:37:28.568730 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa313f5-dbed-45c7-b3e1-fb34091dabf4 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:28.613352 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b6d74a-4956-4547-86e6-cd6f31d36fa8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:28.614848 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b6d74a-4956-4547-86e6-cd6f31d36fa8 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:28.691604 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa313f5-dbed-45c7-b3e1-fb34091dabf4 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:28.723058 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:28.732920 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:28.735722 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9103d70-01eb-47bc-ab2b-873bb539ac2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:28.736379 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9103d70-01eb-47bc-ab2b-873bb539ac2c None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:28.736685 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9103d70-01eb-47bc-ab2b-873bb539ac2c None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:28.736963 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9103d70-01eb-47bc-ab2b-873bb539ac2c None admin] PATH_INFO: `/v3/users/3ee86ed717254b8d8e892338e3d639aa` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:28.738158 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9103d70-01eb-47bc-ab2b-873bb539ac2c None admin] RBAC: Authorizing `identity:get_user(user_id=3ee86ed717254b8d8e892338e3d639aa)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:28.739626 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9103d70-01eb-47bc-ab2b-873bb539ac2c None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:28.741466 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 64/126] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Sep 24 19:37:28 2022] GET /identity/v3/users/3ee86ed717254b8d8e892338e3d639aa => generated 247 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:28.746460 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9103d70-01eb-47bc-ab2b-873bb539ac2c None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:28.747105 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 63/127] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Sep 24 19:37:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:37:28.747941 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b6d74a-4956-4547-86e6-cd6f31d36fa8 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:28.869865 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b6d74a-4956-4547-86e6-cd6f31d36fa8 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:28.873161 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9103d70-01eb-47bc-ab2b-873bb539ac2c None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:28.906377 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa9a90d-5abe-4d5a-a3d5-cac01f19a2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:28.907333 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9a90d-5abe-4d5a-a3d5-cac01f19a2a0 None admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:28.907666 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfcdc9e-c914-463e-b80b-e68cafdaab6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:28.908013 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9a90d-5abe-4d5a-a3d5-cac01f19a2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:28.908277 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfcdc9e-c914-463e-b80b-e68cafdaab6d None admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:28.908559 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfcdc9e-c914-463e-b80b-e68cafdaab6d None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:28.908806 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9a90d-5abe-4d5a-a3d5-cac01f19a2a0 None admin] PATH_INFO: `/v3/projects/3363e1213c7f49a4bccd9116d9d698d0/users/517c8b8a3dbb4c26bb946e9641d03bb6/roles/dd695228990e4288afe29e3cefb75823` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:28.908911 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfcdc9e-c914-463e-b80b-e68cafdaab6d None admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:28.909472 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfcdc9e-c914-463e-b80b-e68cafdaab6d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:28.910940 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfcdc9e-c914-463e-b80b-e68cafdaab6d None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:28.911688 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa9a90d-5abe-4d5a-a3d5-cac01f19a2a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=3363e1213c7f49a4bccd9116d9d698d0, user_id=517c8b8a3dbb4c26bb946e9641d03bb6, role_id=dd695228990e4288afe29e3cefb75823)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:28.914060 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa9a90d-5abe-4d5a-a3d5-cac01f19a2a0 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:29.022951 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 64/128] 10.222.0.60 () {58 vars in 1439 bytes} [Sat Sep 24 19:37:28 2022] PUT /identity/v3/projects/3363e1213c7f49a4bccd9116d9d698d0/users/517c8b8a3dbb4c26bb946e9641d03bb6/roles/dd695228990e4288afe29e3cefb75823 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:37:29.023565 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa9a90d-5abe-4d5a-a3d5-cac01f19a2a0 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:29.051111 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 65/129] 10.222.0.60 () {60 vars in 1141 bytes} [Sat Sep 24 19:37:28 2022] POST /identity/v3/projects => generated 302 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:37:29.059196 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfcdc9e-c914-463e-b80b-e68cafdaab6d None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:29.136078 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:29.183300 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:29.253229 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa9a90d-5abe-4d5a-a3d5-cac01f19a2a0 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:29.271442 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfcdc9e-c914-463e-b80b-e68cafdaab6d None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:29.295131 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5c0d39-4e4f-4e90-91a1-f7ad8fc1c714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:29.295801 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c0d39-4e4f-4e90-91a1-f7ad8fc1c714 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:29.296089 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c0d39-4e4f-4e90-91a1-f7ad8fc1c714 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:29.296367 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c0d39-4e4f-4e90-91a1-f7ad8fc1c714 None admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:29.297046 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5c0d39-4e4f-4e90-91a1-f7ad8fc1c714 None admin] RBAC: Adding query filter params (name=member) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:37:29.297352 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5c0d39-4e4f-4e90-91a1-f7ad8fc1c714 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:29.298788 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5c0d39-4e4f-4e90-91a1-f7ad8fc1c714 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:29.309128 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 65/130] 10.222.0.60 () {56 vars in 1101 bytes} [Sat Sep 24 19:37:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:29.310028 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5c0d39-4e4f-4e90-91a1-f7ad8fc1c714 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:29.314114 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a2244-e923-4ee2-9a56-fe0fbe0f0518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:29.315227 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a2244-e923-4ee2-9a56-fe0fbe0f0518 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:29.315690 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a2244-e923-4ee2-9a56-fe0fbe0f0518 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:29.316165 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a2244-e923-4ee2-9a56-fe0fbe0f0518 None admin] PATH_INFO: `/v3/projects/3363e1213c7f49a4bccd9116d9d698d0` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:29.317698 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60a2244-e923-4ee2-9a56-fe0fbe0f0518 None admin] RBAC: Authorizing `identity:get_project(project_id=3363e1213c7f49a4bccd9116d9d698d0)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:29.319184 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60a2244-e923-4ee2-9a56-fe0fbe0f0518 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:29.321379 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 66/131] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Sep 24 19:37:29 2022] GET /identity/v3/projects/3363e1213c7f49a4bccd9116d9d698d0 => generated 298 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:29.323011 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a2244-e923-4ee2-9a56-fe0fbe0f0518 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:29.438722 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5c0d39-4e4f-4e90-91a1-f7ad8fc1c714 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:29.454632 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:29.483762 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659c624-0a6f-43b5-ac5d-51d9611cde22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:29.484532 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659c624-0a6f-43b5-ac5d-51d9611cde22 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:29.484810 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659c624-0a6f-43b5-ac5d-51d9611cde22 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:29.485094 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659c624-0a6f-43b5-ac5d-51d9611cde22 None admin] PATH_INFO: `/v3/projects/3363e1213c7f49a4bccd9116d9d698d0` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:29.486338 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2659c624-0a6f-43b5-ac5d-51d9611cde22 None admin] RBAC: Authorizing `identity:get_project(project_id=3363e1213c7f49a4bccd9116d9d698d0)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:29.487840 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2659c624-0a6f-43b5-ac5d-51d9611cde22 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:29.488642 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a2244-e923-4ee2-9a56-fe0fbe0f0518 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:29.489736 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 66/132] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Sep 24 19:37:29 2022] GET /identity/v3/projects/3363e1213c7f49a4bccd9116d9d698d0 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:29.490596 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659c624-0a6f-43b5-ac5d-51d9611cde22 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:29.510863 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:29.538688 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1821ae-a2e8-48df-abec-d984bcba2b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:29.539481 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1821ae-a2e8-48df-abec-d984bcba2b90 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:29.539682 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1821ae-a2e8-48df-abec-d984bcba2b90 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:29.540947 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1821ae-a2e8-48df-abec-d984bcba2b90 None admin] PATH_INFO: `/v3/users/517c8b8a3dbb4c26bb946e9641d03bb6` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:29.542244 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1821ae-a2e8-48df-abec-d984bcba2b90 None admin] RBAC: Authorizing `identity:get_user(user_id=517c8b8a3dbb4c26bb946e9641d03bb6)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:29.543675 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1821ae-a2e8-48df-abec-d984bcba2b90 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:29.545288 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 67/133] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Sep 24 19:37:29 2022] GET /identity/v3/users/517c8b8a3dbb4c26bb946e9641d03bb6 => generated 275 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:29.546492 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07ac42-6985-4485-9b61-3fbf70805fcf None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:29.546774 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07ac42-6985-4485-9b61-3fbf70805fcf None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:29.547045 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07ac42-6985-4485-9b61-3fbf70805fcf None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:29.548255 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 68/134] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:37:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:37:29.551990 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07ac42-6985-4485-9b61-3fbf70805fcf None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:29.636923 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659c624-0a6f-43b5-ac5d-51d9611cde22 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:29.678976 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07ac42-6985-4485-9b61-3fbf70805fcf None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:29.681134 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ef9b6-6f24-4fcd-a7b1-c602b2057b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:29.682251 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ef9b6-6f24-4fcd-a7b1-c602b2057b78 None admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:29.682643 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ef9b6-6f24-4fcd-a7b1-c602b2057b78 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:29.683028 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ef9b6-6f24-4fcd-a7b1-c602b2057b78 None admin] PATH_INFO: `/v3/projects/3363e1213c7f49a4bccd9116d9d698d0/users/3ee86ed717254b8d8e892338e3d639aa/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:29.686226 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810ef9b6-6f24-4fcd-a7b1-c602b2057b78 None admin] RBAC: Authorizing `identity:create_grant(project_id=3363e1213c7f49a4bccd9116d9d698d0, user_id=3ee86ed717254b8d8e892338e3d639aa, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:29.687847 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810ef9b6-6f24-4fcd-a7b1-c602b2057b78 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:29.726558 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fa5289-1566-49a8-a22a-a7fd9bdc86f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:29.726994 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa5289-1566-49a8-a22a-a7fd9bdc86f9 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:29.727271 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa5289-1566-49a8-a22a-a7fd9bdc86f9 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:29.727643 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa5289-1566-49a8-a22a-a7fd9bdc86f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:29.728384 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fa5289-1566-49a8-a22a-a7fd9bdc86f9 None admin] RBAC: Adding query filter params (role.id=632e24cff8a04bd598fbbb3b41c62218, scope.project.id=3363e1213c7f49a4bccd9116d9d698d0, user.id=8989e5b5b6f94a8a9ad90965dd6374b1) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:37:29.728692 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fa5289-1566-49a8-a22a-a7fd9bdc86f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:29.730254 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fa5289-1566-49a8-a22a-a7fd9bdc86f9 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:29.738036 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 69/135] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Sep 24 19:37:29 2022] GET /identity/v3/role_assignments?user.id=8989e5b5b6f94a8a9ad90965dd6374b1&scope.project.id=3363e1213c7f49a4bccd9116d9d698d0&role.id=632e24cff8a04bd598fbbb3b41c62218 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:29.740472 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fa5289-1566-49a8-a22a-a7fd9bdc86f9 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:29.771276 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 67/136] 10.222.0.60 () {58 vars in 1439 bytes} [Sat Sep 24 19:37:29 2022] PUT /identity/v3/projects/3363e1213c7f49a4bccd9116d9d698d0/users/3ee86ed717254b8d8e892338e3d639aa/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:37:29.774019 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594ef4d-a7f1-4eac-8025-014cc1e9213b None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:29.775997 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594ef4d-a7f1-4eac-8025-014cc1e9213b None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:29.778674 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594ef4d-a7f1-4eac-8025-014cc1e9213b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:29.829061 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-7594ef4d-a7f1-4eac-8025-014cc1e9213b None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:37:29.832585 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-7594ef4d-a7f1-4eac-8025-014cc1e9213b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:37:29.865289 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:29.931627 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:30.003425 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fa5289-1566-49a8-a22a-a7fd9bdc86f9 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:30.011277 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 68/137] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:37:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:37:30.071796 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e062b3dc-1b57-48a4-8c02-b9825780c738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:30.072460 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062b3dc-1b57-48a4-8c02-b9825780c738 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:30.072739 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062b3dc-1b57-48a4-8c02-b9825780c738 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:30.073014 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062b3dc-1b57-48a4-8c02-b9825780c738 None admin] PATH_INFO: `/v3/projects/b098a73099e649a4b1378e3e4ecc66f1` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:30.078481 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e062b3dc-1b57-48a4-8c02-b9825780c738 None admin] RBAC: Authorizing `identity:get_project(project_id=b098a73099e649a4b1378e3e4ecc66f1)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:30.080015 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e062b3dc-1b57-48a4-8c02-b9825780c738 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:30.082067 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 70/138] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Sep 24 19:37:29 2022] GET /identity/v3/projects/b098a73099e649a4b1378e3e4ecc66f1 => generated 312 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:30.088247 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7594ef4d-a7f1-4eac-8025-014cc1e9213b None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:30.237382 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7594ef4d-a7f1-4eac-8025-014cc1e9213b None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:30.285103 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716cd0ed-ce44-4095-8e2e-5d50fe2d401b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:30.285748 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716cd0ed-ce44-4095-8e2e-5d50fe2d401b None admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:30.286035 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716cd0ed-ce44-4095-8e2e-5d50fe2d401b None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:30.286311 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716cd0ed-ce44-4095-8e2e-5d50fe2d401b None admin] PATH_INFO: `/v3/projects/b098a73099e649a4b1378e3e4ecc66f1/users/517c8b8a3dbb4c26bb946e9641d03bb6/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:30.292533 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716cd0ed-ce44-4095-8e2e-5d50fe2d401b None admin] RBAC: Authorizing `identity:create_grant(project_id=b098a73099e649a4b1378e3e4ecc66f1, user_id=517c8b8a3dbb4c26bb946e9641d03bb6, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:30.294082 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716cd0ed-ce44-4095-8e2e-5d50fe2d401b None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:30.378871 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 69/139] 10.222.0.60 () {58 vars in 1439 bytes} [Sat Sep 24 19:37:30 2022] PUT /identity/v3/projects/b098a73099e649a4b1378e3e4ecc66f1/users/517c8b8a3dbb4c26bb946e9641d03bb6/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:37:30.548268 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e062b3dc-1b57-48a4-8c02-b9825780c738 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:30.695514 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e062b3dc-1b57-48a4-8c02-b9825780c738 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:30.721052 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:30.743033 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa4585-fdd7-49f7-8dbd-8f7641a9febf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:30.743678 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa4585-fdd7-49f7-8dbd-8f7641a9febf None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:30.743952 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa4585-fdd7-49f7-8dbd-8f7641a9febf None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:30.744222 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa4585-fdd7-49f7-8dbd-8f7641a9febf None admin] PATH_INFO: `/v3/roles/member` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:30.755716 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fa4585-fdd7-49f7-8dbd-8f7641a9febf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:37:30.762039 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-45fa4585-fdd7-49f7-8dbd-8f7641a9febf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:37:30.762039 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:37:30.762039 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:37:30.762039 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:37:30.762039 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:37:30.762039 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:37:30.762039 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:37:30.762039 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:37:30.762039 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:37:30.762039 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:37:30.762039 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:37:30.762039 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:37:30.762039 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:37:30.762039 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:37:30.762039 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:37:30.762039 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:37:30.763125 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:37:30.763125 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:37:30.763125 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:37:30.763125 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:37:30.763125 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:37:30.763125 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:37:30.763125 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:37:30.763125 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:37:30.763125 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:37:30.763125 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:37:30.763125 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:37:30.763125 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:37:30.763125 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:37:30.763125 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:37:30.763125 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:37:30.763125 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:37:30.764089 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:37:30.764089 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:37:30.764089 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:37:30.764089 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:37:30.764089 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:37:30.764089 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:37:30.764089 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:37:30.764089 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:37:30.764089 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:37:30.764089 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:37:30.764089 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:37:30.764089 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:37:30.765334 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 71/140] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Sep 24 19:37:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:37:30.771705 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716cd0ed-ce44-4095-8e2e-5d50fe2d401b None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:30.825786 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:30.912605 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716cd0ed-ce44-4095-8e2e-5d50fe2d401b None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:30.965980 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37943076-6f04-4730-8b50-28970a748cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:30.966605 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37943076-6f04-4730-8b50-28970a748cf2 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:30.966889 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37943076-6f04-4730-8b50-28970a748cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:30.967165 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37943076-6f04-4730-8b50-28970a748cf2 None admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:30.967845 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37943076-6f04-4730-8b50-28970a748cf2 None admin] RBAC: Adding query filter params (name=member) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:37:30.968155 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37943076-6f04-4730-8b50-28970a748cf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:30.969574 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37943076-6f04-4730-8b50-28970a748cf2 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:30.985152 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 70/141] 10.222.0.60 () {56 vars in 1101 bytes} [Sat Sep 24 19:37:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:30.991380 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa4585-fdd7-49f7-8dbd-8f7641a9febf None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:31.208377 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa4585-fdd7-49f7-8dbd-8f7641a9febf None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:31.273447 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e2ddc-5f02-4807-9a8a-e6f60e3ac7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:31.274132 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e2ddc-5f02-4807-9a8a-e6f60e3ac7b0 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:31.274415 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e2ddc-5f02-4807-9a8a-e6f60e3ac7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:31.274696 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e2ddc-5f02-4807-9a8a-e6f60e3ac7b0 None admin] PATH_INFO: `/v3/users/517c8b8a3dbb4c26bb946e9641d03bb6` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:31.276073 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e2ddc-5f02-4807-9a8a-e6f60e3ac7b0 None admin] RBAC: Authorizing `identity:get_user(user_id=517c8b8a3dbb4c26bb946e9641d03bb6)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:31.277557 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e2ddc-5f02-4807-9a8a-e6f60e3ac7b0 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:31.279397 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 72/142] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Sep 24 19:37:30 2022] GET /identity/v3/users/517c8b8a3dbb4c26bb946e9641d03bb6 => generated 275 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:31.285065 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37943076-6f04-4730-8b50-28970a748cf2 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:31.423099 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:31.437181 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37943076-6f04-4730-8b50-28970a748cf2 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:31.485405 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf39664a-6a94-4dbf-ad3c-1b635a4ad11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:31.485978 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39664a-6a94-4dbf-ad3c-1b635a4ad11c None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:31.486267 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39664a-6a94-4dbf-ad3c-1b635a4ad11c None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:31.486555 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39664a-6a94-4dbf-ad3c-1b635a4ad11c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:31.577547 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf39664a-6a94-4dbf-ad3c-1b635a4ad11c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:31.583072 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf39664a-6a94-4dbf-ad3c-1b635a4ad11c None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:31.724741 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:31.743367 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 71/143] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Sep 24 19:37:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 24 19:37:31.749252 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e2ddc-5f02-4807-9a8a-e6f60e3ac7b0 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:31.822854 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:31.905132 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e2ddc-5f02-4807-9a8a-e6f60e3ac7b0 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:31.942215 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3b125-41fe-4950-9d92-bb3cbeeceb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:31.942856 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3b125-41fe-4950-9d92-bb3cbeeceb9f None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:31.943139 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3b125-41fe-4950-9d92-bb3cbeeceb9f None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:31.943405 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3b125-41fe-4950-9d92-bb3cbeeceb9f None admin] PATH_INFO: `/v3/projects/3363e1213c7f49a4bccd9116d9d698d0` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:31.945127 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f3b125-41fe-4950-9d92-bb3cbeeceb9f None admin] RBAC: Authorizing `identity:get_project(project_id=3363e1213c7f49a4bccd9116d9d698d0)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:31.946639 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f3b125-41fe-4950-9d92-bb3cbeeceb9f None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:31.948269 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 73/144] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Sep 24 19:37:31 2022] GET /identity/v3/projects/3363e1213c7f49a4bccd9116d9d698d0 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:31.963038 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf39664a-6a94-4dbf-ad3c-1b635a4ad11c None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:32.159704 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf39664a-6a94-4dbf-ad3c-1b635a4ad11c None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:32.223509 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddefbba6-6f84-4ac1-925a-18cfe9c837f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:32.224845 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefbba6-6f84-4ac1-925a-18cfe9c837f8 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:32.225536 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefbba6-6f84-4ac1-925a-18cfe9c837f8 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:32.226396 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefbba6-6f84-4ac1-925a-18cfe9c837f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:32.227968 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddefbba6-6f84-4ac1-925a-18cfe9c837f8 None admin] RBAC: Adding query filter params (role.id=3dfa1e29c6a0404388d256728d66e4a1, scope.project.id=3363e1213c7f49a4bccd9116d9d698d0, user.id=517c8b8a3dbb4c26bb946e9641d03bb6) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:37:32.228708 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddefbba6-6f84-4ac1-925a-18cfe9c837f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:32.231635 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddefbba6-6f84-4ac1-925a-18cfe9c837f8 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:32.243912 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 72/145] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Sep 24 19:37:31 2022] GET /identity/v3/role_assignments?user.id=517c8b8a3dbb4c26bb946e9641d03bb6&scope.project.id=3363e1213c7f49a4bccd9116d9d698d0&role.id=3dfa1e29c6a0404388d256728d66e4a1 => generated 608 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:32.524902 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce505657-703b-4d0a-afe6-a66ad413c36f None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:32.525145 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce505657-703b-4d0a-afe6-a66ad413c36f None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:32.525563 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce505657-703b-4d0a-afe6-a66ad413c36f None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:32.526747 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 74/146] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:37:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:37:32.543180 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c828be89-260a-42f0-91ea-366fd09ce154 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:32.544613 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c828be89-260a-42f0-91ea-366fd09ce154 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:32.545373 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c828be89-260a-42f0-91ea-366fd09ce154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:32.584702 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-c828be89-260a-42f0-91ea-366fd09ce154 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:37:32.587736 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-c828be89-260a-42f0-91ea-366fd09ce154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:37:32.704686 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:32.734265 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 73/147] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:37:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:37:33.234947 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce505657-703b-4d0a-afe6-a66ad413c36f None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:33.363108 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce505657-703b-4d0a-afe6-a66ad413c36f None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:33.369809 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee64d9-e329-490e-896a-a4caee6eb6f6 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:33.370429 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee64d9-e329-490e-896a-a4caee6eb6f6 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:33.370891 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee64d9-e329-490e-896a-a4caee6eb6f6 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:33.372852 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 74/148] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:37:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:37:33.376985 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:33.379395 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827fd1b-7bd1-40df-a6ab-ed5af3f5b1d5 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:33.379678 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827fd1b-7bd1-40df-a6ab-ed5af3f5b1d5 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:33.379953 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827fd1b-7bd1-40df-a6ab-ed5af3f5b1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:33.403294 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cd343f-517c-4b77-9b4f-c80e8cfd561a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:33.403943 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd343f-517c-4b77-9b4f-c80e8cfd561a None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:33.404224 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd343f-517c-4b77-9b4f-c80e8cfd561a None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:33.404489 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd343f-517c-4b77-9b4f-c80e8cfd561a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:33.417362 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cd343f-517c-4b77-9b4f-c80e8cfd561a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:37:33.422158 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-6827fd1b-7bd1-40df-a6ab-ed5af3f5b1d5 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:37:33.422986 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-13cd343f-517c-4b77-9b4f-c80e8cfd561a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:37:33.422986 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:37:33.422986 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:37:33.422986 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:37:33.422986 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:37:33.422986 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:37:33.422986 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:37:33.422986 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:37:33.422986 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:37:33.422986 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:37:33.422986 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:37:33.422986 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:37:33.422986 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:37:33.422986 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:37:33.422986 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:37:33.422986 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:37:33.423814 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:37:33.423814 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:37:33.423814 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:37:33.423814 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:37:33.423814 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:37:33.423814 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:37:33.423814 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:37:33.423814 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:37:33.423814 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:37:33.423814 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:37:33.423814 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:37:33.423814 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:37:33.423814 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:37:33.423814 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:37:33.423814 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:37:33.423814 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:37:33.424568 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:37:33.424568 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:37:33.424568 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:37:33.424568 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:37:33.424568 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:37:33.424568 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:37:33.424568 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:37:33.424568 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:37:33.424568 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:37:33.424568 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:37:33.424568 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:37:33.424568 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:37:33.425138 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-6827fd1b-7bd1-40df-a6ab-ed5af3f5b1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:37:33.425202 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 75/149] 10.222.0.60 () {56 vars in 1114 bytes} [Sat Sep 24 19:37:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:37:33.434580 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cd343f-517c-4b77-9b4f-c80e8cfd561a None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:33.515356 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 75/150] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:37:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:37:33.516897 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209bcb8-ef5c-4475-b9e1-4aa91bdaabfc None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:33.517188 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209bcb8-ef5c-4475-b9e1-4aa91bdaabfc None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:33.517551 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209bcb8-ef5c-4475-b9e1-4aa91bdaabfc None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:33.518978 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 76/151] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:37:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:37:33.525510 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d3717d-80d9-49d7-a24a-28ce921c84c5 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:33.525844 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d3717d-80d9-49d7-a24a-28ce921c84c5 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:33.526062 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d3717d-80d9-49d7-a24a-28ce921c84c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:33.561565 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-69d3717d-80d9-49d7-a24a-28ce921c84c5 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:37:33.563040 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-69d3717d-80d9-49d7-a24a-28ce921c84c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:37:33.577154 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cd343f-517c-4b77-9b4f-c80e8cfd561a None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:33.615775 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc7879d-9c00-4b74-8216-2d14ec34a632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:33.616541 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7879d-9c00-4b74-8216-2d14ec34a632 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:33.616830 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7879d-9c00-4b74-8216-2d14ec34a632 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:33.617107 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7879d-9c00-4b74-8216-2d14ec34a632 None admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:33.617823 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc7879d-9c00-4b74-8216-2d14ec34a632 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:37:33.618130 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc7879d-9c00-4b74-8216-2d14ec34a632 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:33.619599 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc7879d-9c00-4b74-8216-2d14ec34a632 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:33.629116 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 76/152] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Sep 24 19:37:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:33.630264 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338ef91-6fc5-4f5f-ae50-fc092f7339d7 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:33.630548 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338ef91-6fc5-4f5f-ae50-fc092f7339d7 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:33.630868 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338ef91-6fc5-4f5f-ae50-fc092f7339d7 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:33.632717 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 77/153] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:37:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:37:33.639161 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa79efb-b7bf-4f5d-bdfd-f0823d7f7437 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:33.639421 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa79efb-b7bf-4f5d-bdfd-f0823d7f7437 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:33.639699 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa79efb-b7bf-4f5d-bdfd-f0823d7f7437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:33.661277 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-2aa79efb-b7bf-4f5d-bdfd-f0823d7f7437 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:37:33.662544 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-2aa79efb-b7bf-4f5d-bdfd-f0823d7f7437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:37:33.672186 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 77/154] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:37:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 19:37:33.675537 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d3717d-80d9-49d7-a24a-28ce921c84c5 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:33.696276 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:33.727884 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:33.744328 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 78/155] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:37:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 19:37:33.787703 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d3717d-80d9-49d7-a24a-28ce921c84c5 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:33.802601 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f29de9-f340-4ab6-b269-1feeb9937d18 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:33.802886 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f29de9-f340-4ab6-b269-1feeb9937d18 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:33.803146 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f29de9-f340-4ab6-b269-1feeb9937d18 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:33.805471 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 79/156] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:37:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:37:33.814512 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c0fb6-5ef0-4e6e-ac31-ec32954ec460 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:33.814804 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c0fb6-5ef0-4e6e-ac31-ec32954ec460 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:33.815083 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c0fb6-5ef0-4e6e-ac31-ec32954ec460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:33.826524 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6878683-9da7-410b-8d32-ee4336964534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:33.827165 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6878683-9da7-410b-8d32-ee4336964534 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:33.827444 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6878683-9da7-410b-8d32-ee4336964534 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:33.827715 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6878683-9da7-410b-8d32-ee4336964534 None admin] PATH_INFO: `/v3/users/517c8b8a3dbb4c26bb946e9641d03bb6` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:33.828861 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6878683-9da7-410b-8d32-ee4336964534 None admin] RBAC: Authorizing `identity:get_user(user_id=517c8b8a3dbb4c26bb946e9641d03bb6)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:33.830331 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6878683-9da7-410b-8d32-ee4336964534 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:33.831923 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 78/157] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Sep 24 19:37:33 2022] GET /identity/v3/users/517c8b8a3dbb4c26bb946e9641d03bb6 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:33.837964 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6878683-9da7-410b-8d32-ee4336964534 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:33.848116 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-980c0fb6-5ef0-4e6e-ac31-ec32954ec460 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:37:33.849327 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-980c0fb6-5ef0-4e6e-ac31-ec32954ec460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:37:33.958378 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 80/158] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:37:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:37:33.959145 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c0fb6-5ef0-4e6e-ac31-ec32954ec460 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:33.990379 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6878683-9da7-410b-8d32-ee4336964534 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:34.014445 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:34.046513 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04655903-3ae4-4404-a62e-d02bdb970c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:34.047367 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04655903-3ae4-4404-a62e-d02bdb970c78 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:34.047794 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04655903-3ae4-4404-a62e-d02bdb970c78 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:34.048478 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04655903-3ae4-4404-a62e-d02bdb970c78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:34.088433 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:34.101924 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c0fb6-5ef0-4e6e-ac31-ec32954ec460 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:34.147052 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f164f86-9724-4997-a8a9-52ba64c344d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:34.147736 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f164f86-9724-4997-a8a9-52ba64c344d9 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:34.148038 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f164f86-9724-4997-a8a9-52ba64c344d9 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:34.148469 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f164f86-9724-4997-a8a9-52ba64c344d9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:34.149568 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f164f86-9724-4997-a8a9-52ba64c344d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:34.149711 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04655903-3ae4-4404-a62e-d02bdb970c78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:34.151033 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f164f86-9724-4997-a8a9-52ba64c344d9 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:34.151164 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04655903-3ae4-4404-a62e-d02bdb970c78 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:34.153543 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 81/159] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:37:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:34.153543 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f164f86-9724-4997-a8a9-52ba64c344d9 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:34.273804 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 79/160] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Sep 24 19:37:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:37:34.274910 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04655903-3ae4-4404-a62e-d02bdb970c78 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:34.282588 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f164f86-9724-4997-a8a9-52ba64c344d9 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:34.291408 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:34.320798 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e77ca92-469b-4014-a2d2-91ae57a73016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:34.321350 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e77ca92-469b-4014-a2d2-91ae57a73016 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:34.321661 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e77ca92-469b-4014-a2d2-91ae57a73016 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:34.321932 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e77ca92-469b-4014-a2d2-91ae57a73016 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:34.332343 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e77ca92-469b-4014-a2d2-91ae57a73016 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:37:34.337831 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-3e77ca92-469b-4014-a2d2-91ae57a73016 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:37:34.337831 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:37:34.337831 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:37:34.337831 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:37:34.337831 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:37:34.337831 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:37:34.337831 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:37:34.337831 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:37:34.337831 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:37:34.337831 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:37:34.337831 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:37:34.337831 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:37:34.337831 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:37:34.337831 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:37:34.337831 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:37:34.337831 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:37:34.338810 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:37:34.338810 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:37:34.338810 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:37:34.338810 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:37:34.338810 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:37:34.338810 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:37:34.338810 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:37:34.338810 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:37:34.338810 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:37:34.338810 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:37:34.338810 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:37:34.338810 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:37:34.338810 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:37:34.338810 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:37:34.338810 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:37:34.338810 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:37:34.339581 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:37:34.339581 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:37:34.339581 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:37:34.339581 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:37:34.339581 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:37:34.339581 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:37:34.339581 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:37:34.339581 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:37:34.339581 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:37:34.339581 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:37:34.339581 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:37:34.339581 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:37:34.339581 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 82/161] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Sep 24 19:37:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:37:34.340433 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e77ca92-469b-4014-a2d2-91ae57a73016 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:34.365242 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:34.385172 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04655903-3ae4-4404-a62e-d02bdb970c78 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:34.420225 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc81290-6953-4cad-8dd4-2a386e5734e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:34.420864 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc81290-6953-4cad-8dd4-2a386e5734e1 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:34.421142 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc81290-6953-4cad-8dd4-2a386e5734e1 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:34.421414 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc81290-6953-4cad-8dd4-2a386e5734e1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:34.433184 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc81290-6953-4cad-8dd4-2a386e5734e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:37:34.438103 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-9fc81290-6953-4cad-8dd4-2a386e5734e1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 19:37:34.438103 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:37:34.438103 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:37:34.438103 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:37:34.438103 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:37:34.438103 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:37:34.438103 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:37:34.438103 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:37:34.438103 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:37:34.438103 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:37:34.438103 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:37:34.438103 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:37:34.438103 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:37:34.438103 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:37:34.438103 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:37:34.438103 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:37:34.439010 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:37:34.439010 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:37:34.439010 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:37:34.439010 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:37:34.439010 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:37:34.439010 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:37:34.439010 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:37:34.439010 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:37:34.439010 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:37:34.439010 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:37:34.439010 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:37:34.439010 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:37:34.439010 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:37:34.439010 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:37:34.439010 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:37:34.439010 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:37:34.439768 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:37:34.439768 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:37:34.439768 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:37:34.439768 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:37:34.439768 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:37:34.439768 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:37:34.439768 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:37:34.439768 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:37:34.439768 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:37:34.439768 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:37:34.439768 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 19:37:34.439768 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:37:34.439768 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 80/162] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Sep 24 19:37:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:37:34.440403 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc81290-6953-4cad-8dd4-2a386e5734e1 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:34.458495 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e77ca92-469b-4014-a2d2-91ae57a73016 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:34.495912 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4798b84-0d5f-41ad-99d7-a914ba2f8ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:34.496523 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4798b84-0d5f-41ad-99d7-a914ba2f8ddc None admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:34.496801 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4798b84-0d5f-41ad-99d7-a914ba2f8ddc None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:34.497068 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4798b84-0d5f-41ad-99d7-a914ba2f8ddc None admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:34.497763 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4798b84-0d5f-41ad-99d7-a914ba2f8ddc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:34.499214 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4798b84-0d5f-41ad-99d7-a914ba2f8ddc None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:34.526358 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:34.552214 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc81290-6953-4cad-8dd4-2a386e5734e1 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:34.588896 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd8a743-9ab8-4078-9605-8f7775251e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:34.589559 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8a743-9ab8-4078-9605-8f7775251e91 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:34.589737 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8a743-9ab8-4078-9605-8f7775251e91 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:34.590002 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8a743-9ab8-4078-9605-8f7775251e91 None admin] PATH_INFO: `/v3/projects/3363e1213c7f49a4bccd9116d9d698d0` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:34.591385 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd8a743-9ab8-4078-9605-8f7775251e91 None admin] RBAC: Authorizing `identity:get_project(project_id=3363e1213c7f49a4bccd9116d9d698d0)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:34.592870 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd8a743-9ab8-4078-9605-8f7775251e91 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:34.594582 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 81/163] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Sep 24 19:37:34 2022] GET /identity/v3/projects/3363e1213c7f49a4bccd9116d9d698d0 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:34.595342 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd8a743-9ab8-4078-9605-8f7775251e91 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:34.618752 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 83/164] 10.222.0.60 () {60 vars in 1132 bytes} [Sat Sep 24 19:37:34 2022] POST /identity/v3/users => generated 283 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:37:34.619626 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4798b84-0d5f-41ad-99d7-a914ba2f8ddc None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:34.735678 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:34.766472 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd8a743-9ab8-4078-9605-8f7775251e91 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:34.776950 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4798b84-0d5f-41ad-99d7-a914ba2f8ddc None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:34.816679 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed559d-8d00-44bc-8963-961c09ac3110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:34.816941 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed559d-8d00-44bc-8963-961c09ac3110 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:34.817281 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed559d-8d00-44bc-8963-961c09ac3110 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:34.817451 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed559d-8d00-44bc-8963-961c09ac3110 None admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:34.818158 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ed559d-8d00-44bc-8963-961c09ac3110 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:37:34.820831 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ed559d-8d00-44bc-8963-961c09ac3110 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:34.820831 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ed559d-8d00-44bc-8963-961c09ac3110 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:34.824160 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af205119-1fd6-40c7-9467-b81967c58123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:34.825005 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af205119-1fd6-40c7-9467-b81967c58123 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:34.825282 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af205119-1fd6-40c7-9467-b81967c58123 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:34.827403 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af205119-1fd6-40c7-9467-b81967c58123 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:34.831443 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 84/165] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Sep 24 19:37:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:34.832281 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed559d-8d00-44bc-8963-961c09ac3110 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:34.844923 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af205119-1fd6-40c7-9467-b81967c58123 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:37:34.849884 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-af205119-1fd6-40c7-9467-b81967c58123 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:37:34.849884 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:37:34.849884 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:37:34.849884 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:37:34.849884 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:37:34.849884 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:37:34.849884 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:37:34.849884 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:37:34.849884 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:37:34.849884 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:37:34.849884 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:37:34.849884 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:37:34.849884 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:37:34.849884 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:37:34.849884 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:37:34.849884 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:37:34.851470 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:37:34.851470 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:37:34.851470 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:37:34.851470 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:37:34.851470 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:37:34.851470 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:37:34.851470 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:37:34.851470 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:37:34.851470 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:37:34.851470 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:37:34.851470 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:37:34.851470 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:37:34.851470 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:37:34.851470 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:37:34.851470 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:37:34.851470 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:37:34.854647 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:37:34.854647 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:37:34.854647 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:37:34.854647 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:37:34.854647 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:37:34.854647 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:37:34.854647 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:37:34.854647 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:37:34.854647 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:37:34.854647 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:37:34.854647 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:37:34.854647 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:37:34.854647 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 82/166] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Sep 24 19:37:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:37:34.854647 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af205119-1fd6-40c7-9467-b81967c58123 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:34.856454 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:35.002032 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed559d-8d00-44bc-8963-961c09ac3110 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:35.014138 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af205119-1fd6-40c7-9467-b81967c58123 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:35.065657 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7ce0e6-2ad7-49a1-9b72-9fdbaf1bc8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:35.067366 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ce0e6-2ad7-49a1-9b72-9fdbaf1bc8e0 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:35.067366 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ce0e6-2ad7-49a1-9b72-9fdbaf1bc8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:35.067366 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ce0e6-2ad7-49a1-9b72-9fdbaf1bc8e0 None admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:35.067984 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7ce0e6-2ad7-49a1-9b72-9fdbaf1bc8e0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:37:35.068471 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7ce0e6-2ad7-49a1-9b72-9fdbaf1bc8e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:35.070467 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7ce0e6-2ad7-49a1-9b72-9fdbaf1bc8e0 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:35.073151 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a045ddb9-dea1-48e3-a124-0c272f840851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:35.073815 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045ddb9-dea1-48e3-a124-0c272f840851 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:35.074092 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045ddb9-dea1-48e3-a124-0c272f840851 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:35.074359 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045ddb9-dea1-48e3-a124-0c272f840851 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:35.075104 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a045ddb9-dea1-48e3-a124-0c272f840851 None admin] RBAC: Adding query filter params (role.id=dd695228990e4288afe29e3cefb75823, scope.project.id=3363e1213c7f49a4bccd9116d9d698d0, user.id=517c8b8a3dbb4c26bb946e9641d03bb6) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:37:35.075408 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a045ddb9-dea1-48e3-a124-0c272f840851 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:35.078193 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a045ddb9-dea1-48e3-a124-0c272f840851 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:35.081011 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:35.087232 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 83/167] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Sep 24 19:37:34 2022] GET /identity/v3/role_assignments?user.id=517c8b8a3dbb4c26bb946e9641d03bb6&scope.project.id=3363e1213c7f49a4bccd9116d9d698d0&role.id=dd695228990e4288afe29e3cefb75823 => generated 608 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:35.087232 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a045ddb9-dea1-48e3-a124-0c272f840851 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:35.087496 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 85/168] 10.222.0.60 () {56 vars in 1101 bytes} [Sat Sep 24 19:37:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:35.089631 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7ce0e6-2ad7-49a1-9b72-9fdbaf1bc8e0 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:35.185241 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:35.244235 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a045ddb9-dea1-48e3-a124-0c272f840851 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:35.256906 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7ce0e6-2ad7-49a1-9b72-9fdbaf1bc8e0 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:35.307610 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257209ec-fcd8-4855-a185-74038b2e7b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:35.308269 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257209ec-fcd8-4855-a185-74038b2e7b90 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:35.308549 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257209ec-fcd8-4855-a185-74038b2e7b90 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:35.309022 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257209ec-fcd8-4855-a185-74038b2e7b90 None admin] PATH_INFO: `/v3/users/3ee86ed717254b8d8e892338e3d639aa` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:35.311195 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257209ec-fcd8-4855-a185-74038b2e7b90 None admin] RBAC: Authorizing `identity:get_user(user_id=3ee86ed717254b8d8e892338e3d639aa)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:35.313088 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257209ec-fcd8-4855-a185-74038b2e7b90 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:35.315262 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 84/169] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Sep 24 19:37:35 2022] GET /identity/v3/users/3ee86ed717254b8d8e892338e3d639aa => generated 247 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:35.316083 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257209ec-fcd8-4855-a185-74038b2e7b90 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:35.318586 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04244246-5976-499c-93ed-6de1c8678cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:35.319854 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04244246-5976-499c-93ed-6de1c8678cba None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:35.320505 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04244246-5976-499c-93ed-6de1c8678cba None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:35.321099 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04244246-5976-499c-93ed-6de1c8678cba None admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:35.323720 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04244246-5976-499c-93ed-6de1c8678cba None admin] RBAC: Adding query filter params (name=member) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:37:35.324426 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04244246-5976-499c-93ed-6de1c8678cba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:35.326836 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04244246-5976-499c-93ed-6de1c8678cba None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:35.343373 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 86/170] 10.222.0.60 () {56 vars in 1101 bytes} [Sat Sep 24 19:37:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:35.344351 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04244246-5976-499c-93ed-6de1c8678cba None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:35.432193 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:35.464497 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257209ec-fcd8-4855-a185-74038b2e7b90 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:35.487495 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04244246-5976-499c-93ed-6de1c8678cba None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:35.505783 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030599dd-d83c-4495-a645-5061ae72621c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:35.506430 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030599dd-d83c-4495-a645-5061ae72621c None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:35.506707 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030599dd-d83c-4495-a645-5061ae72621c None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:35.507229 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030599dd-d83c-4495-a645-5061ae72621c None admin] PATH_INFO: `/v3/users/8989e5b5b6f94a8a9ad90965dd6374b1` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:35.509464 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030599dd-d83c-4495-a645-5061ae72621c None admin] RBAC: Authorizing `identity:get_user(user_id=8989e5b5b6f94a8a9ad90965dd6374b1)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:35.511916 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030599dd-d83c-4495-a645-5061ae72621c None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:35.512759 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 85/171] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Sep 24 19:37:35 2022] GET /identity/v3/users/8989e5b5b6f94a8a9ad90965dd6374b1 => generated 289 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:35.513361 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030599dd-d83c-4495-a645-5061ae72621c None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:35.523047 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:35.549910 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deacdbec-3c7b-438e-a8df-67ab7c601dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:35.551775 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deacdbec-3c7b-438e-a8df-67ab7c601dad None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:35.552888 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deacdbec-3c7b-438e-a8df-67ab7c601dad None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:35.555737 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deacdbec-3c7b-438e-a8df-67ab7c601dad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:35.654968 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deacdbec-3c7b-438e-a8df-67ab7c601dad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:35.656917 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deacdbec-3c7b-438e-a8df-67ab7c601dad None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:35.669647 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030599dd-d83c-4495-a645-5061ae72621c None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:35.720059 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b2833a-6a86-41d3-861d-bcf1c1e40f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:35.720637 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2833a-6a86-41d3-861d-bcf1c1e40f18 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:35.720915 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2833a-6a86-41d3-861d-bcf1c1e40f18 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:35.721186 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2833a-6a86-41d3-861d-bcf1c1e40f18 None admin] PATH_INFO: `/v3/users/517c8b8a3dbb4c26bb946e9641d03bb6` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:35.727660 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b2833a-6a86-41d3-861d-bcf1c1e40f18 None admin] RBAC: Authorizing `identity:get_user(user_id=517c8b8a3dbb4c26bb946e9641d03bb6)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:35.729175 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b2833a-6a86-41d3-861d-bcf1c1e40f18 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:35.731111 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 86/172] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Sep 24 19:37:35 2022] GET /identity/v3/users/517c8b8a3dbb4c26bb946e9641d03bb6 => generated 275 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:35.731739 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b2833a-6a86-41d3-861d-bcf1c1e40f18 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:35.735462 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:35.787208 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 87/173] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Sep 24 19:37:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:37:35.789099 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deacdbec-3c7b-438e-a8df-67ab7c601dad None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:35.878151 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:35.903648 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deacdbec-3c7b-438e-a8df-67ab7c601dad None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:35.927278 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b2833a-6a86-41d3-861d-bcf1c1e40f18 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:35.941917 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18042095-d598-41f4-a6a0-f340b07ee96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:35.942722 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18042095-d598-41f4-a6a0-f340b07ee96e None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:35.943068 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18042095-d598-41f4-a6a0-f340b07ee96e None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:35.945531 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18042095-d598-41f4-a6a0-f340b07ee96e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:35.986058 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:35.987696 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d4c08c-3acd-4f6c-8773-4ecc8c751fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:35.988352 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d4c08c-3acd-4f6c-8773-4ecc8c751fa8 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:35.988623 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d4c08c-3acd-4f6c-8773-4ecc8c751fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:35.988890 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d4c08c-3acd-4f6c-8773-4ecc8c751fa8 None admin] PATH_INFO: `/v3/projects/3363e1213c7f49a4bccd9116d9d698d0` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:35.994306 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d4c08c-3acd-4f6c-8773-4ecc8c751fa8 None admin] RBAC: Authorizing `identity:get_project(project_id=3363e1213c7f49a4bccd9116d9d698d0)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:35.995784 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d4c08c-3acd-4f6c-8773-4ecc8c751fa8 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:35.997871 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 87/174] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Sep 24 19:37:35 2022] GET /identity/v3/projects/3363e1213c7f49a4bccd9116d9d698d0 => generated 298 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:35.998698 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d4c08c-3acd-4f6c-8773-4ecc8c751fa8 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:36.024812 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18042095-d598-41f4-a6a0-f340b07ee96e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:36.026410 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18042095-d598-41f4-a6a0-f340b07ee96e None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:36.136550 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 88/175] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Sep 24 19:37:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:37:36.137227 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18042095-d598-41f4-a6a0-f340b07ee96e None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:36.215490 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:36.252911 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18042095-d598-41f4-a6a0-f340b07ee96e None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:36.293894 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e925c-d565-4df3-bd73-66f23dbeb536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:36.294630 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e925c-d565-4df3-bd73-66f23dbeb536 None admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:36.294918 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e925c-d565-4df3-bd73-66f23dbeb536 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:36.295203 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e925c-d565-4df3-bd73-66f23dbeb536 None admin] PATH_INFO: `/v3/projects/3363e1213c7f49a4bccd9116d9d698d0/users/8989e5b5b6f94a8a9ad90965dd6374b1/roles/632e24cff8a04bd598fbbb3b41c62218` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:36.297253 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7e925c-d565-4df3-bd73-66f23dbeb536 None admin] RBAC: Authorizing `identity:create_grant(project_id=3363e1213c7f49a4bccd9116d9d698d0, user_id=8989e5b5b6f94a8a9ad90965dd6374b1, role_id=632e24cff8a04bd598fbbb3b41c62218)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:36.298886 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7e925c-d565-4df3-bd73-66f23dbeb536 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:36.314674 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d4c08c-3acd-4f6c-8773-4ecc8c751fa8 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:36.370861 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 89/176] 10.222.0.60 () {58 vars in 1439 bytes} [Sat Sep 24 19:37:36 2022] PUT /identity/v3/projects/3363e1213c7f49a4bccd9116d9d698d0/users/8989e5b5b6f94a8a9ad90965dd6374b1/roles/632e24cff8a04bd598fbbb3b41c62218 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:37:36.371899 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e925c-d565-4df3-bd73-66f23dbeb536 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:36.375549 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d052cab-7171-47af-a9d6-06344f7c7c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:36.376329 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d052cab-7171-47af-a9d6-06344f7c7c69 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:36.376614 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d052cab-7171-47af-a9d6-06344f7c7c69 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:36.376890 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d052cab-7171-47af-a9d6-06344f7c7c69 None admin] PATH_INFO: `/v3/projects/3363e1213c7f49a4bccd9116d9d698d0` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:36.380156 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d052cab-7171-47af-a9d6-06344f7c7c69 None admin] RBAC: Authorizing `identity:get_project(project_id=3363e1213c7f49a4bccd9116d9d698d0)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:36.382294 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d052cab-7171-47af-a9d6-06344f7c7c69 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:36.390610 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 88/177] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Sep 24 19:37:35 2022] GET /identity/v3/projects/3363e1213c7f49a4bccd9116d9d698d0 => generated 298 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:36.402171 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d052cab-7171-47af-a9d6-06344f7c7c69 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:36.413542 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:36.620092 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e925c-d565-4df3-bd73-66f23dbeb536 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:36.636682 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d052cab-7171-47af-a9d6-06344f7c7c69 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:36.676795 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:36.718922 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104fbf9c-ffa3-4eb8-bc21-474184cbe423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:36.719573 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104fbf9c-ffa3-4eb8-bc21-474184cbe423 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:36.719859 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104fbf9c-ffa3-4eb8-bc21-474184cbe423 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:36.720138 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104fbf9c-ffa3-4eb8-bc21-474184cbe423 None admin] PATH_INFO: `/v3/projects/b098a73099e649a4b1378e3e4ecc66f1` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:36.724301 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104fbf9c-ffa3-4eb8-bc21-474184cbe423 None admin] RBAC: Authorizing `identity:get_project(project_id=b098a73099e649a4b1378e3e4ecc66f1)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:36.726072 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104fbf9c-ffa3-4eb8-bc21-474184cbe423 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:36.731095 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b31713-136b-4be0-b09d-d25cf16248f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:36.731737 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b31713-136b-4be0-b09d-d25cf16248f4 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:36.732020 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b31713-136b-4be0-b09d-d25cf16248f4 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:36.732293 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b31713-136b-4be0-b09d-d25cf16248f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:36.733044 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b31713-136b-4be0-b09d-d25cf16248f4 None admin] RBAC: Adding query filter params (role.id=f022705fa6ce43828345ef50b3f7efc9, scope.project.id=3363e1213c7f49a4bccd9116d9d698d0, user.id=3ee86ed717254b8d8e892338e3d639aa) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:37:36.733358 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b31713-136b-4be0-b09d-d25cf16248f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:36.734921 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b31713-136b-4be0-b09d-d25cf16248f4 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:36.738070 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 90/178] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Sep 24 19:37:36 2022] GET /identity/v3/projects/b098a73099e649a4b1378e3e4ecc66f1 => generated 312 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:36.745532 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 89/179] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Sep 24 19:37:36 2022] GET /identity/v3/role_assignments?user.id=3ee86ed717254b8d8e892338e3d639aa&scope.project.id=3363e1213c7f49a4bccd9116d9d698d0&role.id=f022705fa6ce43828345ef50b3f7efc9 => generated 608 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:37:36.748911 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104fbf9c-ffa3-4eb8-bc21-474184cbe423 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:36.899783 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104fbf9c-ffa3-4eb8-bc21-474184cbe423 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:36.940358 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce64db54-def7-42f6-b2d0-51c155480f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:36.940993 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64db54-def7-42f6-b2d0-51c155480f9d None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:36.941274 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64db54-def7-42f6-b2d0-51c155480f9d None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:36.941584 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64db54-def7-42f6-b2d0-51c155480f9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:36.942348 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce64db54-def7-42f6-b2d0-51c155480f9d None admin] RBAC: Adding query filter params (role.id=3dfa1e29c6a0404388d256728d66e4a1, scope.project.id=b098a73099e649a4b1378e3e4ecc66f1, user.id=517c8b8a3dbb4c26bb946e9641d03bb6) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:37:36.942664 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce64db54-def7-42f6-b2d0-51c155480f9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:36.944135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce64db54-def7-42f6-b2d0-51c155480f9d None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:36.954895 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 91/180] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Sep 24 19:37:36 2022] GET /identity/v3/role_assignments?user.id=517c8b8a3dbb4c26bb946e9641d03bb6&scope.project.id=b098a73099e649a4b1378e3e4ecc66f1&role.id=3dfa1e29c6a0404388d256728d66e4a1 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:37.675310 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdeb50b-cb8a-4530-955b-98d0072c66a9 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:37.675310 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdeb50b-cb8a-4530-955b-98d0072c66a9 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:37.675310 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdeb50b-cb8a-4530-955b-98d0072c66a9 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:37.675830 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 90/181] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:37:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:37:37.681781 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb57ed-2749-451d-b744-eb8ee0d4590d None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:37.682285 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb57ed-2749-451d-b744-eb8ee0d4590d None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:37.682361 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb57ed-2749-451d-b744-eb8ee0d4590d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:37.706156 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-70eb57ed-2749-451d-b744-eb8ee0d4590d None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:37:37.707703 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-70eb57ed-2749-451d-b744-eb8ee0d4590d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:37:37.764583 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:37.783896 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 92/182] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:37:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:37:38.020821 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4e1c6-ce7f-49dc-a9e8-cfb8588d0e83 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:38.021313 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4e1c6-ce7f-49dc-a9e8-cfb8588d0e83 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:38.021313 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4e1c6-ce7f-49dc-a9e8-cfb8588d0e83 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:38.023407 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 91/183] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:37:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:37:38.027893 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ef3f3-d4df-4de1-bb86-01f1b6df6225 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:38.028444 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ef3f3-d4df-4de1-bb86-01f1b6df6225 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:38.028632 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b3499-d18e-4a2f-8584-3f23a9727468 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:38.028916 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b3499-d18e-4a2f-8584-3f23a9727468 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:38.029195 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b3499-d18e-4a2f-8584-3f23a9727468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:38.029607 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ef3f3-d4df-4de1-bb86-01f1b6df6225 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:38.031251 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 93/184] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:37:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:37:38.037948 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e48be6-bb80-42ac-b6c7-0da3ed28ac27 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:38.038254 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e48be6-bb80-42ac-b6c7-0da3ed28ac27 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:38.038530 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e48be6-bb80-42ac-b6c7-0da3ed28ac27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:38.050949 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-2e4b3499-d18e-4a2f-8584-3f23a9727468 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:37:38.053278 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-2e4b3499-d18e-4a2f-8584-3f23a9727468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:37:38.058069 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-a5e48be6-bb80-42ac-b6c7-0da3ed28ac27 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:37:38.059269 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-a5e48be6-bb80-42ac-b6c7-0da3ed28ac27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:37:38.136680 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:38.136882 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 94/185] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:37:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 19:37:38.141732 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e48be6-bb80-42ac-b6c7-0da3ed28ac27 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:38.146896 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 92/186] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:37:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 19:37:38.252070 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e48be6-bb80-42ac-b6c7-0da3ed28ac27 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:38.268227 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:38.290870 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a57c1a-7b20-4156-a2c8-40d36ab533aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:38.291810 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a57c1a-7b20-4156-a2c8-40d36ab533aa None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:38.292338 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a57c1a-7b20-4156-a2c8-40d36ab533aa None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:38.292795 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a57c1a-7b20-4156-a2c8-40d36ab533aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:38.305193 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a57c1a-7b20-4156-a2c8-40d36ab533aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:37:38.310561 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-09a57c1a-7b20-4156-a2c8-40d36ab533aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:37:38.310561 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:37:38.310561 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:37:38.310561 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:37:38.310561 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:37:38.310561 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:37:38.310561 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:37:38.310561 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:37:38.310561 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:37:38.310561 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:37:38.310561 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:37:38.310561 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:37:38.310561 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:37:38.310561 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:37:38.310561 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:37:38.310561 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:37:38.311492 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:37:38.311492 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:37:38.311492 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:37:38.311492 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:37:38.311492 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:37:38.311492 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:37:38.311492 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:37:38.311492 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:37:38.311492 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:37:38.311492 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:37:38.311492 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:37:38.311492 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:37:38.311492 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:37:38.311492 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:37:38.311492 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:37:38.311492 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:37:38.312279 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:37:38.312279 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:37:38.312279 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:37:38.312279 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:37:38.312279 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:37:38.312279 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:37:38.312279 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:37:38.312279 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:37:38.312279 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:37:38.312279 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:37:38.312279 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:37:38.312279 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:37:38.314391 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 95/187] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Sep 24 19:37:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:37:38.326416 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b3499-d18e-4a2f-8584-3f23a9727468 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:38.419738 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a57c1a-7b20-4156-a2c8-40d36ab533aa None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:38.441101 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b3499-d18e-4a2f-8584-3f23a9727468 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:38.480721 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce15b920-69d7-4c90-9919-5b4b67c79cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:38.481321 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15b920-69d7-4c90-9919-5b4b67c79cc3 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:38.481629 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15b920-69d7-4c90-9919-5b4b67c79cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:38.481898 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15b920-69d7-4c90-9919-5b4b67c79cc3 None admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:38.482570 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce15b920-69d7-4c90-9919-5b4b67c79cc3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:37:38.482871 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce15b920-69d7-4c90-9919-5b4b67c79cc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:38.484266 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce15b920-69d7-4c90-9919-5b4b67c79cc3 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:38.493655 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 93/188] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Sep 24 19:37:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:38.494347 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce15b920-69d7-4c90-9919-5b4b67c79cc3 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:38.552875 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a57c1a-7b20-4156-a2c8-40d36ab533aa None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:38.566431 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:38.600022 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c319569-8142-4189-93cb-97212d79c4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:38.601588 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c319569-8142-4189-93cb-97212d79c4e4 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:38.602204 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c319569-8142-4189-93cb-97212d79c4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:38.602695 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c319569-8142-4189-93cb-97212d79c4e4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:38.614077 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c319569-8142-4189-93cb-97212d79c4e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:37:38.620321 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-8c319569-8142-4189-93cb-97212d79c4e4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:37:38.620321 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:37:38.620321 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:37:38.620321 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:37:38.620321 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:37:38.620321 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:37:38.620321 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:37:38.620321 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:37:38.620321 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:37:38.620321 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:37:38.620321 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:37:38.620321 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:37:38.620321 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:37:38.620321 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:37:38.620321 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:37:38.620321 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:37:38.626378 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:37:38.626378 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:37:38.626378 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:37:38.626378 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:37:38.626378 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:37:38.626378 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:37:38.626378 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:37:38.626378 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:37:38.626378 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:37:38.626378 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:37:38.626378 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:37:38.626378 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:37:38.626378 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:37:38.626378 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:37:38.626378 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:37:38.626378 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:37:38.627169 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:37:38.627169 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:37:38.627169 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:37:38.627169 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:37:38.627169 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:37:38.627169 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:37:38.627169 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:37:38.627169 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:37:38.627169 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:37:38.627169 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:37:38.627169 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:37:38.627169 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:37:38.627169 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 96/189] 10.222.0.60 () {56 vars in 1114 bytes} [Sat Sep 24 19:37:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:37:38.627169 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c319569-8142-4189-93cb-97212d79c4e4 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:38.634463 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce15b920-69d7-4c90-9919-5b4b67c79cc3 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:38.666183 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:38.670327 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade4f95e-2c00-46c6-8d8f-f18cb109ce36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:38.670966 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4f95e-2c00-46c6-8d8f-f18cb109ce36 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:38.671295 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4f95e-2c00-46c6-8d8f-f18cb109ce36 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:38.671566 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4f95e-2c00-46c6-8d8f-f18cb109ce36 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:38.677354 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade4f95e-2c00-46c6-8d8f-f18cb109ce36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:38.677354 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade4f95e-2c00-46c6-8d8f-f18cb109ce36 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:38.677354 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 94/190] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:37:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:38.681161 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade4f95e-2c00-46c6-8d8f-f18cb109ce36 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:38.743053 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c319569-8142-4189-93cb-97212d79c4e4 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:38.783297 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb23274-48e5-485d-845c-c5d17956f673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:38.784011 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb23274-48e5-485d-845c-c5d17956f673 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:38.784291 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb23274-48e5-485d-845c-c5d17956f673 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:38.784573 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb23274-48e5-485d-845c-c5d17956f673 None admin] PATH_INFO: `/v3/users/88977caac45542988ea6997003268bcc` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:38.796407 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade4f95e-2c00-46c6-8d8f-f18cb109ce36 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:38.802833 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb23274-48e5-485d-845c-c5d17956f673 None admin] RBAC: Authorizing `identity:get_user(user_id=88977caac45542988ea6997003268bcc)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:38.804510 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb23274-48e5-485d-845c-c5d17956f673 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:38.806522 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 97/191] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Sep 24 19:37:38 2022] GET /identity/v3/users/88977caac45542988ea6997003268bcc => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:38.807299 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb23274-48e5-485d-845c-c5d17956f673 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:38.832074 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:38.840057 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754a883-3e4b-4eda-9536-0543234346d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:38.840682 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754a883-3e4b-4eda-9536-0543234346d1 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:38.840961 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754a883-3e4b-4eda-9536-0543234346d1 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:38.843126 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754a883-3e4b-4eda-9536-0543234346d1 None admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:38.843126 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0754a883-3e4b-4eda-9536-0543234346d1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:37:38.843126 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0754a883-3e4b-4eda-9536-0543234346d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:38.843605 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0754a883-3e4b-4eda-9536-0543234346d1 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:38.853477 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 95/192] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Sep 24 19:37:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:38.858631 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754a883-3e4b-4eda-9536-0543234346d1 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:38.926189 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:38.937029 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb23274-48e5-485d-845c-c5d17956f673 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:38.977418 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476180c3-e558-41af-9dbd-86c187715b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:38.977806 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754a883-3e4b-4eda-9536-0543234346d1 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:38.978154 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476180c3-e558-41af-9dbd-86c187715b65 None admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:38.978440 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476180c3-e558-41af-9dbd-86c187715b65 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:38.978716 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476180c3-e558-41af-9dbd-86c187715b65 None admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:38.979382 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476180c3-e558-41af-9dbd-86c187715b65 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:38.980835 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476180c3-e558-41af-9dbd-86c187715b65 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:39.018396 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e90bd9-ba86-4182-8a20-2eebf122d793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:39.019042 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e90bd9-ba86-4182-8a20-2eebf122d793 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:39.019318 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e90bd9-ba86-4182-8a20-2eebf122d793 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:39.019586 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e90bd9-ba86-4182-8a20-2eebf122d793 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:39.086509 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:39.097430 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e90bd9-ba86-4182-8a20-2eebf122d793 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:39.098047 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 98/193] 10.222.0.60 () {60 vars in 1132 bytes} [Sat Sep 24 19:37:38 2022] POST /identity/v3/users => generated 297 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:37:39.098774 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476180c3-e558-41af-9dbd-86c187715b65 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:39.103516 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e90bd9-ba86-4182-8a20-2eebf122d793 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:39.256048 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476180c3-e558-41af-9dbd-86c187715b65 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:39.262241 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 96/194] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Sep 24 19:37:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:37:39.270660 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e90bd9-ba86-4182-8a20-2eebf122d793 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:39.296779 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e83a00-d654-4aa4-9d23-d81d3fa364f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:39.297144 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e83a00-d654-4aa4-9d23-d81d3fa364f1 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:39.297331 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e83a00-d654-4aa4-9d23-d81d3fa364f1 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:39.297640 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e83a00-d654-4aa4-9d23-d81d3fa364f1 None admin] PATH_INFO: `/v3/users/88977caac45542988ea6997003268bcc` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:39.298831 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e83a00-d654-4aa4-9d23-d81d3fa364f1 None admin] RBAC: Authorizing `identity:get_user(user_id=88977caac45542988ea6997003268bcc)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:39.300467 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e83a00-d654-4aa4-9d23-d81d3fa364f1 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:39.302138 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 99/195] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Sep 24 19:37:39 2022] GET /identity/v3/users/88977caac45542988ea6997003268bcc => generated 283 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:39.306116 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e33b1a-3b8d-4750-80aa-dff652791157 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:39.306716 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e33b1a-3b8d-4750-80aa-dff652791157 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:39.307195 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e33b1a-3b8d-4750-80aa-dff652791157 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:39.308810 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 100/196] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:37:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:37:39.309872 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e33b1a-3b8d-4750-80aa-dff652791157 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:39.336978 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:39.392423 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:39.403915 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e90bd9-ba86-4182-8a20-2eebf122d793 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:39.447419 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e33b1a-3b8d-4750-80aa-dff652791157 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:39.448939 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c5c022-95fe-4730-9c8f-c81fab604115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:39.449867 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5c022-95fe-4730-9c8f-c81fab604115 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:39.450326 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5c022-95fe-4730-9c8f-c81fab604115 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:39.450866 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5c022-95fe-4730-9c8f-c81fab604115 None admin] PATH_INFO: `/v3/projects/a67dea7cdf8d4c61b2758c16712e9c38` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:39.454499 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c5c022-95fe-4730-9c8f-c81fab604115 None admin] RBAC: Authorizing `identity:get_project(project_id=a67dea7cdf8d4c61b2758c16712e9c38)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:39.454970 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c5c022-95fe-4730-9c8f-c81fab604115 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:39.458687 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 97/197] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Sep 24 19:37:39 2022] GET /identity/v3/projects/a67dea7cdf8d4c61b2758c16712e9c38 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:39.460060 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb8510b-5f8e-435e-87bb-b260991a550e None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:39.460295 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb8510b-5f8e-435e-87bb-b260991a550e None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:39.460568 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb8510b-5f8e-435e-87bb-b260991a550e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:39.482908 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-ceb8510b-5f8e-435e-87bb-b260991a550e None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:37:39.484111 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-ceb8510b-5f8e-435e-87bb-b260991a550e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:37:39.492953 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b1cc78-8e6f-43ef-be73-5665241c0951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:39.493678 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1cc78-8e6f-43ef-be73-5665241c0951 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:39.493960 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1cc78-8e6f-43ef-be73-5665241c0951 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:39.494328 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1cc78-8e6f-43ef-be73-5665241c0951 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:39.590604 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 98/198] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:37:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:37:39.596261 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b1cc78-8e6f-43ef-be73-5665241c0951 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:39.597844 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b1cc78-8e6f-43ef-be73-5665241c0951 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:39.598628 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb8510b-5f8e-435e-87bb-b260991a550e None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:39.620423 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:39.724992 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 101/199] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Sep 24 19:37:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:37:39.732123 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b1cc78-8e6f-43ef-be73-5665241c0951 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:39.816618 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:39.835762 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb8510b-5f8e-435e-87bb-b260991a550e None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:39.863623 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b1cc78-8e6f-43ef-be73-5665241c0951 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:39.911652 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd7bada-f576-4ec6-abdb-ea8528f5c9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:39.912278 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7bada-f576-4ec6-abdb-ea8528f5c9d2 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:39.912503 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:39.912604 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7bada-f576-4ec6-abdb-ea8528f5c9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:39.912809 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7bada-f576-4ec6-abdb-ea8528f5c9d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:39.914433 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd7bada-f576-4ec6-abdb-ea8528f5c9d2 None admin] RBAC: Adding query filter params (role.id=f022705fa6ce43828345ef50b3f7efc9, scope.project.id=a67dea7cdf8d4c61b2758c16712e9c38, user.id=88977caac45542988ea6997003268bcc) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:37:39.917524 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd7bada-f576-4ec6-abdb-ea8528f5c9d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:39.917524 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd7bada-f576-4ec6-abdb-ea8528f5c9d2 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:39.930289 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 99/200] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Sep 24 19:37:39 2022] GET /identity/v3/role_assignments?user.id=88977caac45542988ea6997003268bcc&scope.project.id=a67dea7cdf8d4c61b2758c16712e9c38&role.id=f022705fa6ce43828345ef50b3f7efc9 => generated 259 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:39.935356 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1459b9d1-0545-4aaa-9903-1ecd5332f8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:39.936083 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459b9d1-0545-4aaa-9903-1ecd5332f8d2 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:39.936366 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459b9d1-0545-4aaa-9903-1ecd5332f8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:39.936641 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459b9d1-0545-4aaa-9903-1ecd5332f8d2 None admin] PATH_INFO: `/v3/projects/a67dea7cdf8d4c61b2758c16712e9c38` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:39.937963 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1459b9d1-0545-4aaa-9903-1ecd5332f8d2 None admin] RBAC: Authorizing `identity:get_project(project_id=a67dea7cdf8d4c61b2758c16712e9c38)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:39.939479 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1459b9d1-0545-4aaa-9903-1ecd5332f8d2 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:39.941638 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 102/201] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Sep 24 19:37:39 2022] GET /identity/v3/projects/a67dea7cdf8d4c61b2758c16712e9c38 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:39.949173 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd7bada-f576-4ec6-abdb-ea8528f5c9d2 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:39.999570 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1459b9d1-0545-4aaa-9903-1ecd5332f8d2 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:40.110045 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd7bada-f576-4ec6-abdb-ea8528f5c9d2 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:40.166001 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1459b9d1-0545-4aaa-9903-1ecd5332f8d2 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:40.204334 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f035bd2-33ae-4f97-a641-81c9c4ba880c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:40.205055 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f035bd2-33ae-4f97-a641-81c9c4ba880c None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:40.205330 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f035bd2-33ae-4f97-a641-81c9c4ba880c None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:40.205633 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f035bd2-33ae-4f97-a641-81c9c4ba880c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:40.206209 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a145ab-5351-4850-a9a6-d18edeae58c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:40.206837 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a145ab-5351-4850-a9a6-d18edeae58c9 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:40.207113 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a145ab-5351-4850-a9a6-d18edeae58c9 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:40.207385 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a145ab-5351-4850-a9a6-d18edeae58c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:40.208303 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a145ab-5351-4850-a9a6-d18edeae58c9 None admin] RBAC: Adding query filter params (role.id=dd695228990e4288afe29e3cefb75823, scope.project.id=a67dea7cdf8d4c61b2758c16712e9c38, user.id=88977caac45542988ea6997003268bcc) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:37:40.208613 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a145ab-5351-4850-a9a6-d18edeae58c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:40.210161 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a145ab-5351-4850-a9a6-d18edeae58c9 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:40.217675 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f035bd2-33ae-4f97-a641-81c9c4ba880c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:37:40.223334 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-2f035bd2-33ae-4f97-a641-81c9c4ba880c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 19:37:40.223334 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:37:40.223334 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:37:40.223334 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:37:40.223334 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:37:40.223334 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:37:40.223334 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:37:40.223334 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:37:40.223334 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:37:40.223334 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:37:40.223334 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:37:40.223334 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:37:40.223334 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:37:40.223334 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:37:40.223334 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:37:40.223334 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:37:40.224241 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:37:40.224241 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:37:40.224241 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:37:40.224241 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:37:40.224241 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:37:40.224241 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:37:40.224241 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:37:40.224241 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:37:40.224241 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:37:40.224241 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:37:40.224241 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:37:40.224241 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:37:40.224241 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:37:40.224241 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:37:40.224241 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:37:40.224241 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:37:40.225035 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:37:40.225035 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:37:40.225035 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:37:40.225035 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:37:40.225035 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:37:40.225035 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:37:40.225035 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:37:40.225035 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:37:40.225035 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:37:40.225035 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:37:40.225035 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 19:37:40.225035 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:37:40.227603 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 100/202] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Sep 24 19:37:39 2022] GET /identity/v3/role_assignments?user.id=88977caac45542988ea6997003268bcc&scope.project.id=a67dea7cdf8d4c61b2758c16712e9c38&role.id=dd695228990e4288afe29e3cefb75823 => generated 259 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:40.227770 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 103/203] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Sep 24 19:37:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:37:40.232678 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a145ab-5351-4850-a9a6-d18edeae58c9 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:40.277295 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:40.379579 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a145ab-5351-4850-a9a6-d18edeae58c9 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:40.422059 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbe288f-fee8-49ea-97b3-831ac0f7e68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:40.422583 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe288f-fee8-49ea-97b3-831ac0f7e68d None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:40.422857 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe288f-fee8-49ea-97b3-831ac0f7e68d None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:40.423125 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe288f-fee8-49ea-97b3-831ac0f7e68d None admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:40.423800 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbe288f-fee8-49ea-97b3-831ac0f7e68d None admin] RBAC: Adding query filter params (name=reader) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:37:40.424097 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbe288f-fee8-49ea-97b3-831ac0f7e68d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:40.425595 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbe288f-fee8-49ea-97b3-831ac0f7e68d None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:40.436333 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 101/204] 10.222.0.60 () {56 vars in 1101 bytes} [Sat Sep 24 19:37:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:40.442197 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f035bd2-33ae-4f97-a641-81c9c4ba880c None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:40.519034 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:40.579608 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f035bd2-33ae-4f97-a641-81c9c4ba880c None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:40.614886 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13964f9-593d-45b7-91d5-c2bc9f9d286b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:40.615531 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13964f9-593d-45b7-91d5-c2bc9f9d286b None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:40.615812 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13964f9-593d-45b7-91d5-c2bc9f9d286b None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:40.616191 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13964f9-593d-45b7-91d5-c2bc9f9d286b None admin] PATH_INFO: `/v3/users/8989e5b5b6f94a8a9ad90965dd6374b1` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:40.617632 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13964f9-593d-45b7-91d5-c2bc9f9d286b None admin] RBAC: Authorizing `identity:get_user(user_id=8989e5b5b6f94a8a9ad90965dd6374b1)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:40.619089 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13964f9-593d-45b7-91d5-c2bc9f9d286b None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:40.620680 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 104/205] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Sep 24 19:37:40 2022] GET /identity/v3/users/8989e5b5b6f94a8a9ad90965dd6374b1 => generated 289 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:40.628501 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbe288f-fee8-49ea-97b3-831ac0f7e68d None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:40.775715 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:40.800953 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbe288f-fee8-49ea-97b3-831ac0f7e68d None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:40.842446 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0539ffe-e36f-4711-9222-64670afca5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:40.843066 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0539ffe-e36f-4711-9222-64670afca5ef None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:40.843344 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0539ffe-e36f-4711-9222-64670afca5ef None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:40.843614 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0539ffe-e36f-4711-9222-64670afca5ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:40.950414 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0539ffe-e36f-4711-9222-64670afca5ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:40.950414 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0539ffe-e36f-4711-9222-64670afca5ef None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:41.050444 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:41.073541 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 102/206] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Sep 24 19:37:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:37:41.082909 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13964f9-593d-45b7-91d5-c2bc9f9d286b None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:41.327497 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13964f9-593d-45b7-91d5-c2bc9f9d286b None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:41.360812 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:41.414824 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8272674e-4b0d-428b-b0ac-023291ac5a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:41.415903 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272674e-4b0d-428b-b0ac-023291ac5a95 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:41.416388 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272674e-4b0d-428b-b0ac-023291ac5a95 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:41.416865 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272674e-4b0d-428b-b0ac-023291ac5a95 None admin] PATH_INFO: `/v3/projects/3363e1213c7f49a4bccd9116d9d698d0` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:41.418911 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8272674e-4b0d-428b-b0ac-023291ac5a95 None admin] RBAC: Authorizing `identity:get_project(project_id=3363e1213c7f49a4bccd9116d9d698d0)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:41.421644 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8272674e-4b0d-428b-b0ac-023291ac5a95 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:41.425185 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 105/207] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Sep 24 19:37:41 2022] GET /identity/v3/projects/3363e1213c7f49a4bccd9116d9d698d0 => generated 298 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:37:41.431586 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0539ffe-e36f-4711-9222-64670afca5ef None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:41.671671 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0539ffe-e36f-4711-9222-64670afca5ef None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:41.746230 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946700ff-165b-4cb6-8cc1-431218f3bb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:41.746847 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946700ff-165b-4cb6-8cc1-431218f3bb47 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:41.747127 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946700ff-165b-4cb6-8cc1-431218f3bb47 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:41.747399 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946700ff-165b-4cb6-8cc1-431218f3bb47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:41.748128 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946700ff-165b-4cb6-8cc1-431218f3bb47 None admin] RBAC: Adding query filter params (role.id=632e24cff8a04bd598fbbb3b41c62218, scope.project.id=3363e1213c7f49a4bccd9116d9d698d0, user.id=8989e5b5b6f94a8a9ad90965dd6374b1) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:37:41.748438 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946700ff-165b-4cb6-8cc1-431218f3bb47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:41.749905 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946700ff-165b-4cb6-8cc1-431218f3bb47 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:41.762807 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 103/208] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Sep 24 19:37:41 2022] GET /identity/v3/role_assignments?user.id=8989e5b5b6f94a8a9ad90965dd6374b1&scope.project.id=3363e1213c7f49a4bccd9116d9d698d0&role.id=632e24cff8a04bd598fbbb3b41c62218 => generated 608 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:42.079757 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e960cc-bc5b-4118-88c1-09e39e28266b None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:42.080258 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e960cc-bc5b-4118-88c1-09e39e28266b None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:42.081097 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e960cc-bc5b-4118-88c1-09e39e28266b None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:42.083811 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 106/209] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:37:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:37:42.091211 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc77484-2e25-4451-ab3f-e8376cb08987 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:42.092057 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc77484-2e25-4451-ab3f-e8376cb08987 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:42.092804 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc77484-2e25-4451-ab3f-e8376cb08987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:42.134375 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-bcc77484-2e25-4451-ab3f-e8376cb08987 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:37:42.136794 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-bcc77484-2e25-4451-ab3f-e8376cb08987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:37:42.202563 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:42.237532 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 104/210] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:37:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:37:42.543416 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e960cc-bc5b-4118-88c1-09e39e28266b None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:42.675628 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e960cc-bc5b-4118-88c1-09e39e28266b None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:42.689831 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e530d-5253-4f57-994b-f62201a715c8 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:42.690664 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e530d-5253-4f57-994b-f62201a715c8 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:42.691077 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e530d-5253-4f57-994b-f62201a715c8 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:42.692925 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 105/211] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:37:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:37:42.698540 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d5965-7d14-4fc3-b049-bf5d182652fc None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:42.699007 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d5965-7d14-4fc3-b049-bf5d182652fc None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:42.699460 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d5965-7d14-4fc3-b049-bf5d182652fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:42.718544 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d5e16-a408-4c83-9f44-82e34f799562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:42.719042 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-921d5965-7d14-4fc3-b049-bf5d182652fc None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:37:42.719242 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d5e16-a408-4c83-9f44-82e34f799562 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:42.719489 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d5e16-a408-4c83-9f44-82e34f799562 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:42.719762 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d5e16-a408-4c83-9f44-82e34f799562 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:42.721059 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-921d5965-7d14-4fc3-b049-bf5d182652fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:37:42.735937 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5d5e16-a408-4c83-9f44-82e34f799562 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:37:42.743484 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-4e5d5e16-a408-4c83-9f44-82e34f799562 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:37:42.743484 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:37:42.743484 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:37:42.743484 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:37:42.743484 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:37:42.743484 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:37:42.743484 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:37:42.743484 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:37:42.743484 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:37:42.743484 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:37:42.743484 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:37:42.743484 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:37:42.743484 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:37:42.743484 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:37:42.743484 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:37:42.743484 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:37:42.744372 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:37:42.744372 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:37:42.744372 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:37:42.744372 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:37:42.744372 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:37:42.744372 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:37:42.744372 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:37:42.744372 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:37:42.744372 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:37:42.744372 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:37:42.744372 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:37:42.744372 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:37:42.744372 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:37:42.744372 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:37:42.744372 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:37:42.744372 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:37:42.745155 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:37:42.745155 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:37:42.745155 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:37:42.745155 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:37:42.745155 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:37:42.745155 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:37:42.745155 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:37:42.745155 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:37:42.745155 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:37:42.745155 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:37:42.745155 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:37:42.745155 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:37:42.745155 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 107/212] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Sep 24 19:37:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:37:42.751392 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d5e16-a408-4c83-9f44-82e34f799562 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:42.813622 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 106/213] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:37:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:37:42.823201 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:42.894209 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d5e16-a408-4c83-9f44-82e34f799562 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:42.918176 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d628f-1d71-46e9-b2f7-0612dad330ce None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:42.918457 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d628f-1d71-46e9-b2f7-0612dad330ce None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:42.918736 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d628f-1d71-46e9-b2f7-0612dad330ce None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:42.920092 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 107/214] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:37:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:37:42.926383 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a42a2d-59c0-49a8-bed6-945a58a2481a None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:42.926619 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a42a2d-59c0-49a8-bed6-945a58a2481a None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:42.926894 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a42a2d-59c0-49a8-bed6-945a58a2481a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:42.938713 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2653b3b-94e2-4473-acd0-548feeb4ba6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:42.939710 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2653b3b-94e2-4473-acd0-548feeb4ba6e None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:42.940160 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2653b3b-94e2-4473-acd0-548feeb4ba6e None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:42.940599 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2653b3b-94e2-4473-acd0-548feeb4ba6e None admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:42.941437 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2653b3b-94e2-4473-acd0-548feeb4ba6e None admin] RBAC: Adding query filter params (name=member) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:37:42.942620 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2653b3b-94e2-4473-acd0-548feeb4ba6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:42.945374 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2653b3b-94e2-4473-acd0-548feeb4ba6e None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:42.948852 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-58a42a2d-59c0-49a8-bed6-945a58a2481a None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:37:42.950085 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-58a42a2d-59c0-49a8-bed6-945a58a2481a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:37:42.956613 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 108/215] 10.222.0.60 () {56 vars in 1101 bytes} [Sat Sep 24 19:37:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:42.963672 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2653b3b-94e2-4473-acd0-548feeb4ba6e None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:43.054969 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 108/216] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:37:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:37:43.056553 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11648332-bf7e-4fa4-b63a-ce881c5b929e None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:43.056908 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11648332-bf7e-4fa4-b63a-ce881c5b929e None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:43.057251 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11648332-bf7e-4fa4-b63a-ce881c5b929e None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:43.058892 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 109/217] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:37:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:37:43.064316 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562adc8b-3447-4ced-a541-0329536027ab None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:43.064546 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562adc8b-3447-4ced-a541-0329536027ab None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:43.064796 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562adc8b-3447-4ced-a541-0329536027ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:43.086078 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-562adc8b-3447-4ced-a541-0329536027ab None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:37:43.087309 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-562adc8b-3447-4ced-a541-0329536027ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:37:43.099496 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2653b3b-94e2-4473-acd0-548feeb4ba6e None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:43.102573 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:43.118757 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:43.139827 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73465019-c8a1-4a4b-aecd-fcf8bcab3667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:43.140461 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73465019-c8a1-4a4b-aecd-fcf8bcab3667 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:43.140741 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73465019-c8a1-4a4b-aecd-fcf8bcab3667 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:43.141009 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73465019-c8a1-4a4b-aecd-fcf8bcab3667 None admin] PATH_INFO: `/v3/users/ff358e7de33d49c7af888063fc19c9ac` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:43.156877 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73465019-c8a1-4a4b-aecd-fcf8bcab3667 None admin] RBAC: Authorizing `identity:get_user(user_id=ff358e7de33d49c7af888063fc19c9ac)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:43.158403 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73465019-c8a1-4a4b-aecd-fcf8bcab3667 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:43.165350 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 109/218] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Sep 24 19:37:42 2022] GET /identity/v3/users/ff358e7de33d49c7af888063fc19c9ac => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:37:43.165350 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73465019-c8a1-4a4b-aecd-fcf8bcab3667 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:43.165641 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 110/219] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:37:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 19:37:43.167251 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562adc8b-3447-4ced-a541-0329536027ab None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:43.295137 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73465019-c8a1-4a4b-aecd-fcf8bcab3667 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:43.298987 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562adc8b-3447-4ced-a541-0329536027ab None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:43.340284 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39f45b-062c-479d-a96c-9d21562314a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:43.340756 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39f45b-062c-479d-a96c-9d21562314a2 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:43.341037 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39f45b-062c-479d-a96c-9d21562314a2 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:43.341311 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39f45b-062c-479d-a96c-9d21562314a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:43.342503 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c2bce-2a9f-4006-b01f-edb348defd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:43.343367 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c2bce-2a9f-4006-b01f-edb348defd07 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:43.343811 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c2bce-2a9f-4006-b01f-edb348defd07 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:43.344270 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c2bce-2a9f-4006-b01f-edb348defd07 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:43.345586 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8c2bce-2a9f-4006-b01f-edb348defd07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:43.347224 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8c2bce-2a9f-4006-b01f-edb348defd07 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:43.349029 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 110/220] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:37:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:43.354101 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c2bce-2a9f-4006-b01f-edb348defd07 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:43.382345 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:43.384770 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:43.424753 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff39f45b-062c-479d-a96c-9d21562314a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:43.426309 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff39f45b-062c-479d-a96c-9d21562314a2 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:43.465761 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c2bce-2a9f-4006-b01f-edb348defd07 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:43.500001 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67cfec8-ded8-4bdb-861c-706d9d292048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:43.500642 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67cfec8-ded8-4bdb-861c-706d9d292048 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:43.500919 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67cfec8-ded8-4bdb-861c-706d9d292048 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:43.501188 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67cfec8-ded8-4bdb-861c-706d9d292048 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:43.513021 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67cfec8-ded8-4bdb-861c-706d9d292048 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:37:43.517921 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-a67cfec8-ded8-4bdb-861c-706d9d292048 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:37:43.517921 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:37:43.517921 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:37:43.517921 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:37:43.517921 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:37:43.517921 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:37:43.517921 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:37:43.517921 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:37:43.517921 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:37:43.517921 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:37:43.517921 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:37:43.517921 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:37:43.517921 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:37:43.517921 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:37:43.517921 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:37:43.517921 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:37:43.518787 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:37:43.518787 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:37:43.518787 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:37:43.518787 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:37:43.518787 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:37:43.518787 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:37:43.518787 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:37:43.518787 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:37:43.518787 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:37:43.518787 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:37:43.518787 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:37:43.518787 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:37:43.518787 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:37:43.518787 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:37:43.518787 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:37:43.518787 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:37:43.519629 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:37:43.519629 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:37:43.519629 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:37:43.519629 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:37:43.519629 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:37:43.519629 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:37:43.519629 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:37:43.519629 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:37:43.519629 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:37:43.519629 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:37:43.519629 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:37:43.519629 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:37:43.519629 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 111/221] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Sep 24 19:37:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:37:43.520277 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67cfec8-ded8-4bdb-861c-706d9d292048 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:43.545623 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 111/222] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Sep 24 19:37:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 24 19:37:43.546321 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39f45b-062c-479d-a96c-9d21562314a2 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:43.609292 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:43.617101 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:43.628611 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67cfec8-ded8-4bdb-861c-706d9d292048 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:43.648675 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39f45b-062c-479d-a96c-9d21562314a2 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:43.663780 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c48a69-fda2-4bcd-89d8-692db5c9079d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:43.664391 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c48a69-fda2-4bcd-89d8-692db5c9079d None admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:43.664670 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c48a69-fda2-4bcd-89d8-692db5c9079d None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:43.664951 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c48a69-fda2-4bcd-89d8-692db5c9079d None admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:43.665720 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c48a69-fda2-4bcd-89d8-692db5c9079d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:43.667186 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c48a69-fda2-4bcd-89d8-692db5c9079d None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:43.684788 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe2f3f-e378-4404-ba5b-a92c55d53b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:43.685428 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe2f3f-e378-4404-ba5b-a92c55d53b61 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:43.685738 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe2f3f-e378-4404-ba5b-a92c55d53b61 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:43.686010 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe2f3f-e378-4404-ba5b-a92c55d53b61 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:43.699447 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe2f3f-e378-4404-ba5b-a92c55d53b61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:37:43.702488 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-7abe2f3f-e378-4404-ba5b-a92c55d53b61 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:37:43.702488 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:37:43.702488 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:37:43.702488 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:37:43.702488 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:37:43.702488 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:37:43.702488 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:37:43.702488 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:37:43.702488 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:37:43.702488 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:37:43.702488 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:37:43.702488 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:37:43.702488 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:37:43.702488 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:37:43.702488 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:37:43.702488 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:37:43.703474 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:37:43.703474 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:37:43.703474 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:37:43.703474 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:37:43.703474 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:37:43.703474 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:37:43.703474 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:37:43.703474 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:37:43.703474 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:37:43.703474 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:37:43.703474 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:37:43.703474 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:37:43.703474 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:37:43.703474 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:37:43.703474 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:37:43.703474 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:37:43.704333 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:37:43.704333 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:37:43.704333 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:37:43.704333 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:37:43.704333 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:37:43.704333 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:37:43.704333 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:37:43.704333 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:37:43.704333 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:37:43.704333 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:37:43.704333 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:37:43.704333 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:37:43.704333 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 112/223] 10.222.0.60 () {56 vars in 1114 bytes} [Sat Sep 24 19:37:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:37:43.704957 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe2f3f-e378-4404-ba5b-a92c55d53b61 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:43.800249 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 112/224] 10.222.0.60 () {60 vars in 1132 bytes} [Sat Sep 24 19:37:43 2022] POST /identity/v3/users => generated 297 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:37:43.801195 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c48a69-fda2-4bcd-89d8-692db5c9079d None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:43.806456 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe2f3f-e378-4404-ba5b-a92c55d53b61 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:43.838011 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:43.850761 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526a6bd-633b-492b-976e-21c0c0df4ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:43.851905 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526a6bd-633b-492b-976e-21c0c0df4ad7 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:43.852184 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526a6bd-633b-492b-976e-21c0c0df4ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:43.852453 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526a6bd-633b-492b-976e-21c0c0df4ad7 None admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:43.853137 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c526a6bd-633b-492b-976e-21c0c0df4ad7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:37:43.853443 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c526a6bd-633b-492b-976e-21c0c0df4ad7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:43.854928 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c526a6bd-633b-492b-976e-21c0c0df4ad7 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:43.865073 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 113/225] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Sep 24 19:37:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:43.865625 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526a6bd-633b-492b-976e-21c0c0df4ad7 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:43.946654 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c48a69-fda2-4bcd-89d8-692db5c9079d None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:43.986289 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0070feb-269c-4b9d-8f9a-e20115777115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:43.986937 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0070feb-269c-4b9d-8f9a-e20115777115 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:43.987215 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0070feb-269c-4b9d-8f9a-e20115777115 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:43.987487 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0070feb-269c-4b9d-8f9a-e20115777115 None admin] PATH_INFO: `/v3/projects/a67dea7cdf8d4c61b2758c16712e9c38` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:43.988649 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0070feb-269c-4b9d-8f9a-e20115777115 None admin] RBAC: Authorizing `identity:get_project(project_id=a67dea7cdf8d4c61b2758c16712e9c38)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:43.990218 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0070feb-269c-4b9d-8f9a-e20115777115 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:43.992778 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 113/226] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Sep 24 19:37:43 2022] GET /identity/v3/projects/a67dea7cdf8d4c61b2758c16712e9c38 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:43.994120 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0070feb-269c-4b9d-8f9a-e20115777115 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:44.004554 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526a6bd-633b-492b-976e-21c0c0df4ad7 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:44.012710 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:44.059337 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dde98a-6437-419e-bdc3-8225dae8a259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:44.060501 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dde98a-6437-419e-bdc3-8225dae8a259 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:44.060946 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dde98a-6437-419e-bdc3-8225dae8a259 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:44.061386 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dde98a-6437-419e-bdc3-8225dae8a259 None admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:44.063013 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dde98a-6437-419e-bdc3-8225dae8a259 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:37:44.063013 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dde98a-6437-419e-bdc3-8225dae8a259 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:44.065176 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dde98a-6437-419e-bdc3-8225dae8a259 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:44.084284 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 114/227] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Sep 24 19:37:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:44.084284 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dde98a-6437-419e-bdc3-8225dae8a259 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:44.148835 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0070feb-269c-4b9d-8f9a-e20115777115 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:44.168491 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:44.193350 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abeb708-51b8-4214-9a05-4a8a9e296c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:44.194613 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abeb708-51b8-4214-9a05-4a8a9e296c0f None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:44.194890 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abeb708-51b8-4214-9a05-4a8a9e296c0f None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:44.195161 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abeb708-51b8-4214-9a05-4a8a9e296c0f None admin] PATH_INFO: `/v3/users/88977caac45542988ea6997003268bcc` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:44.197285 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abeb708-51b8-4214-9a05-4a8a9e296c0f None admin] RBAC: Authorizing `identity:get_user(user_id=88977caac45542988ea6997003268bcc)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:44.203044 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abeb708-51b8-4214-9a05-4a8a9e296c0f None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:44.204808 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 114/228] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Sep 24 19:37:43 2022] GET /identity/v3/users/88977caac45542988ea6997003268bcc => generated 283 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:44.205731 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abeb708-51b8-4214-9a05-4a8a9e296c0f None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:44.245817 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dde98a-6437-419e-bdc3-8225dae8a259 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:44.289831 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eac75b-3c38-4711-bc91-2237a12d1bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:44.290736 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eac75b-3c38-4711-bc91-2237a12d1bfe None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:44.291015 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eac75b-3c38-4711-bc91-2237a12d1bfe None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:44.291285 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eac75b-3c38-4711-bc91-2237a12d1bfe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:44.292190 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eac75b-3c38-4711-bc91-2237a12d1bfe None admin] RBAC: Adding query filter params (role.id=3dfa1e29c6a0404388d256728d66e4a1, scope.project.id=a67dea7cdf8d4c61b2758c16712e9c38, user.id=ff358e7de33d49c7af888063fc19c9ac) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:37:44.292499 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eac75b-3c38-4711-bc91-2237a12d1bfe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:44.294831 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eac75b-3c38-4711-bc91-2237a12d1bfe None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:44.302594 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 115/229] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Sep 24 19:37:44 2022] GET /identity/v3/role_assignments?user.id=ff358e7de33d49c7af888063fc19c9ac&scope.project.id=a67dea7cdf8d4c61b2758c16712e9c38&role.id=3dfa1e29c6a0404388d256728d66e4a1 => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:44.304290 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eac75b-3c38-4711-bc91-2237a12d1bfe None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:44.305809 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:44.330652 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abeb708-51b8-4214-9a05-4a8a9e296c0f None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:44.379754 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13500a8-cd23-4a8b-b9e0-9b223645b190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:44.380822 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13500a8-cd23-4a8b-b9e0-9b223645b190 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:44.381215 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13500a8-cd23-4a8b-b9e0-9b223645b190 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:44.381618 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13500a8-cd23-4a8b-b9e0-9b223645b190 None admin] PATH_INFO: `/v3/users/88977caac45542988ea6997003268bcc` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:44.383439 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13500a8-cd23-4a8b-b9e0-9b223645b190 None admin] RBAC: Authorizing `identity:get_user(user_id=88977caac45542988ea6997003268bcc)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:44.385162 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13500a8-cd23-4a8b-b9e0-9b223645b190 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:44.387313 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 115/230] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Sep 24 19:37:44 2022] GET /identity/v3/users/88977caac45542988ea6997003268bcc => generated 283 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:44.393839 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13500a8-cd23-4a8b-b9e0-9b223645b190 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:44.450679 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eac75b-3c38-4711-bc91-2237a12d1bfe None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:44.468683 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:44.495190 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabfb45e-6be2-46c1-a885-790e4133116b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:44.495587 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabfb45e-6be2-46c1-a885-790e4133116b None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:44.495863 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabfb45e-6be2-46c1-a885-790e4133116b None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:44.496159 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabfb45e-6be2-46c1-a885-790e4133116b None admin] PATH_INFO: `/v3/projects/a67dea7cdf8d4c61b2758c16712e9c38` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:44.498401 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabfb45e-6be2-46c1-a885-790e4133116b None admin] RBAC: Authorizing `identity:get_project(project_id=a67dea7cdf8d4c61b2758c16712e9c38)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:44.499861 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabfb45e-6be2-46c1-a885-790e4133116b None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:44.501733 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 116/231] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Sep 24 19:37:44 2022] GET /identity/v3/projects/a67dea7cdf8d4c61b2758c16712e9c38 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:44.508983 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabfb45e-6be2-46c1-a885-790e4133116b None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:44.599664 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13500a8-cd23-4a8b-b9e0-9b223645b190 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:44.717587 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d591c3a-a920-47dc-beb9-2f6d1d8cf2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:44.718586 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d591c3a-a920-47dc-beb9-2f6d1d8cf2bf None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:44.719052 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d591c3a-a920-47dc-beb9-2f6d1d8cf2bf None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:44.719514 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d591c3a-a920-47dc-beb9-2f6d1d8cf2bf None admin] PATH_INFO: `/v3/projects/a67dea7cdf8d4c61b2758c16712e9c38` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:44.722117 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d591c3a-a920-47dc-beb9-2f6d1d8cf2bf None admin] RBAC: Authorizing `identity:get_project(project_id=a67dea7cdf8d4c61b2758c16712e9c38)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:44.724288 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d591c3a-a920-47dc-beb9-2f6d1d8cf2bf None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:44.727979 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 116/232] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Sep 24 19:37:44 2022] GET /identity/v3/projects/a67dea7cdf8d4c61b2758c16712e9c38 => generated 302 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:44.737397 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d591c3a-a920-47dc-beb9-2f6d1d8cf2bf None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:44.745747 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabfb45e-6be2-46c1-a885-790e4133116b None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:44.793482 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:44.811049 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbca0e1-2dc2-455d-a329-82c6580fda9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:44.812583 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbca0e1-2dc2-455d-a329-82c6580fda9e None admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:44.813376 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbca0e1-2dc2-455d-a329-82c6580fda9e None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:44.814582 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbca0e1-2dc2-455d-a329-82c6580fda9e None admin] PATH_INFO: `/v3/projects/a67dea7cdf8d4c61b2758c16712e9c38/users/88977caac45542988ea6997003268bcc/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:44.818744 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbca0e1-2dc2-455d-a329-82c6580fda9e None admin] RBAC: Authorizing `identity:create_grant(project_id=a67dea7cdf8d4c61b2758c16712e9c38, user_id=88977caac45542988ea6997003268bcc, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:44.825223 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbca0e1-2dc2-455d-a329-82c6580fda9e None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:44.903634 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 117/233] 10.222.0.60 () {58 vars in 1439 bytes} [Sat Sep 24 19:37:44 2022] PUT /identity/v3/projects/a67dea7cdf8d4c61b2758c16712e9c38/users/88977caac45542988ea6997003268bcc/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:37:45.006484 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d591c3a-a920-47dc-beb9-2f6d1d8cf2bf None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:45.087959 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc69d7-267f-4f68-9f2f-3c921ab97449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:45.089370 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc69d7-267f-4f68-9f2f-3c921ab97449 None admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:45.090064 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc69d7-267f-4f68-9f2f-3c921ab97449 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:45.090722 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc69d7-267f-4f68-9f2f-3c921ab97449 None admin] PATH_INFO: `/v3/projects/a67dea7cdf8d4c61b2758c16712e9c38/users/88977caac45542988ea6997003268bcc/roles/dd695228990e4288afe29e3cefb75823` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:45.097268 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dc69d7-267f-4f68-9f2f-3c921ab97449 None admin] RBAC: Authorizing `identity:create_grant(project_id=a67dea7cdf8d4c61b2758c16712e9c38, user_id=88977caac45542988ea6997003268bcc, role_id=dd695228990e4288afe29e3cefb75823)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:45.100641 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dc69d7-267f-4f68-9f2f-3c921ab97449 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:45.296635 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 117/234] 10.222.0.60 () {58 vars in 1439 bytes} [Sat Sep 24 19:37:44 2022] PUT /identity/v3/projects/a67dea7cdf8d4c61b2758c16712e9c38/users/88977caac45542988ea6997003268bcc/roles/dd695228990e4288afe29e3cefb75823 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:37:46.477619 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c7d448-c5ac-49e0-959f-fc1cf7db62c9 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:46.478663 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c7d448-c5ac-49e0-959f-fc1cf7db62c9 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:46.479163 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c7d448-c5ac-49e0-959f-fc1cf7db62c9 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:46.480766 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 118/235] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:37:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:37:46.486672 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d280fae-87e8-41c9-a8ef-d2d9f47fef61 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:46.487573 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d280fae-87e8-41c9-a8ef-d2d9f47fef61 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:46.488067 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d280fae-87e8-41c9-a8ef-d2d9f47fef61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:46.518132 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-7d280fae-87e8-41c9-a8ef-d2d9f47fef61 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:37:46.519670 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-7d280fae-87e8-41c9-a8ef-d2d9f47fef61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:37:46.619309 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 118/236] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:37:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:37:46.697205 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52031468-2c47-490e-8921-1d8e4e64b3c6 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:46.697482 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52031468-2c47-490e-8921-1d8e4e64b3c6 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:46.697775 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52031468-2c47-490e-8921-1d8e4e64b3c6 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:46.699334 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 119/237] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:37:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:37:46.708245 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2decc2bd-6aa2-4acf-8879-503b89d222f9 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:46.708245 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2decc2bd-6aa2-4acf-8879-503b89d222f9 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:46.708245 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2decc2bd-6aa2-4acf-8879-503b89d222f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:46.720542 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:46.727336 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-2decc2bd-6aa2-4acf-8879-503b89d222f9 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:37:46.733365 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-2decc2bd-6aa2-4acf-8879-503b89d222f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:37:46.803893 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 119/238] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:37:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:37:47.030140 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52031468-2c47-490e-8921-1d8e4e64b3c6 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:47.086062 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:47.162383 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52031468-2c47-490e-8921-1d8e4e64b3c6 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:47.170769 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2decc2bd-6aa2-4acf-8879-503b89d222f9 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:47.219405 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba6c4eb-5dfa-4b39-a523-ace972166f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:47.221344 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6c4eb-5dfa-4b39-a523-ace972166f4f None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:47.223065 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6c4eb-5dfa-4b39-a523-ace972166f4f None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:47.223552 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6c4eb-5dfa-4b39-a523-ace972166f4f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:47.252098 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba6c4eb-5dfa-4b39-a523-ace972166f4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:37:47.260746 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-8ba6c4eb-5dfa-4b39-a523-ace972166f4f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 19:37:47.260746 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:37:47.260746 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:37:47.260746 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:37:47.260746 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:37:47.260746 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:37:47.260746 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:37:47.260746 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:37:47.260746 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:37:47.260746 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:37:47.260746 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:37:47.260746 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:37:47.260746 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:37:47.260746 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:37:47.260746 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:37:47.260746 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:37:47.261730 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:37:47.261730 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:37:47.261730 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:37:47.261730 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:37:47.261730 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:37:47.261730 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:37:47.261730 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:37:47.261730 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:37:47.261730 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:37:47.261730 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:37:47.261730 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:37:47.261730 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:37:47.261730 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:37:47.261730 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:37:47.261730 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:37:47.261730 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:37:47.262545 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:37:47.262545 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:37:47.262545 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:37:47.262545 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:37:47.262545 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:37:47.262545 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:37:47.262545 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:37:47.262545 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:37:47.262545 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:37:47.262545 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:37:47.262545 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 19:37:47.262545 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:37:47.265134 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 120/239] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Sep 24 19:37:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:37:47.272083 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba6c4eb-5dfa-4b39-a523-ace972166f4f None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:47.400497 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2decc2bd-6aa2-4acf-8879-503b89d222f9 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:47.465431 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:47.471748 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba6c4eb-5dfa-4b39-a523-ace972166f4f None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:47.511478 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501fd3c6-590b-44e0-b511-1f75f3140c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:47.512030 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501fd3c6-590b-44e0-b511-1f75f3140c88 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:47.512483 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501fd3c6-590b-44e0-b511-1f75f3140c88 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:47.512587 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501fd3c6-590b-44e0-b511-1f75f3140c88 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:47.513854 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501fd3c6-590b-44e0-b511-1f75f3140c88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:47.521541 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501fd3c6-590b-44e0-b511-1f75f3140c88 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:47.521541 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 120/240] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:37:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:47.525897 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501fd3c6-590b-44e0-b511-1f75f3140c88 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:47.531929 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:47.533264 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89097b9-c3ac-45e3-890c-6bbd7033d91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:47.533950 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89097b9-c3ac-45e3-890c-6bbd7033d91c None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:47.534234 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89097b9-c3ac-45e3-890c-6bbd7033d91c None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:47.534508 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89097b9-c3ac-45e3-890c-6bbd7033d91c None admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:47.535212 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89097b9-c3ac-45e3-890c-6bbd7033d91c None admin] RBAC: Adding query filter params (name=reader) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:37:47.535515 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89097b9-c3ac-45e3-890c-6bbd7033d91c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:47.536957 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89097b9-c3ac-45e3-890c-6bbd7033d91c None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:47.562934 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 121/241] 10.222.0.60 () {56 vars in 1101 bytes} [Sat Sep 24 19:37:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:37:47.565817 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89097b9-c3ac-45e3-890c-6bbd7033d91c None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:47.710488 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89097b9-c3ac-45e3-890c-6bbd7033d91c None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:47.711827 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501fd3c6-590b-44e0-b511-1f75f3140c88 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:47.753598 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb85dd6-bd82-465b-9251-94f01fb33bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:47.754431 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb85dd6-bd82-465b-9251-94f01fb33bee None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:47.754800 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb85dd6-bd82-465b-9251-94f01fb33bee None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:47.755232 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb85dd6-bd82-465b-9251-94f01fb33bee None admin] PATH_INFO: `/v3/users/b4fa40a0e7614a98904ddea68693d426` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:47.761548 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af3eec-d080-46d5-8cbd-0f065b5e6f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:47.762196 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af3eec-d080-46d5-8cbd-0f065b5e6f52 None admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:47.762473 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af3eec-d080-46d5-8cbd-0f065b5e6f52 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:47.762741 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af3eec-d080-46d5-8cbd-0f065b5e6f52 None admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:47.763448 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9af3eec-d080-46d5-8cbd-0f065b5e6f52 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:47.764958 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9af3eec-d080-46d5-8cbd-0f065b5e6f52 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:47.773047 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb85dd6-bd82-465b-9251-94f01fb33bee None admin] RBAC: Authorizing `identity:get_user(user_id=b4fa40a0e7614a98904ddea68693d426)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:47.775869 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb85dd6-bd82-465b-9251-94f01fb33bee None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:47.778086 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 122/242] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Sep 24 19:37:47 2022] GET /identity/v3/users/b4fa40a0e7614a98904ddea68693d426 => generated 297 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:47.786029 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c950e41-6963-4d34-99da-ba1ba465f962 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:47.786472 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c950e41-6963-4d34-99da-ba1ba465f962 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:47.786817 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c950e41-6963-4d34-99da-ba1ba465f962 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:47.789241 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 123/243] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:37:47 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:37:47.793792 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c950e41-6963-4d34-99da-ba1ba465f962 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:47.817589 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:47.858421 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 121/244] 10.222.0.60 () {60 vars in 1132 bytes} [Sat Sep 24 19:37:47 2022] POST /identity/v3/users => generated 293 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:37:47.860876 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b8b06-ad1e-4b59-82a2-223e1407e0e7 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:47.861337 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b8b06-ad1e-4b59-82a2-223e1407e0e7 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:47.861820 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b8b06-ad1e-4b59-82a2-223e1407e0e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:47.889966 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-931b8b06-ad1e-4b59-82a2-223e1407e0e7 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:37:47.892716 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-931b8b06-ad1e-4b59-82a2-223e1407e0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:37:47.931069 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c950e41-6963-4d34-99da-ba1ba465f962 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:47.979313 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031a4c5-fa78-4f35-b822-f63ce3d06ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:47.979920 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031a4c5-fa78-4f35-b822-f63ce3d06ea0 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:47.980211 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031a4c5-fa78-4f35-b822-f63ce3d06ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:47.980475 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031a4c5-fa78-4f35-b822-f63ce3d06ea0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:47.989075 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:48.003761 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 122/245] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:37:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:37:48.011249 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f23303-99f2-4fc4-84cd-e860381352f6 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:48.011851 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f23303-99f2-4fc4-84cd-e860381352f6 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:48.012370 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f23303-99f2-4fc4-84cd-e860381352f6 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:48.014043 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 123/246] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:37:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:37:48.020007 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6219b-b4c0-4d7b-bc9b-66bc27df5a13 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:48.020612 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6219b-b4c0-4d7b-bc9b-66bc27df5a13 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:48.021124 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6219b-b4c0-4d7b-bc9b-66bc27df5a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:48.050811 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-a1d6219b-b4c0-4d7b-bc9b-66bc27df5a13 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:37:48.052390 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-a1d6219b-b4c0-4d7b-bc9b-66bc27df5a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:37:48.086471 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1031a4c5-fa78-4f35-b822-f63ce3d06ea0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:48.088014 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1031a4c5-fa78-4f35-b822-f63ce3d06ea0 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:48.114780 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:48.154812 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 124/247] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:37:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:37:48.228544 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 124/248] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Sep 24 19:37:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:37:48.235244 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d6219b-b4c0-4d7b-bc9b-66bc27df5a13 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:48.310480 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17413f8a-b30c-4c40-b972-1724b560bdca None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:48.310794 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17413f8a-b30c-4c40-b972-1724b560bdca None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:48.311025 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17413f8a-b30c-4c40-b972-1724b560bdca None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:48.315823 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 125/249] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:37:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:37:48.315823 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17413f8a-b30c-4c40-b972-1724b560bdca None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:48.355242 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d6219b-b4c0-4d7b-bc9b-66bc27df5a13 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:48.377122 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:48.394361 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994cf406-5138-4b52-a000-ece5c80903e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:48.395356 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994cf406-5138-4b52-a000-ece5c80903e4 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:48.397751 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994cf406-5138-4b52-a000-ece5c80903e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:48.397751 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994cf406-5138-4b52-a000-ece5c80903e4 None admin] PATH_INFO: `/v3/projects/a67dea7cdf8d4c61b2758c16712e9c38` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:48.397975 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994cf406-5138-4b52-a000-ece5c80903e4 None admin] RBAC: Authorizing `identity:get_project(project_id=a67dea7cdf8d4c61b2758c16712e9c38)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:48.399501 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994cf406-5138-4b52-a000-ece5c80903e4 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:48.401617 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 125/250] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Sep 24 19:37:48 2022] GET /identity/v3/projects/a67dea7cdf8d4c61b2758c16712e9c38 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:37:48.402599 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e861fc3a-44d4-4668-933a-449faeaab522 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:48.402886 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e861fc3a-44d4-4668-933a-449faeaab522 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:48.404548 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e861fc3a-44d4-4668-933a-449faeaab522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:48.427339 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-e861fc3a-44d4-4668-933a-449faeaab522 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:37:48.430282 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-e861fc3a-44d4-4668-933a-449faeaab522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:37:48.472566 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17413f8a-b30c-4c40-b972-1724b560bdca None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:48.498073 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:48.515023 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fbda56-9725-4646-a7ea-9a97fa82d86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:48.515660 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fbda56-9725-4646-a7ea-9a97fa82d86d None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:48.515936 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fbda56-9725-4646-a7ea-9a97fa82d86d None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:48.516206 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fbda56-9725-4646-a7ea-9a97fa82d86d None admin] PATH_INFO: `/v3/roles/member` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:48.529847 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fbda56-9725-4646-a7ea-9a97fa82d86d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:37:48.535737 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-f8fbda56-9725-4646-a7ea-9a97fa82d86d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:37:48.535737 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:37:48.535737 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:37:48.535737 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:37:48.535737 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:37:48.535737 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:37:48.535737 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:37:48.535737 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:37:48.535737 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:37:48.535737 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:37:48.535737 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:37:48.535737 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:37:48.535737 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:37:48.535737 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:37:48.535737 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:37:48.535737 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:37:48.537073 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:37:48.537073 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:37:48.537073 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:37:48.537073 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:37:48.537073 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:37:48.537073 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:37:48.537073 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:37:48.537073 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:37:48.537073 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:37:48.537073 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:37:48.537073 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:37:48.537073 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:37:48.537073 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:37:48.537073 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:37:48.537073 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:37:48.537073 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:37:48.538443 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:37:48.538443 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:37:48.538443 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:37:48.538443 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:37:48.538443 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:37:48.538443 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:37:48.538443 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:37:48.538443 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:37:48.538443 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:37:48.538443 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:37:48.538443 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:37:48.538443 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:37:48.541246 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 126/251] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:37:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:37:48.541820 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 126/252] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Sep 24 19:37:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:37:48.542748 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fbda56-9725-4646-a7ea-9a97fa82d86d None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:48.542912 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e861fc3a-44d4-4668-933a-449faeaab522 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:48.660464 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e861fc3a-44d4-4668-933a-449faeaab522 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:48.683675 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:48.707963 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa52d05-33fa-4259-a2cd-6ba3fdd2a099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:48.708826 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa52d05-33fa-4259-a2cd-6ba3fdd2a099 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:48.710083 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa52d05-33fa-4259-a2cd-6ba3fdd2a099 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:48.710719 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa52d05-33fa-4259-a2cd-6ba3fdd2a099 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:48.711605 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa52d05-33fa-4259-a2cd-6ba3fdd2a099 None admin] RBAC: Adding query filter params (role.id=632e24cff8a04bd598fbbb3b41c62218, scope.project.id=a67dea7cdf8d4c61b2758c16712e9c38, user.id=b4fa40a0e7614a98904ddea68693d426) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:37:48.712082 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa52d05-33fa-4259-a2cd-6ba3fdd2a099 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:48.713682 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa52d05-33fa-4259-a2cd-6ba3fdd2a099 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:48.720443 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 127/253] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Sep 24 19:37:48 2022] GET /identity/v3/role_assignments?user.id=b4fa40a0e7614a98904ddea68693d426&scope.project.id=a67dea7cdf8d4c61b2758c16712e9c38&role.id=632e24cff8a04bd598fbbb3b41c62218 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:48.721589 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa52d05-33fa-4259-a2cd-6ba3fdd2a099 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:48.759957 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fbda56-9725-4646-a7ea-9a97fa82d86d None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:48.839918 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa52d05-33fa-4259-a2cd-6ba3fdd2a099 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:48.878258 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5664a86-1640-49e8-a4da-1e6b106c6373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:48.878958 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5664a86-1640-49e8-a4da-1e6b106c6373 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:48.879243 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5664a86-1640-49e8-a4da-1e6b106c6373 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:48.879505 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5664a86-1640-49e8-a4da-1e6b106c6373 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:48.880347 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55185eed-0a9b-4532-a5de-03b093fb6628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:48.881213 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55185eed-0a9b-4532-a5de-03b093fb6628 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:48.881712 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55185eed-0a9b-4532-a5de-03b093fb6628 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:48.882279 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55185eed-0a9b-4532-a5de-03b093fb6628 None admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:48.883165 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55185eed-0a9b-4532-a5de-03b093fb6628 None admin] RBAC: Adding query filter params (name=member) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:37:48.883856 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55185eed-0a9b-4532-a5de-03b093fb6628 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:48.885429 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55185eed-0a9b-4532-a5de-03b093fb6628 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:48.895151 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 128/254] 10.222.0.60 () {56 vars in 1101 bytes} [Sat Sep 24 19:37:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:48.902833 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55185eed-0a9b-4532-a5de-03b093fb6628 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:48.915927 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5664a86-1640-49e8-a4da-1e6b106c6373 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:37:48.921622 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-f5664a86-1640-49e8-a4da-1e6b106c6373 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:37:48.921622 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:37:48.921622 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:37:48.921622 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:37:48.921622 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:37:48.921622 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:37:48.921622 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:37:48.921622 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:37:48.921622 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:37:48.921622 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:37:48.921622 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:37:48.921622 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:37:48.921622 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:37:48.921622 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:37:48.921622 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:37:48.921622 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:37:48.922593 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:37:48.922593 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:37:48.922593 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:37:48.922593 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:37:48.922593 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:37:48.922593 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:37:48.922593 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:37:48.922593 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:37:48.922593 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:37:48.922593 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:37:48.922593 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:37:48.922593 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:37:48.922593 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:37:48.922593 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:37:48.922593 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:37:48.922593 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:37:48.923406 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:37:48.923406 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:37:48.923406 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:37:48.923406 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:37:48.923406 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:37:48.923406 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:37:48.923406 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:37:48.923406 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:37:48.923406 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:37:48.923406 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:37:48.923406 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:37:48.923406 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:37:48.923406 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 127/255] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Sep 24 19:37:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:37:48.931644 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5664a86-1640-49e8-a4da-1e6b106c6373 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:48.994299 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:49.057605 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:49.094329 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55185eed-0a9b-4532-a5de-03b093fb6628 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:49.111650 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5664a86-1640-49e8-a4da-1e6b106c6373 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:49.153540 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe97a4-5924-4610-b3f9-d30fe29b27bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:49.154741 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe97a4-5924-4610-b3f9-d30fe29b27bc None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:49.155243 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe97a4-5924-4610-b3f9-d30fe29b27bc None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:49.155705 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe97a4-5924-4610-b3f9-d30fe29b27bc None admin] PATH_INFO: `/v3/users/ff358e7de33d49c7af888063fc19c9ac` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:49.157096 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe97a4-5924-4610-b3f9-d30fe29b27bc None admin] RBAC: Authorizing `identity:get_user(user_id=ff358e7de33d49c7af888063fc19c9ac)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:49.157714 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a6d89-8b07-47f0-857d-c521071e29e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:49.158335 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a6d89-8b07-47f0-857d-c521071e29e3 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:49.158614 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a6d89-8b07-47f0-857d-c521071e29e3 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:49.158883 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a6d89-8b07-47f0-857d-c521071e29e3 None admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:49.159555 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020a6d89-8b07-47f0-857d-c521071e29e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:37:49.159858 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020a6d89-8b07-47f0-857d-c521071e29e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:49.160146 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe97a4-5924-4610-b3f9-d30fe29b27bc None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:49.161242 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020a6d89-8b07-47f0-857d-c521071e29e3 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:49.162286 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 129/256] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Sep 24 19:37:48 2022] GET /identity/v3/users/ff358e7de33d49c7af888063fc19c9ac => generated 297 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:37:49.164416 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe97a4-5924-4610-b3f9-d30fe29b27bc None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:49.187228 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 128/257] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Sep 24 19:37:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:49.188584 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a6d89-8b07-47f0-857d-c521071e29e3 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:49.348574 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe97a4-5924-4610-b3f9-d30fe29b27bc None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:49.374932 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:49.411865 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a6d89-8b07-47f0-857d-c521071e29e3 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:49.413099 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0513a38b-4c18-43be-9f6f-9b3245d863d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:49.413793 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:49.414213 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513a38b-4c18-43be-9f6f-9b3245d863d9 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:49.414724 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513a38b-4c18-43be-9f6f-9b3245d863d9 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:49.415282 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513a38b-4c18-43be-9f6f-9b3245d863d9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:49.428030 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0513a38b-4c18-43be-9f6f-9b3245d863d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:37:49.434853 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-0513a38b-4c18-43be-9f6f-9b3245d863d9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:37:49.434853 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:37:49.434853 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:37:49.434853 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:37:49.434853 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:37:49.434853 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:37:49.434853 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:37:49.434853 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:37:49.434853 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:37:49.434853 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:37:49.434853 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:37:49.434853 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:37:49.434853 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:37:49.434853 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:37:49.434853 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:37:49.434853 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:37:49.435840 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:37:49.435840 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:37:49.435840 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:37:49.435840 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:37:49.435840 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:37:49.435840 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:37:49.435840 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:37:49.435840 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:37:49.435840 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:37:49.435840 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:37:49.435840 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:37:49.435840 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:37:49.435840 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:37:49.435840 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:37:49.435840 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:37:49.435840 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:37:49.436620 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:37:49.436620 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:37:49.436620 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:37:49.436620 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:37:49.436620 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:37:49.436620 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:37:49.436620 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:37:49.436620 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:37:49.436620 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:37:49.436620 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:37:49.436620 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:37:49.436620 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:37:49.439100 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 130/258] 10.222.0.60 () {56 vars in 1114 bytes} [Sat Sep 24 19:37:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:37:49.440283 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0513a38b-4c18-43be-9f6f-9b3245d863d9 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:49.487349 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11128fb7-a34c-429a-9ad3-9e33fb0ba594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:49.489543 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11128fb7-a34c-429a-9ad3-9e33fb0ba594 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:49.489972 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11128fb7-a34c-429a-9ad3-9e33fb0ba594 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:49.490408 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11128fb7-a34c-429a-9ad3-9e33fb0ba594 None admin] PATH_INFO: `/v3/projects/a67dea7cdf8d4c61b2758c16712e9c38` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:49.492544 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11128fb7-a34c-429a-9ad3-9e33fb0ba594 None admin] RBAC: Authorizing `identity:get_project(project_id=a67dea7cdf8d4c61b2758c16712e9c38)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:49.494319 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11128fb7-a34c-429a-9ad3-9e33fb0ba594 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:49.496389 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 129/259] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Sep 24 19:37:49 2022] GET /identity/v3/projects/a67dea7cdf8d4c61b2758c16712e9c38 => generated 302 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:49.497606 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11128fb7-a34c-429a-9ad3-9e33fb0ba594 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:49.644093 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0513a38b-4c18-43be-9f6f-9b3245d863d9 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:49.681928 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11128fb7-a34c-429a-9ad3-9e33fb0ba594 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:49.712533 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8b6424-1c20-4627-ae6e-38003585631a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:49.713177 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b6424-1c20-4627-ae6e-38003585631a None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:49.713450 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b6424-1c20-4627-ae6e-38003585631a None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:49.713743 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b6424-1c20-4627-ae6e-38003585631a None admin] PATH_INFO: `/v3/users/88977caac45542988ea6997003268bcc` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:49.717397 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8b6424-1c20-4627-ae6e-38003585631a None admin] RBAC: Authorizing `identity:get_user(user_id=88977caac45542988ea6997003268bcc)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:49.722073 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8b6424-1c20-4627-ae6e-38003585631a None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:49.723767 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 131/260] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Sep 24 19:37:49 2022] GET /identity/v3/users/88977caac45542988ea6997003268bcc => generated 283 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:49.724517 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8b6424-1c20-4627-ae6e-38003585631a None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:49.754571 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188669aa-c22f-4a95-a4ec-0a8bfd91a9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:49.755309 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188669aa-c22f-4a95-a4ec-0a8bfd91a9ae None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:49.755686 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188669aa-c22f-4a95-a4ec-0a8bfd91a9ae None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:49.756134 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188669aa-c22f-4a95-a4ec-0a8bfd91a9ae None admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:49.759344 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188669aa-c22f-4a95-a4ec-0a8bfd91a9ae None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:37:49.759703 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188669aa-c22f-4a95-a4ec-0a8bfd91a9ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:49.761140 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188669aa-c22f-4a95-a4ec-0a8bfd91a9ae None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:49.778406 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 130/261] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Sep 24 19:37:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:49.779264 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188669aa-c22f-4a95-a4ec-0a8bfd91a9ae None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:49.808392 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:49.828923 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:49.922623 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8b6424-1c20-4627-ae6e-38003585631a None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:49.952105 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188669aa-c22f-4a95-a4ec-0a8bfd91a9ae None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:49.961864 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff33e7-a49b-4692-9bd8-385f1174d2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:49.962929 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff33e7-a49b-4692-9bd8-385f1174d2aa None admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:49.963402 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff33e7-a49b-4692-9bd8-385f1174d2aa None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:49.963831 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff33e7-a49b-4692-9bd8-385f1174d2aa None admin] PATH_INFO: `/v3/projects/a67dea7cdf8d4c61b2758c16712e9c38/users/ff358e7de33d49c7af888063fc19c9ac/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:49.966033 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ff33e7-a49b-4692-9bd8-385f1174d2aa None admin] RBAC: Authorizing `identity:create_grant(project_id=a67dea7cdf8d4c61b2758c16712e9c38, user_id=ff358e7de33d49c7af888063fc19c9ac, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:49.968040 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ff33e7-a49b-4692-9bd8-385f1174d2aa None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:50.040891 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 132/262] 10.222.0.60 () {58 vars in 1439 bytes} [Sat Sep 24 19:37:49 2022] PUT /identity/v3/projects/a67dea7cdf8d4c61b2758c16712e9c38/users/ff358e7de33d49c7af888063fc19c9ac/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:37:50.042260 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff33e7-a49b-4692-9bd8-385f1174d2aa None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:50.072312 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c2529f-799d-4d76-96ff-08e44f629d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:50.072934 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2529f-799d-4d76-96ff-08e44f629d15 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:50.073210 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2529f-799d-4d76-96ff-08e44f629d15 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:50.073477 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2529f-799d-4d76-96ff-08e44f629d15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:50.174115 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:50.182451 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff33e7-a49b-4692-9bd8-385f1174d2aa None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:50.202269 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c2529f-799d-4d76-96ff-08e44f629d15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:50.203782 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c2529f-799d-4d76-96ff-08e44f629d15 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:50.242908 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:50.259986 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df167e7-0e9b-435f-a940-275bb5566b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:50.260643 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df167e7-0e9b-435f-a940-275bb5566b88 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:50.260925 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df167e7-0e9b-435f-a940-275bb5566b88 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:50.261197 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df167e7-0e9b-435f-a940-275bb5566b88 None admin] PATH_INFO: `/v3/users/88977caac45542988ea6997003268bcc` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:50.263049 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df167e7-0e9b-435f-a940-275bb5566b88 None admin] RBAC: Authorizing `identity:get_user(user_id=88977caac45542988ea6997003268bcc)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:50.264607 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df167e7-0e9b-435f-a940-275bb5566b88 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:50.270531 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 133/263] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Sep 24 19:37:50 2022] GET /identity/v3/users/88977caac45542988ea6997003268bcc => generated 283 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:50.272517 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df167e7-0e9b-435f-a940-275bb5566b88 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:50.322339 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 131/264] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Sep 24 19:37:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:37:50.328030 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c2529f-799d-4d76-96ff-08e44f629d15 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:50.435726 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c2529f-799d-4d76-96ff-08e44f629d15 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:50.472760 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:50.477372 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd8aea-8989-4d84-a77f-4b5a0dc64055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:50.478165 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd8aea-8989-4d84-a77f-4b5a0dc64055 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:50.478454 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd8aea-8989-4d84-a77f-4b5a0dc64055 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:50.478733 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd8aea-8989-4d84-a77f-4b5a0dc64055 None admin] PATH_INFO: `/v3/projects/a67dea7cdf8d4c61b2758c16712e9c38` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:50.480435 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bd8aea-8989-4d84-a77f-4b5a0dc64055 None admin] RBAC: Authorizing `identity:get_project(project_id=a67dea7cdf8d4c61b2758c16712e9c38)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:50.483182 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bd8aea-8989-4d84-a77f-4b5a0dc64055 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:50.489935 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 132/265] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Sep 24 19:37:50 2022] GET /identity/v3/projects/a67dea7cdf8d4c61b2758c16712e9c38 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:37:50.493400 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd8aea-8989-4d84-a77f-4b5a0dc64055 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:50.504562 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df167e7-0e9b-435f-a940-275bb5566b88 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:50.591867 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3368bdd9-6d9f-4a5d-95da-031ddbfc0fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:50.592545 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368bdd9-6d9f-4a5d-95da-031ddbfc0fb5 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:50.592832 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368bdd9-6d9f-4a5d-95da-031ddbfc0fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:50.593108 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368bdd9-6d9f-4a5d-95da-031ddbfc0fb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:50.605650 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd8aea-8989-4d84-a77f-4b5a0dc64055 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:50.642983 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e1afc-12cb-4bb5-929f-df81c6a23a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:50.643595 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e1afc-12cb-4bb5-929f-df81c6a23a8a None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:50.643994 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e1afc-12cb-4bb5-929f-df81c6a23a8a None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:50.644273 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e1afc-12cb-4bb5-929f-df81c6a23a8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:50.645006 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846e1afc-12cb-4bb5-929f-df81c6a23a8a None admin] RBAC: Adding query filter params (role.id=f022705fa6ce43828345ef50b3f7efc9, scope.project.id=a67dea7cdf8d4c61b2758c16712e9c38, user.id=88977caac45542988ea6997003268bcc) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:37:50.645318 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846e1afc-12cb-4bb5-929f-df81c6a23a8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:50.647673 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846e1afc-12cb-4bb5-929f-df81c6a23a8a None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:50.654271 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 133/266] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Sep 24 19:37:50 2022] GET /identity/v3/role_assignments?user.id=88977caac45542988ea6997003268bcc&scope.project.id=a67dea7cdf8d4c61b2758c16712e9c38&role.id=f022705fa6ce43828345ef50b3f7efc9 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:37:50.677358 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:50.726862 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3368bdd9-6d9f-4a5d-95da-031ddbfc0fb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:50.728268 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3368bdd9-6d9f-4a5d-95da-031ddbfc0fb5 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:50.844689 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 134/267] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Sep 24 19:37:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 24 19:37:50.850858 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e1afc-12cb-4bb5-929f-df81c6a23a8a None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:50.940732 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:50.984260 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e1afc-12cb-4bb5-929f-df81c6a23a8a None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:51.022188 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57704e45-ba43-43ea-aff7-d90618cbe826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:51.022836 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57704e45-ba43-43ea-aff7-d90618cbe826 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:51.023116 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57704e45-ba43-43ea-aff7-d90618cbe826 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:51.023392 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57704e45-ba43-43ea-aff7-d90618cbe826 None admin] PATH_INFO: `/v3/projects/a67dea7cdf8d4c61b2758c16712e9c38` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:51.024540 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57704e45-ba43-43ea-aff7-d90618cbe826 None admin] RBAC: Authorizing `identity:get_project(project_id=a67dea7cdf8d4c61b2758c16712e9c38)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:51.026023 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57704e45-ba43-43ea-aff7-d90618cbe826 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:51.027982 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 134/268] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Sep 24 19:37:50 2022] GET /identity/v3/projects/a67dea7cdf8d4c61b2758c16712e9c38 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:37:51.033730 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3368bdd9-6d9f-4a5d-95da-031ddbfc0fb5 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:51.108428 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e9917-a5fe-494e-8011-c565e6f84f9a None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:51.108767 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e9917-a5fe-494e-8011-c565e6f84f9a None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:51.108971 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e9917-a5fe-494e-8011-c565e6f84f9a None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:51.110619 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 135/269] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:37:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:37:51.111621 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:51.124929 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c24d82-20c8-4d9d-8049-b22be19ebfef None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:51.125886 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c24d82-20c8-4d9d-8049-b22be19ebfef None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:51.128287 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c24d82-20c8-4d9d-8049-b22be19ebfef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:51.152475 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3368bdd9-6d9f-4a5d-95da-031ddbfc0fb5 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:51.152663 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-67c24d82-20c8-4d9d-8049-b22be19ebfef None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:37:51.153920 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-67c24d82-20c8-4d9d-8049-b22be19ebfef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:37:51.219131 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c3a8af-4a09-4f85-b076-2adfa33fc517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:51.219740 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3a8af-4a09-4f85-b076-2adfa33fc517 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:51.220013 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3a8af-4a09-4f85-b076-2adfa33fc517 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:51.220284 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3a8af-4a09-4f85-b076-2adfa33fc517 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:51.221016 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c3a8af-4a09-4f85-b076-2adfa33fc517 None admin] RBAC: Adding query filter params (role.id=dd695228990e4288afe29e3cefb75823, scope.project.id=a67dea7cdf8d4c61b2758c16712e9c38, user.id=88977caac45542988ea6997003268bcc) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:37:51.221320 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c3a8af-4a09-4f85-b076-2adfa33fc517 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:51.222788 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c3a8af-4a09-4f85-b076-2adfa33fc517 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:51.237649 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 135/270] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Sep 24 19:37:51 2022] GET /identity/v3/role_assignments?user.id=88977caac45542988ea6997003268bcc&scope.project.id=a67dea7cdf8d4c61b2758c16712e9c38&role.id=dd695228990e4288afe29e3cefb75823 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:51.278779 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 136/271] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:37:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:37:51.391533 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2d4ad-5865-4cd7-8aeb-36ceaabad436 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:51.391878 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2d4ad-5865-4cd7-8aeb-36ceaabad436 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:51.392196 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2d4ad-5865-4cd7-8aeb-36ceaabad436 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:51.394072 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 136/272] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:37:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:37:51.400322 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603a906-1d29-445e-93b9-c0c590db08f7 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:51.400634 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603a906-1d29-445e-93b9-c0c590db08f7 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:51.400975 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603a906-1d29-445e-93b9-c0c590db08f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:51.424408 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-9603a906-1d29-445e-93b9-c0c590db08f7 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:37:51.428977 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-9603a906-1d29-445e-93b9-c0c590db08f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:37:51.492429 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:51.502413 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 137/273] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:37:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:37:51.648576 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b2d4ad-5865-4cd7-8aeb-36ceaabad436 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:51.793357 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b2d4ad-5865-4cd7-8aeb-36ceaabad436 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:51.798452 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603a906-1d29-445e-93b9-c0c590db08f7 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:51.828743 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:51.838340 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54792f-d3da-4948-85d2-1c292bdd2091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:51.843036 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54792f-d3da-4948-85d2-1c292bdd2091 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:51.843036 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54792f-d3da-4948-85d2-1c292bdd2091 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:51.843036 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54792f-d3da-4948-85d2-1c292bdd2091 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:51.857319 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d54792f-d3da-4948-85d2-1c292bdd2091 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:37:51.862832 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-4d54792f-d3da-4948-85d2-1c292bdd2091 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:37:51.862832 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:37:51.862832 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:37:51.862832 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:37:51.862832 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:37:51.862832 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:37:51.862832 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:37:51.862832 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:37:51.862832 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:37:51.862832 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:37:51.862832 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:37:51.862832 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:37:51.862832 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:37:51.862832 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:37:51.862832 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:37:51.862832 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:37:51.863807 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:37:51.863807 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:37:51.863807 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:37:51.863807 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:37:51.863807 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:37:51.863807 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:37:51.863807 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:37:51.863807 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:37:51.863807 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:37:51.863807 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:37:51.863807 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:37:51.863807 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:37:51.863807 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:37:51.863807 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:37:51.863807 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:37:51.863807 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:37:51.864590 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:37:51.864590 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:37:51.864590 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:37:51.864590 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:37:51.864590 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:37:51.864590 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:37:51.864590 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:37:51.864590 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:37:51.864590 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:37:51.864590 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:37:51.864590 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:37:51.864590 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:37:51.864590 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 137/274] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Sep 24 19:37:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:37:51.870428 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54792f-d3da-4948-85d2-1c292bdd2091 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:51.931052 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603a906-1d29-445e-93b9-c0c590db08f7 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:51.969928 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37879f7b-64c3-43ec-8513-2de1c86f44d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:51.970565 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37879f7b-64c3-43ec-8513-2de1c86f44d1 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:51.970843 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37879f7b-64c3-43ec-8513-2de1c86f44d1 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:51.971112 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37879f7b-64c3-43ec-8513-2de1c86f44d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:51.972211 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37879f7b-64c3-43ec-8513-2de1c86f44d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:51.973684 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37879f7b-64c3-43ec-8513-2de1c86f44d1 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:51.975369 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 138/275] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:37:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:37:51.976602 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70023da-11f8-4fe1-a248-3beceae91122 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:51.976882 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70023da-11f8-4fe1-a248-3beceae91122 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:51.977151 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70023da-11f8-4fe1-a248-3beceae91122 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:51.978540 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 139/276] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:37:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:37:51.980594 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70023da-11f8-4fe1-a248-3beceae91122 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:52.038897 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54792f-d3da-4948-85d2-1c292bdd2091 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:52.042392 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:52.079852 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b630c00-6e96-4e21-848c-dc2d177c6cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:52.081211 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b630c00-6e96-4e21-848c-dc2d177c6cea None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:52.081500 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b630c00-6e96-4e21-848c-dc2d177c6cea None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:52.081794 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b630c00-6e96-4e21-848c-dc2d177c6cea None admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:52.082461 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b630c00-6e96-4e21-848c-dc2d177c6cea None admin] RBAC: Adding query filter params (name=member) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:37:52.082766 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b630c00-6e96-4e21-848c-dc2d177c6cea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:52.084646 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b630c00-6e96-4e21-848c-dc2d177c6cea None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:52.087715 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70023da-11f8-4fe1-a248-3beceae91122 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:52.098461 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 138/277] 10.222.0.60 () {56 vars in 1101 bytes} [Sat Sep 24 19:37:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:37:52.098461 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933a959-77eb-48a1-a299-457e752a4b25 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:52.098461 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933a959-77eb-48a1-a299-457e752a4b25 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:52.098461 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933a959-77eb-48a1-a299-457e752a4b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:52.115359 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-4933a959-77eb-48a1-a299-457e752a4b25 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:37:52.117176 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-4933a959-77eb-48a1-a299-457e752a4b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:37:52.128258 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d44a5-5f1f-451f-9899-c7f27f5855f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:52.128874 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d44a5-5f1f-451f-9899-c7f27f5855f3 None admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:52.129187 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d44a5-5f1f-451f-9899-c7f27f5855f3 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:52.129427 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d44a5-5f1f-451f-9899-c7f27f5855f3 None admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:52.130237 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d44a5-5f1f-451f-9899-c7f27f5855f3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:52.131922 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d44a5-5f1f-451f-9899-c7f27f5855f3 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:52.166701 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:52.185320 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 139/278] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:37:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:37:52.186437 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4933a959-77eb-48a1-a299-457e752a4b25 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:52.265953 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 140/279] 10.222.0.60 () {60 vars in 1132 bytes} [Sat Sep 24 19:37:51 2022] POST /identity/v3/users => generated 293 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 19:37:52.296093 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4933a959-77eb-48a1-a299-457e752a4b25 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:52.342675 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5955a81-46a6-42e2-ba79-6a270e34b007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:52.343716 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5955a81-46a6-42e2-ba79-6a270e34b007 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:52.344222 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5955a81-46a6-42e2-ba79-6a270e34b007 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:52.344730 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5955a81-46a6-42e2-ba79-6a270e34b007 None admin] PATH_INFO: `/v3/users/28a3dab1cce646dda12250bab1138205` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:52.363959 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5955a81-46a6-42e2-ba79-6a270e34b007 None admin] RBAC: Authorizing `identity:get_user(user_id=28a3dab1cce646dda12250bab1138205)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:52.365995 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5955a81-46a6-42e2-ba79-6a270e34b007 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:52.368412 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 140/280] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Sep 24 19:37:52 2022] GET /identity/v3/users/28a3dab1cce646dda12250bab1138205 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:52.377088 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d44a5-5f1f-451f-9899-c7f27f5855f3 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:52.512669 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5955a81-46a6-42e2-ba79-6a270e34b007 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:52.556285 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d44a5-5f1f-451f-9899-c7f27f5855f3 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:52.582277 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:52.589611 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:52.610190 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a9266-ba25-4847-b27b-c9c7588735a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:52.610731 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a9266-ba25-4847-b27b-c9c7588735a3 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:52.611009 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a9266-ba25-4847-b27b-c9c7588735a3 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:52.611282 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a9266-ba25-4847-b27b-c9c7588735a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:52.612043 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685a9266-ba25-4847-b27b-c9c7588735a3 None admin] RBAC: Adding query filter params (role.id=3dfa1e29c6a0404388d256728d66e4a1, user.id=28a3dab1cce646dda12250bab1138205, scope.system=all) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:37:52.612348 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685a9266-ba25-4847-b27b-c9c7588735a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:52.613910 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685a9266-ba25-4847-b27b-c9c7588735a3 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:52.626393 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 141/281] 10.222.0.60 () {56 vars in 1308 bytes} [Sat Sep 24 19:37:52 2022] GET /identity/v3/role_assignments?user.id=28a3dab1cce646dda12250bab1138205&scope.system=all&role.id=3dfa1e29c6a0404388d256728d66e4a1 => generated 226 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:52.672646 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5955a81-46a6-42e2-ba79-6a270e34b007 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:52.718306 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff25c50-8123-4851-8c2e-aecae9497cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:52.718964 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff25c50-8123-4851-8c2e-aecae9497cdc None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:52.719241 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff25c50-8123-4851-8c2e-aecae9497cdc None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:52.719512 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff25c50-8123-4851-8c2e-aecae9497cdc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:52.733639 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff25c50-8123-4851-8c2e-aecae9497cdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:37:52.738758 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-bff25c50-8123-4851-8c2e-aecae9497cdc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 19:37:52.738758 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:37:52.738758 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:37:52.738758 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:37:52.738758 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:37:52.738758 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:37:52.738758 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:37:52.738758 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:37:52.738758 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:37:52.738758 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:37:52.738758 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:37:52.738758 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:37:52.738758 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:37:52.738758 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:37:52.738758 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:37:52.738758 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:37:52.739713 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:37:52.739713 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:37:52.739713 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:37:52.739713 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:37:52.739713 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:37:52.739713 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:37:52.739713 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:37:52.739713 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:37:52.739713 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:37:52.739713 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:37:52.739713 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:37:52.739713 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:37:52.739713 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:37:52.739713 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:37:52.739713 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:37:52.739713 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:37:52.741770 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:37:52.741770 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:37:52.741770 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:37:52.741770 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:37:52.741770 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:37:52.741770 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:37:52.741770 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:37:52.741770 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:37:52.741770 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:37:52.741770 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:37:52.741770 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 19:37:52.741770 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:37:52.741770 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 141/282] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Sep 24 19:37:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:37:52.746773 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a9266-ba25-4847-b27b-c9c7588735a3 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:52.880586 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a9266-ba25-4847-b27b-c9c7588735a3 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:52.926741 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d83c5-e47c-44c3-9dc2-212880216014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:52.927373 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d83c5-e47c-44c3-9dc2-212880216014 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:52.927648 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d83c5-e47c-44c3-9dc2-212880216014 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:52.928016 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d83c5-e47c-44c3-9dc2-212880216014 None admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:52.928938 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53d83c5-e47c-44c3-9dc2-212880216014 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:37:52.929118 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53d83c5-e47c-44c3-9dc2-212880216014 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:52.930749 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53d83c5-e47c-44c3-9dc2-212880216014 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:52.943299 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 142/283] 10.222.0.60 () {56 vars in 1101 bytes} [Sat Sep 24 19:37:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:52.949480 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff25c50-8123-4851-8c2e-aecae9497cdc None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:53.051371 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625259a-b619-47d6-8d73-2d404827bd1a None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:53.052109 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625259a-b619-47d6-8d73-2d404827bd1a None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:53.052954 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625259a-b619-47d6-8d73-2d404827bd1a None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:53.056244 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 143/284] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:37:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:37:53.069813 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68291455-68a9-471f-8baf-781f1f9246ce None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:53.070652 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68291455-68a9-471f-8baf-781f1f9246ce None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:53.071462 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68291455-68a9-471f-8baf-781f1f9246ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:53.107243 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-68291455-68a9-471f-8baf-781f1f9246ce None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:37:53.111224 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-68291455-68a9-471f-8baf-781f1f9246ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:37:53.151194 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff25c50-8123-4851-8c2e-aecae9497cdc None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:53.153124 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:53.190649 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:53.212483 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3085162-540e-4361-ad49-7221ca148ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:53.213161 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3085162-540e-4361-ad49-7221ca148ed2 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:53.213451 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3085162-540e-4361-ad49-7221ca148ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:53.213756 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3085162-540e-4361-ad49-7221ca148ed2 None admin] PATH_INFO: `/v3/users/b4fa40a0e7614a98904ddea68693d426` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:53.215839 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3085162-540e-4361-ad49-7221ca148ed2 None admin] RBAC: Authorizing `identity:get_user(user_id=b4fa40a0e7614a98904ddea68693d426)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:53.220492 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3085162-540e-4361-ad49-7221ca148ed2 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:53.222234 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 142/285] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Sep 24 19:37:52 2022] GET /identity/v3/users/b4fa40a0e7614a98904ddea68693d426 => generated 297 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:37:53.228412 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3085162-540e-4361-ad49-7221ca148ed2 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:53.260102 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 144/286] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:37:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 19:37:53.355669 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3085162-540e-4361-ad49-7221ca148ed2 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:53.398089 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2500502-9d62-484a-81c6-88836db6f48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:53.398768 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2500502-9d62-484a-81c6-88836db6f48d None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:53.399053 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2500502-9d62-484a-81c6-88836db6f48d None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:53.399331 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2500502-9d62-484a-81c6-88836db6f48d None admin] PATH_INFO: `/v3/projects/a67dea7cdf8d4c61b2758c16712e9c38` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:53.400555 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2500502-9d62-484a-81c6-88836db6f48d None admin] RBAC: Authorizing `identity:get_project(project_id=a67dea7cdf8d4c61b2758c16712e9c38)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:53.402092 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2500502-9d62-484a-81c6-88836db6f48d None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:53.403868 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 143/287] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Sep 24 19:37:53 2022] GET /identity/v3/projects/a67dea7cdf8d4c61b2758c16712e9c38 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:37:53.410601 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68291455-68a9-471f-8baf-781f1f9246ce None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:53.601203 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68291455-68a9-471f-8baf-781f1f9246ce None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:53.635899 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2500502-9d62-484a-81c6-88836db6f48d None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:53.655644 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce0c95-9ebc-4ea6-b5c3-e4e967ed9866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:53.656244 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce0c95-9ebc-4ea6-b5c3-e4e967ed9866 None admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:53.656525 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce0c95-9ebc-4ea6-b5c3-e4e967ed9866 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:53.656796 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce0c95-9ebc-4ea6-b5c3-e4e967ed9866 None admin] PATH_INFO: `/v3/projects/a67dea7cdf8d4c61b2758c16712e9c38/users/b4fa40a0e7614a98904ddea68693d426/roles/632e24cff8a04bd598fbbb3b41c62218` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:53.662877 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fce0c95-9ebc-4ea6-b5c3-e4e967ed9866 None admin] RBAC: Authorizing `identity:create_grant(project_id=a67dea7cdf8d4c61b2758c16712e9c38, user_id=b4fa40a0e7614a98904ddea68693d426, role_id=632e24cff8a04bd598fbbb3b41c62218)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:53.664456 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fce0c95-9ebc-4ea6-b5c3-e4e967ed9866 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:53.695134 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:53.744518 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 145/288] 10.222.0.60 () {58 vars in 1439 bytes} [Sat Sep 24 19:37:53 2022] PUT /identity/v3/projects/a67dea7cdf8d4c61b2758c16712e9c38/users/b4fa40a0e7614a98904ddea68693d426/roles/632e24cff8a04bd598fbbb3b41c62218 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:37:53.788816 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2500502-9d62-484a-81c6-88836db6f48d None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:53.845327 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f4704-86ff-446a-8230-d61bf162b060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:53.846025 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f4704-86ff-446a-8230-d61bf162b060 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:53.846308 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f4704-86ff-446a-8230-d61bf162b060 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:53.846582 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f4704-86ff-446a-8230-d61bf162b060 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:53.863692 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1f4704-86ff-446a-8230-d61bf162b060 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:37:53.868876 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-ae1f4704-86ff-446a-8230-d61bf162b060 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:37:53.868876 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:37:53.868876 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:37:53.868876 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:37:53.868876 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:37:53.868876 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:37:53.868876 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:37:53.868876 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:37:53.868876 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:37:53.868876 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:37:53.868876 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:37:53.868876 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:37:53.868876 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:37:53.868876 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:37:53.868876 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:37:53.868876 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:37:53.869885 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:37:53.869885 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:37:53.869885 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:37:53.869885 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:37:53.869885 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:37:53.869885 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:37:53.869885 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:37:53.869885 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:37:53.869885 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:37:53.869885 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:37:53.869885 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:37:53.869885 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:37:53.869885 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:37:53.869885 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:37:53.869885 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:37:53.869885 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:37:53.870767 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:37:53.870767 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:37:53.870767 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:37:53.870767 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:37:53.870767 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:37:53.870767 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:37:53.870767 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:37:53.870767 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:37:53.870767 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:37:53.870767 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:37:53.870767 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:37:53.870767 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:37:53.870767 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 144/289] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Sep 24 19:37:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:37:53.876350 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce0c95-9ebc-4ea6-b5c3-e4e967ed9866 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:53.919910 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:54.012078 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce0c95-9ebc-4ea6-b5c3-e4e967ed9866 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:54.058518 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78897625-7789-4aba-92c2-278ef74f1f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:54.059147 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78897625-7789-4aba-92c2-278ef74f1f68 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:54.059425 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78897625-7789-4aba-92c2-278ef74f1f68 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:54.059697 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78897625-7789-4aba-92c2-278ef74f1f68 None admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:54.060376 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78897625-7789-4aba-92c2-278ef74f1f68 None admin] RBAC: Adding query filter params (name=member) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:37:54.060679 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78897625-7789-4aba-92c2-278ef74f1f68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:54.062133 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78897625-7789-4aba-92c2-278ef74f1f68 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:54.072985 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 146/290] 10.222.0.60 () {56 vars in 1101 bytes} [Sat Sep 24 19:37:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:54.080495 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f4704-86ff-446a-8230-d61bf162b060 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:54.210295 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:54.217767 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f4704-86ff-446a-8230-d61bf162b060 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:54.265189 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8063284a-e80f-46f8-be06-f6b6fa9bf1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:54.265865 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063284a-e80f-46f8-be06-f6b6fa9bf1d1 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:54.266150 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063284a-e80f-46f8-be06-f6b6fa9bf1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:54.266426 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063284a-e80f-46f8-be06-f6b6fa9bf1d1 None admin] PATH_INFO: `/v3/users/ff358e7de33d49c7af888063fc19c9ac` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:54.267613 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8063284a-e80f-46f8-be06-f6b6fa9bf1d1 None admin] RBAC: Authorizing `identity:get_user(user_id=ff358e7de33d49c7af888063fc19c9ac)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:54.269074 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8063284a-e80f-46f8-be06-f6b6fa9bf1d1 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:54.272913 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 145/291] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Sep 24 19:37:54 2022] GET /identity/v3/users/ff358e7de33d49c7af888063fc19c9ac => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:37:54.280616 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78897625-7789-4aba-92c2-278ef74f1f68 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:54.451345 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:54.457999 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78897625-7789-4aba-92c2-278ef74f1f68 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:54.512976 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a65d7eb-0fc4-4a6d-ae64-bb70738b6951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:54.513526 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65d7eb-0fc4-4a6d-ae64-bb70738b6951 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:54.513812 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65d7eb-0fc4-4a6d-ae64-bb70738b6951 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:54.514081 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65d7eb-0fc4-4a6d-ae64-bb70738b6951 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:54.617540 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a65d7eb-0fc4-4a6d-ae64-bb70738b6951 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:54.619052 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a65d7eb-0fc4-4a6d-ae64-bb70738b6951 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:54.764243 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:54.772600 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 147/292] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Sep 24 19:37:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:37:54.778601 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8063284a-e80f-46f8-be06-f6b6fa9bf1d1 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:54.924210 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8063284a-e80f-46f8-be06-f6b6fa9bf1d1 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:54.979207 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aaf233-8bcf-46ad-bf99-a07c59492f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:54.979864 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aaf233-8bcf-46ad-bf99-a07c59492f06 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:54.980146 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aaf233-8bcf-46ad-bf99-a07c59492f06 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:54.980423 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aaf233-8bcf-46ad-bf99-a07c59492f06 None admin] PATH_INFO: `/v3/projects/a67dea7cdf8d4c61b2758c16712e9c38` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:54.982211 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aaf233-8bcf-46ad-bf99-a07c59492f06 None admin] RBAC: Authorizing `identity:get_project(project_id=a67dea7cdf8d4c61b2758c16712e9c38)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:54.983651 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aaf233-8bcf-46ad-bf99-a07c59492f06 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:54.985715 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 146/293] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Sep 24 19:37:54 2022] GET /identity/v3/projects/a67dea7cdf8d4c61b2758c16712e9c38 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:54.993002 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a65d7eb-0fc4-4a6d-ae64-bb70738b6951 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:55.131913 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a65d7eb-0fc4-4a6d-ae64-bb70738b6951 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:55.170163 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8622b39d-b09b-413e-b010-172189217865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:55.170795 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622b39d-b09b-413e-b010-172189217865 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:55.171076 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622b39d-b09b-413e-b010-172189217865 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:55.171351 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622b39d-b09b-413e-b010-172189217865 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:55.172102 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8622b39d-b09b-413e-b010-172189217865 None admin] RBAC: Adding query filter params (role.id=3dfa1e29c6a0404388d256728d66e4a1, scope.project.id=a67dea7cdf8d4c61b2758c16712e9c38, user.id=ff358e7de33d49c7af888063fc19c9ac) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:37:55.172417 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8622b39d-b09b-413e-b010-172189217865 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:55.173943 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8622b39d-b09b-413e-b010-172189217865 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:55.185452 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 148/294] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Sep 24 19:37:54 2022] GET /identity/v3/role_assignments?user.id=ff358e7de33d49c7af888063fc19c9ac&scope.project.id=a67dea7cdf8d4c61b2758c16712e9c38&role.id=3dfa1e29c6a0404388d256728d66e4a1 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:37:55.266617 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97bbd6b-0423-439f-8cc4-7509a0126e52 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:55.267132 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97bbd6b-0423-439f-8cc4-7509a0126e52 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:55.267132 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97bbd6b-0423-439f-8cc4-7509a0126e52 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:55.268754 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 147/295] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:37:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:37:55.288949 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f56e2b-cd95-42ce-bee3-a0a4677ec463 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:55.289270 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f56e2b-cd95-42ce-bee3-a0a4677ec463 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:55.289517 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f56e2b-cd95-42ce-bee3-a0a4677ec463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:55.320984 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-c1f56e2b-cd95-42ce-bee3-a0a4677ec463 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:37:55.322256 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-c1f56e2b-cd95-42ce-bee3-a0a4677ec463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:37:55.359749 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d725ba34-aac7-4366-8ce9-bb354031ae67 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:55.359749 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d725ba34-aac7-4366-8ce9-bb354031ae67 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:55.359749 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d725ba34-aac7-4366-8ce9-bb354031ae67 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:55.360636 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 148/296] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:37:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:37:55.367011 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442cc31-bcc8-4685-b60f-0c5d2238a5c8 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:55.367360 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442cc31-bcc8-4685-b60f-0c5d2238a5c8 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:55.367546 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442cc31-bcc8-4685-b60f-0c5d2238a5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:55.402562 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-b442cc31-bcc8-4685-b60f-0c5d2238a5c8 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:37:55.403721 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-b442cc31-bcc8-4685-b60f-0c5d2238a5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:37:55.426143 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:55.447224 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:55.451653 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 149/297] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:37:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:37:55.500345 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 149/298] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:37:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:37:55.753386 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f56e2b-cd95-42ce-bee3-a0a4677ec463 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:55.867051 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b442cc31-bcc8-4685-b60f-0c5d2238a5c8 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:55.906702 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f56e2b-cd95-42ce-bee3-a0a4677ec463 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:55.985285 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0677e23d-d1ca-47c8-81d3-b89f7692c26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:55.986339 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677e23d-d1ca-47c8-81d3-b89f7692c26e None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:55.986749 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677e23d-d1ca-47c8-81d3-b89f7692c26e None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:55.987277 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677e23d-d1ca-47c8-81d3-b89f7692c26e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:56.001397 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0677e23d-d1ca-47c8-81d3-b89f7692c26e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:37:56.004802 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b442cc31-bcc8-4685-b60f-0c5d2238a5c8 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:56.006789 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-0677e23d-d1ca-47c8-81d3-b89f7692c26e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 19:37:56.006789 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:37:56.006789 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:37:56.006789 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:37:56.006789 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:37:56.006789 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:37:56.006789 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:37:56.006789 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:37:56.006789 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:37:56.006789 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:37:56.006789 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:37:56.006789 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:37:56.006789 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:37:56.006789 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:37:56.006789 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:37:56.006789 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:37:56.007701 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:37:56.007701 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:37:56.007701 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:37:56.007701 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:37:56.007701 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:37:56.007701 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:37:56.007701 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:37:56.007701 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:37:56.007701 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:37:56.007701 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:37:56.007701 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:37:56.007701 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:37:56.007701 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:37:56.007701 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:37:56.007701 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:37:56.007701 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:37:56.010228 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:37:56.010228 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:37:56.010228 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:37:56.010228 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:37:56.010228 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:37:56.010228 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:37:56.010228 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:37:56.010228 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:37:56.010228 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:37:56.010228 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:37:56.010228 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 19:37:56.010228 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:37:56.010228 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 150/299] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Sep 24 19:37:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:37:56.010228 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f29978-80f1-4c66-8d3b-8836ebf13456 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:56.010929 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f29978-80f1-4c66-8d3b-8836ebf13456 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:56.010929 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f29978-80f1-4c66-8d3b-8836ebf13456 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:56.012003 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 151/300] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:37:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:37:56.014383 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f29978-80f1-4c66-8d3b-8836ebf13456 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:56.055192 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8f021-7108-4d8e-b4fd-32225f919f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:56.055944 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8f021-7108-4d8e-b4fd-32225f919f50 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:56.056215 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8f021-7108-4d8e-b4fd-32225f919f50 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:56.056493 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8f021-7108-4d8e-b4fd-32225f919f50 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:56.057681 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc8f021-7108-4d8e-b4fd-32225f919f50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:56.059105 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc8f021-7108-4d8e-b4fd-32225f919f50 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:56.060701 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 150/301] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:37:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:56.064060 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134b024-0f13-4609-9712-f4975bf4b723 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:56.064060 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134b024-0f13-4609-9712-f4975bf4b723 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:56.064060 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134b024-0f13-4609-9712-f4975bf4b723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:56.080930 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-d134b024-0f13-4609-9712-f4975bf4b723 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:37:56.082164 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-d134b024-0f13-4609-9712-f4975bf4b723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:37:56.084117 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:56.112968 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:56.149117 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f29978-80f1-4c66-8d3b-8836ebf13456 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:56.166499 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 151/302] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:37:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:37:56.167328 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d134b024-0f13-4609-9712-f4975bf4b723 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:56.199154 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b57428a-8dd7-4b64-a5a9-c62f39621e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:56.200237 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57428a-8dd7-4b64-a5a9-c62f39621e53 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:56.200722 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57428a-8dd7-4b64-a5a9-c62f39621e53 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:56.201193 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57428a-8dd7-4b64-a5a9-c62f39621e53 None admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:56.202100 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b57428a-8dd7-4b64-a5a9-c62f39621e53 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:37:56.202623 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b57428a-8dd7-4b64-a5a9-c62f39621e53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:56.204239 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b57428a-8dd7-4b64-a5a9-c62f39621e53 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:56.215909 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 152/303] 10.222.0.60 () {56 vars in 1101 bytes} [Sat Sep 24 19:37:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:56.221237 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b57428a-8dd7-4b64-a5a9-c62f39621e53 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:56.311573 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d134b024-0f13-4609-9712-f4975bf4b723 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:56.357780 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf18375-d288-4af9-be0c-f93c3960cde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:56.358406 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf18375-d288-4af9-be0c-f93c3960cde7 None admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:56.358687 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf18375-d288-4af9-be0c-f93c3960cde7 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:56.358980 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf18375-d288-4af9-be0c-f93c3960cde7 None admin] PATH_INFO: `/v3/groups` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:56.359602 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf18375-d288-4af9-be0c-f93c3960cde7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:56.361069 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf18375-d288-4af9-be0c-f93c3960cde7 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:56.364851 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b57428a-8dd7-4b64-a5a9-c62f39621e53 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:56.377312 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:56.403108 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756f9839-aa6f-4069-8ad7-74d4303ea798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:56.403856 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f9839-aa6f-4069-8ad7-74d4303ea798 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:56.404137 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f9839-aa6f-4069-8ad7-74d4303ea798 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:56.404409 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f9839-aa6f-4069-8ad7-74d4303ea798 None admin] PATH_INFO: `/v3/users/c31733c37d9d40edbc1604ea7aea3c7e` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:56.418909 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756f9839-aa6f-4069-8ad7-74d4303ea798 None admin] RBAC: Authorizing `identity:get_user(user_id=c31733c37d9d40edbc1604ea7aea3c7e)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:56.420393 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756f9839-aa6f-4069-8ad7-74d4303ea798 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:56.422279 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 153/304] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Sep 24 19:37:56 2022] GET /identity/v3/users/c31733c37d9d40edbc1604ea7aea3c7e => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:56.423432 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeadd08-1862-4a46-92ae-8f3fe37da6e2 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:56.423718 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeadd08-1862-4a46-92ae-8f3fe37da6e2 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:56.423989 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeadd08-1862-4a46-92ae-8f3fe37da6e2 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:56.425328 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 154/305] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:37:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:37:56.428528 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeadd08-1862-4a46-92ae-8f3fe37da6e2 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:56.531810 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeadd08-1862-4a46-92ae-8f3fe37da6e2 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:56.563133 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 152/306] 10.222.0.60 () {60 vars in 1134 bytes} [Sat Sep 24 19:37:56 2022] POST /identity/v3/groups => generated 229 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:37:56.564400 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75515e0b-1215-469c-8c85-15c05e4a0dc1 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:56.564740 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75515e0b-1215-469c-8c85-15c05e4a0dc1 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:56.565035 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75515e0b-1215-469c-8c85-15c05e4a0dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:56.573122 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3b974-3548-4642-b468-739c1b1326c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:56.579655 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3b974-3548-4642-b468-739c1b1326c3 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:56.579655 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3b974-3548-4642-b468-739c1b1326c3 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:56.579655 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3b974-3548-4642-b468-739c1b1326c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:56.579655 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba3b974-3548-4642-b468-739c1b1326c3 None admin] RBAC: Adding query filter params (role.id=632e24cff8a04bd598fbbb3b41c62218, user.id=c31733c37d9d40edbc1604ea7aea3c7e, scope.system=all) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:37:56.579655 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba3b974-3548-4642-b468-739c1b1326c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:56.579655 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba3b974-3548-4642-b468-739c1b1326c3 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:56.583922 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 155/307] 10.222.0.60 () {56 vars in 1308 bytes} [Sat Sep 24 19:37:56 2022] GET /identity/v3/role_assignments?user.id=c31733c37d9d40edbc1604ea7aea3c7e&scope.system=all&role.id=632e24cff8a04bd598fbbb3b41c62218 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:56.593489 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-75515e0b-1215-469c-8c85-15c05e4a0dc1 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:37:56.594834 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-75515e0b-1215-469c-8c85-15c05e4a0dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:37:56.598547 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3b974-3548-4642-b468-739c1b1326c3 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:56.624847 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:56.663945 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:56.712160 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 153/308] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:37:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:37:56.780826 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3b974-3548-4642-b468-739c1b1326c3 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:56.823473 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1c818f-9f9c-4a6f-95f8-0fa8e187fad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:56.824046 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c818f-9f9c-4a6f-95f8-0fa8e187fad0 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:56.824323 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c818f-9f9c-4a6f-95f8-0fa8e187fad0 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:56.824593 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c818f-9f9c-4a6f-95f8-0fa8e187fad0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:56.837208 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1c818f-9f9c-4a6f-95f8-0fa8e187fad0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:37:56.842227 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-6a1c818f-9f9c-4a6f-95f8-0fa8e187fad0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:37:56.842227 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:37:56.842227 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:37:56.842227 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:37:56.842227 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:37:56.842227 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:37:56.842227 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:37:56.842227 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:37:56.842227 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:37:56.842227 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:37:56.842227 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:37:56.842227 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:37:56.842227 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:37:56.842227 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:37:56.842227 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:37:56.842227 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:37:56.843186 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:37:56.843186 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:37:56.843186 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:37:56.843186 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:37:56.843186 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:37:56.843186 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:37:56.843186 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:37:56.843186 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:37:56.843186 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:37:56.843186 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:37:56.843186 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:37:56.843186 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:37:56.843186 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:37:56.843186 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:37:56.843186 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:37:56.843186 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:37:56.844000 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:37:56.844000 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:37:56.844000 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:37:56.844000 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:37:56.844000 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:37:56.844000 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:37:56.844000 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:37:56.844000 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:37:56.844000 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:37:56.844000 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:37:56.844000 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:37:56.844000 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:37:56.844000 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 156/309] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Sep 24 19:37:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:37:56.850769 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75515e0b-1215-469c-8c85-15c05e4a0dc1 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:56.964146 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75515e0b-1215-469c-8c85-15c05e4a0dc1 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:57.001889 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336064ae-0dbc-4966-9aff-465ad43d2b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:57.002886 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336064ae-0dbc-4966-9aff-465ad43d2b95 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:57.003363 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336064ae-0dbc-4966-9aff-465ad43d2b95 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:57.003830 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336064ae-0dbc-4966-9aff-465ad43d2b95 None admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:57.004697 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336064ae-0dbc-4966-9aff-465ad43d2b95 None admin] RBAC: Adding query filter params (name=member) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:37:57.005207 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336064ae-0dbc-4966-9aff-465ad43d2b95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:57.007541 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336064ae-0dbc-4966-9aff-465ad43d2b95 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:57.008322 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1c818f-9f9c-4a6f-95f8-0fa8e187fad0 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:57.021550 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 154/310] 10.222.0.60 () {56 vars in 1101 bytes} [Sat Sep 24 19:37:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:57.030558 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336064ae-0dbc-4966-9aff-465ad43d2b95 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:57.058903 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:57.134188 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:57.143229 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1c818f-9f9c-4a6f-95f8-0fa8e187fad0 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:57.176695 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336064ae-0dbc-4966-9aff-465ad43d2b95 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:57.186028 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a1031-8043-4fc8-8d98-8ec18f1cf5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:57.187326 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a1031-8043-4fc8-8d98-8ec18f1cf5c8 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:57.188365 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a1031-8043-4fc8-8d98-8ec18f1cf5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:57.188872 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a1031-8043-4fc8-8d98-8ec18f1cf5c8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:57.204008 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131a1031-8043-4fc8-8d98-8ec18f1cf5c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:37:57.211442 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-131a1031-8043-4fc8-8d98-8ec18f1cf5c8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 19:37:57.211442 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:37:57.211442 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:37:57.211442 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:37:57.211442 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:37:57.211442 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:37:57.211442 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:37:57.211442 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:37:57.211442 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:37:57.211442 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:37:57.211442 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:37:57.211442 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:37:57.211442 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:37:57.211442 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:37:57.211442 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:37:57.211442 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:37:57.212388 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:37:57.212388 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:37:57.212388 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:37:57.212388 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:37:57.212388 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:37:57.212388 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:37:57.212388 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:37:57.212388 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:37:57.212388 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:37:57.212388 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:37:57.212388 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:37:57.212388 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:37:57.212388 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:37:57.212388 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:37:57.212388 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:37:57.212388 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:37:57.213176 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:37:57.213176 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:37:57.213176 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:37:57.213176 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:37:57.213176 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:37:57.213176 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:37:57.213176 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:37:57.213176 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:37:57.213176 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:37:57.213176 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:37:57.213176 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 19:37:57.213176 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:37:57.214876 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 157/311] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Sep 24 19:37:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:37:57.221225 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a1031-8043-4fc8-8d98-8ec18f1cf5c8 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:57.231220 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a881e-408b-4300-b84f-c2e2a18e668e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:57.232820 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a881e-408b-4300-b84f-c2e2a18e668e None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:57.233443 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a881e-408b-4300-b84f-c2e2a18e668e None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:57.233988 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a881e-408b-4300-b84f-c2e2a18e668e None admin] PATH_INFO: `/v3/users/28a3dab1cce646dda12250bab1138205` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:57.236375 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a881e-408b-4300-b84f-c2e2a18e668e None admin] RBAC: Authorizing `identity:get_user(user_id=28a3dab1cce646dda12250bab1138205)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:57.238660 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a881e-408b-4300-b84f-c2e2a18e668e None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:57.242383 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 155/312] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Sep 24 19:37:57 2022] GET /identity/v3/users/28a3dab1cce646dda12250bab1138205 => generated 293 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:57.248231 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a881e-408b-4300-b84f-c2e2a18e668e None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:57.342240 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:57.356192 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a1031-8043-4fc8-8d98-8ec18f1cf5c8 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:57.363864 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a881e-408b-4300-b84f-c2e2a18e668e None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:57.394671 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f100c9e1-431b-49a3-9b2b-4127452f1155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:57.395360 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100c9e1-431b-49a3-9b2b-4127452f1155 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:57.395555 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100c9e1-431b-49a3-9b2b-4127452f1155 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:57.395812 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100c9e1-431b-49a3-9b2b-4127452f1155 None admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:57.397049 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f100c9e1-431b-49a3-9b2b-4127452f1155 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:37:57.397354 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f100c9e1-431b-49a3-9b2b-4127452f1155 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:57.398807 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f100c9e1-431b-49a3-9b2b-4127452f1155 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:57.407759 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5def72a-5a67-4471-a9e0-722e7f979218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:57.408776 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5def72a-5a67-4471-a9e0-722e7f979218 None admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:57.409273 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5def72a-5a67-4471-a9e0-722e7f979218 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:57.409821 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5def72a-5a67-4471-a9e0-722e7f979218 None admin] PATH_INFO: `/v3/system/users/28a3dab1cce646dda12250bab1138205/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:57.411561 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5def72a-5a67-4471-a9e0-722e7f979218 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=28a3dab1cce646dda12250bab1138205, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:57.413010 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 158/313] 10.222.0.60 () {56 vars in 1101 bytes} [Sat Sep 24 19:37:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:57.413781 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5def72a-5a67-4471-a9e0-722e7f979218 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:57.414508 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f100c9e1-431b-49a3-9b2b-4127452f1155 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:57.432871 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:57.516932 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 156/314] 10.222.0.60 () {58 vars in 1334 bytes} [Sat Sep 24 19:37:57 2022] PUT /identity/v3/system/users/28a3dab1cce646dda12250bab1138205/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:37:57.535911 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f100c9e1-431b-49a3-9b2b-4127452f1155 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:57.583102 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2558d9a4-108b-44fe-b2e6-2d1e64413383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:57.585101 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558d9a4-108b-44fe-b2e6-2d1e64413383 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:57.585681 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558d9a4-108b-44fe-b2e6-2d1e64413383 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:57.586149 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558d9a4-108b-44fe-b2e6-2d1e64413383 None admin] PATH_INFO: `/v3/users/b4fa40a0e7614a98904ddea68693d426` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:57.587734 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2558d9a4-108b-44fe-b2e6-2d1e64413383 None admin] RBAC: Authorizing `identity:get_user(user_id=b4fa40a0e7614a98904ddea68693d426)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:57.589654 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2558d9a4-108b-44fe-b2e6-2d1e64413383 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:57.592224 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 159/315] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Sep 24 19:37:57 2022] GET /identity/v3/users/b4fa40a0e7614a98904ddea68693d426 => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:57.601668 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5def72a-5a67-4471-a9e0-722e7f979218 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:57.722974 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5def72a-5a67-4471-a9e0-722e7f979218 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:57.763589 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276fef83-5ef1-4c32-a741-52d89a4a06dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:57.764529 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276fef83-5ef1-4c32-a741-52d89a4a06dc None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:57.764966 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276fef83-5ef1-4c32-a741-52d89a4a06dc None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:57.765415 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276fef83-5ef1-4c32-a741-52d89a4a06dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:57.791185 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:57.851855 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276fef83-5ef1-4c32-a741-52d89a4a06dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:57.853335 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276fef83-5ef1-4c32-a741-52d89a4a06dc None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:57.958899 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 157/316] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Sep 24 19:37:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:37:57.964652 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2558d9a4-108b-44fe-b2e6-2d1e64413383 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:58.059483 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:58.080040 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2558d9a4-108b-44fe-b2e6-2d1e64413383 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:58.117241 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b63d2b-d727-43a2-86b4-0d0a61dae4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:58.118631 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b63d2b-d727-43a2-86b4-0d0a61dae4fd None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:58.119346 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b63d2b-d727-43a2-86b4-0d0a61dae4fd None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:58.120047 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b63d2b-d727-43a2-86b4-0d0a61dae4fd None admin] PATH_INFO: `/v3/projects/a67dea7cdf8d4c61b2758c16712e9c38` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:58.121748 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b63d2b-d727-43a2-86b4-0d0a61dae4fd None admin] RBAC: Authorizing `identity:get_project(project_id=a67dea7cdf8d4c61b2758c16712e9c38)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:58.123390 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b63d2b-d727-43a2-86b4-0d0a61dae4fd None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:58.125588 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 160/317] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Sep 24 19:37:57 2022] GET /identity/v3/projects/a67dea7cdf8d4c61b2758c16712e9c38 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:58.137548 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276fef83-5ef1-4c32-a741-52d89a4a06dc None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:58.179984 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:58.235619 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276fef83-5ef1-4c32-a741-52d89a4a06dc None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:58.273447 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad9968-d478-41b8-abc7-2d853e211226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:58.274104 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad9968-d478-41b8-abc7-2d853e211226 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:58.274427 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad9968-d478-41b8-abc7-2d853e211226 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:58.274703 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad9968-d478-41b8-abc7-2d853e211226 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:58.275445 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ad9968-d478-41b8-abc7-2d853e211226 None admin] RBAC: Adding query filter params (role.id=632e24cff8a04bd598fbbb3b41c62218, scope.project.id=a67dea7cdf8d4c61b2758c16712e9c38, user.id=b4fa40a0e7614a98904ddea68693d426) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:37:58.275754 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ad9968-d478-41b8-abc7-2d853e211226 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:58.277209 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ad9968-d478-41b8-abc7-2d853e211226 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:58.283750 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 158/318] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Sep 24 19:37:58 2022] GET /identity/v3/role_assignments?user.id=b4fa40a0e7614a98904ddea68693d426&scope.project.id=a67dea7cdf8d4c61b2758c16712e9c38&role.id=632e24cff8a04bd598fbbb3b41c62218 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:37:58.914101 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ed2e3-9dfa-4088-af89-09fc7f7fada1 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:58.914660 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ed2e3-9dfa-4088-af89-09fc7f7fada1 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:58.914660 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ed2e3-9dfa-4088-af89-09fc7f7fada1 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:58.916197 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 161/319] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:37:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:37:58.921669 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf020aa3-44fd-492d-8e16-33cd8dacbbb6 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:58.922191 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf020aa3-44fd-492d-8e16-33cd8dacbbb6 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:58.922191 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf020aa3-44fd-492d-8e16-33cd8dacbbb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:58.941721 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-cf020aa3-44fd-492d-8e16-33cd8dacbbb6 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:37:58.942833 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-cf020aa3-44fd-492d-8e16-33cd8dacbbb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:37:58.999768 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48a550-23e0-43af-a00a-c8ef3e32bb06 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:59.000083 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48a550-23e0-43af-a00a-c8ef3e32bb06 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:59.000301 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48a550-23e0-43af-a00a-c8ef3e32bb06 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:59.002030 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 162/320] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:37:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:37:59.009080 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90bf83e-5668-4d15-a48a-c50109a85c2a None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:59.009365 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90bf83e-5668-4d15-a48a-c50109a85c2a None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:59.009649 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90bf83e-5668-4d15-a48a-c50109a85c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:59.029572 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 159/321] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:37:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:37:59.038866 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-e90bf83e-5668-4d15-a48a-c50109a85c2a None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:37:59.040078 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-e90bf83e-5668-4d15-a48a-c50109a85c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:37:59.110046 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 163/322] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:37:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:37:59.300706 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf020aa3-44fd-492d-8e16-33cd8dacbbb6 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:59.345373 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:59.380098 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90bf83e-5668-4d15-a48a-c50109a85c2a None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:59.411538 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf020aa3-44fd-492d-8e16-33cd8dacbbb6 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:59.455827 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af62d70-03c4-46f3-a924-7c9afe858790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:59.456468 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af62d70-03c4-46f3-a924-7c9afe858790 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:59.456745 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af62d70-03c4-46f3-a924-7c9afe858790 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:59.457017 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af62d70-03c4-46f3-a924-7c9afe858790 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:59.468843 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af62d70-03c4-46f3-a924-7c9afe858790 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:37:59.474193 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-3af62d70-03c4-46f3-a924-7c9afe858790 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 19:37:59.474193 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:37:59.474193 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:37:59.474193 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:37:59.474193 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:37:59.474193 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:37:59.474193 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:37:59.474193 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:37:59.474193 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:37:59.474193 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:37:59.474193 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:37:59.474193 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:37:59.474193 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:37:59.474193 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:37:59.474193 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:37:59.474193 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:37:59.476035 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:37:59.476035 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:37:59.476035 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:37:59.476035 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:37:59.476035 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:37:59.476035 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:37:59.476035 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:37:59.476035 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:37:59.476035 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:37:59.476035 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:37:59.476035 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:37:59.476035 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:37:59.476035 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:37:59.476035 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:37:59.476035 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:37:59.476035 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:37:59.476834 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:37:59.476834 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:37:59.476834 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:37:59.476834 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:37:59.476834 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:37:59.476834 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:37:59.476834 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:37:59.476834 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:37:59.476834 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:37:59.476834 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:37:59.476834 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 19:37:59.476834 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:37:59.476834 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 160/323] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Sep 24 19:37:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:37:59.480568 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:59.482328 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af62d70-03c4-46f3-a924-7c9afe858790 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:59.505543 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90bf83e-5668-4d15-a48a-c50109a85c2a None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:59.547456 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d46fbf-7ed1-4cda-8488-a9a67002fc4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:59.548401 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d46fbf-7ed1-4cda-8488-a9a67002fc4c None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:59.548678 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d46fbf-7ed1-4cda-8488-a9a67002fc4c None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:59.548948 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d46fbf-7ed1-4cda-8488-a9a67002fc4c None admin] PATH_INFO: `/v3/domains/default` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:59.550096 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d46fbf-7ed1-4cda-8488-a9a67002fc4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:59.551593 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d46fbf-7ed1-4cda-8488-a9a67002fc4c None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:59.553849 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 164/324] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:37:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:37:59.559612 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d46fbf-7ed1-4cda-8488-a9a67002fc4c None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:59.604432 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:59.610255 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af62d70-03c4-46f3-a924-7c9afe858790 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:59.654665 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d2eb23-b1bb-4d2c-bd52-fcfff0d8c54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:59.655274 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2eb23-b1bb-4d2c-bd52-fcfff0d8c54c None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:59.655539 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2eb23-b1bb-4d2c-bd52-fcfff0d8c54c None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:59.655818 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2eb23-b1bb-4d2c-bd52-fcfff0d8c54c None admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:59.656471 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d2eb23-b1bb-4d2c-bd52-fcfff0d8c54c None admin] RBAC: Adding query filter params (name=reader) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:37:59.656774 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d2eb23-b1bb-4d2c-bd52-fcfff0d8c54c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:59.658179 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d2eb23-b1bb-4d2c-bd52-fcfff0d8c54c None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:59.668079 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 161/325] 10.222.0.60 () {56 vars in 1101 bytes} [Sat Sep 24 19:37:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:37:59.674115 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d2eb23-b1bb-4d2c-bd52-fcfff0d8c54c None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:59.682006 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d46fbf-7ed1-4cda-8488-a9a67002fc4c None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:59.725439 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d0e8a-1621-4864-9e89-0b1d62a6aeab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:59.726107 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d0e8a-1621-4864-9e89-0b1d62a6aeab None admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:59.726386 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d0e8a-1621-4864-9e89-0b1d62a6aeab None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:59.726659 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d0e8a-1621-4864-9e89-0b1d62a6aeab None admin] PATH_INFO: `/v3/groups` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:59.727310 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4d0e8a-1621-4864-9e89-0b1d62a6aeab None admin] RBAC: Authorizing `identity:create_group()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:59.728861 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4d0e8a-1621-4864-9e89-0b1d62a6aeab None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:59.795148 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d2eb23-b1bb-4d2c-bd52-fcfff0d8c54c None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:59.830732 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b342a6f-f4a8-4408-a0cc-42904c059206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:59.831274 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b342a6f-f4a8-4408-a0cc-42904c059206 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:59.831552 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b342a6f-f4a8-4408-a0cc-42904c059206 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:59.831900 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b342a6f-f4a8-4408-a0cc-42904c059206 None admin] PATH_INFO: `/v3/users/c31733c37d9d40edbc1604ea7aea3c7e` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:59.833068 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b342a6f-f4a8-4408-a0cc-42904c059206 None admin] RBAC: Authorizing `identity:get_user(user_id=c31733c37d9d40edbc1604ea7aea3c7e)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:59.834823 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b342a6f-f4a8-4408-a0cc-42904c059206 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:59.836409 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 162/326] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Sep 24 19:37:59 2022] GET /identity/v3/users/c31733c37d9d40edbc1604ea7aea3c7e => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:37:59.841694 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 165/327] 10.222.0.60 () {60 vars in 1134 bytes} [Sat Sep 24 19:37:59 2022] POST /identity/v3/groups => generated 226 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 19:37:59.841777 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efef55-28d8-4dd4-a922-203f2e996fea None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:59.841777 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efef55-28d8-4dd4-a922-203f2e996fea None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:59.841777 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efef55-28d8-4dd4-a922-203f2e996fea None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:59.841777 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 163/328] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:37:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:37:59.842718 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d0e8a-1621-4864-9e89-0b1d62a6aeab None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:59.845305 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfde96f-29c9-4ab1-a4b9-808878dcafa4 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:59.845532 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfde96f-29c9-4ab1-a4b9-808878dcafa4 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:59.851929 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfde96f-29c9-4ab1-a4b9-808878dcafa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:59.856452 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:59.872454 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-dcfde96f-29c9-4ab1-a4b9-808878dcafa4 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:37:59.873989 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-dcfde96f-29c9-4ab1-a4b9-808878dcafa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:37:59.904236 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:59.956864 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 164/329] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:37:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 19:37:59.979357 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d0e8a-1621-4864-9e89-0b1d62a6aeab None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:00.018495 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03895918-cd09-4779-9760-e67705909615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:00.019451 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03895918-cd09-4779-9760-e67705909615 None admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:00.019886 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03895918-cd09-4779-9760-e67705909615 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:00.020300 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03895918-cd09-4779-9760-e67705909615 None admin] PATH_INFO: `/v3/system/users/c31733c37d9d40edbc1604ea7aea3c7e/roles/632e24cff8a04bd598fbbb3b41c62218` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:00.022512 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03895918-cd09-4779-9760-e67705909615 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c31733c37d9d40edbc1604ea7aea3c7e, role_id=632e24cff8a04bd598fbbb3b41c62218)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:00.024200 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03895918-cd09-4779-9760-e67705909615 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:00.084328 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 166/330] 10.222.0.60 () {58 vars in 1334 bytes} [Sat Sep 24 19:37:59 2022] PUT /identity/v3/system/users/c31733c37d9d40edbc1604ea7aea3c7e/roles/632e24cff8a04bd598fbbb3b41c62218 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:38:00.269392 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfde96f-29c9-4ab1-a4b9-808878dcafa4 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:00.386629 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfde96f-29c9-4ab1-a4b9-808878dcafa4 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:00.425610 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64082907-71fb-42ea-b706-586784763122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:00.426613 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64082907-71fb-42ea-b706-586784763122 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:00.427111 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64082907-71fb-42ea-b706-586784763122 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:00.427796 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64082907-71fb-42ea-b706-586784763122 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:00.440277 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64082907-71fb-42ea-b706-586784763122 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:38:00.446658 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-64082907-71fb-42ea-b706-586784763122 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:38:00.446658 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:00.446658 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:00.446658 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:00.446658 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:00.446658 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:00.446658 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:00.446658 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:00.446658 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:00.446658 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:00.446658 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:00.446658 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:00.446658 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:38:00.446658 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:38:00.446658 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:38:00.446658 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:38:00.447600 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:38:00.447600 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:38:00.447600 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:38:00.447600 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:38:00.447600 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:00.447600 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:00.447600 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:00.447600 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:00.447600 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:00.447600 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:00.447600 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:00.447600 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:00.447600 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:00.447600 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:00.447600 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:00.447600 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:00.448381 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:00.448381 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:00.448381 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:00.448381 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:00.448381 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:38:00.448381 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:38:00.448381 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:38:00.448381 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:38:00.448381 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:38:00.448381 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:38:00.448381 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:38:00.448381 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:00.451026 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 165/331] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Sep 24 19:38:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:00.457176 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03895918-cd09-4779-9760-e67705909615 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:00.541053 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:00.581388 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03895918-cd09-4779-9760-e67705909615 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:00.624578 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467faee-05d1-4540-9829-e3d346f64788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:00.625613 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467faee-05d1-4540-9829-e3d346f64788 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:00.626083 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467faee-05d1-4540-9829-e3d346f64788 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:00.626592 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467faee-05d1-4540-9829-e3d346f64788 None admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:00.627501 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e467faee-05d1-4540-9829-e3d346f64788 None admin] RBAC: Adding query filter params (name=member) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:00.628043 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e467faee-05d1-4540-9829-e3d346f64788 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:00.629850 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e467faee-05d1-4540-9829-e3d346f64788 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:00.643547 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 167/332] 10.222.0.60 () {56 vars in 1101 bytes} [Sat Sep 24 19:38:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:00.651275 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64082907-71fb-42ea-b706-586784763122 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:00.707901 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:00.856167 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64082907-71fb-42ea-b706-586784763122 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:00.906071 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b4d58-2a80-4531-bd2f-72dac5a9021b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:00.906644 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b4d58-2a80-4531-bd2f-72dac5a9021b None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:00.906926 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b4d58-2a80-4531-bd2f-72dac5a9021b None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:00.907200 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b4d58-2a80-4531-bd2f-72dac5a9021b None admin] PATH_INFO: `/v3/users/28a3dab1cce646dda12250bab1138205` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:00.908416 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b4d58-2a80-4531-bd2f-72dac5a9021b None admin] RBAC: Authorizing `identity:get_user(user_id=28a3dab1cce646dda12250bab1138205)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:00.909923 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b4d58-2a80-4531-bd2f-72dac5a9021b None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:00.911945 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 166/333] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Sep 24 19:38:00 2022] GET /identity/v3/users/28a3dab1cce646dda12250bab1138205 => generated 293 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:00.917958 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467faee-05d1-4540-9829-e3d346f64788 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:01.160421 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467faee-05d1-4540-9829-e3d346f64788 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:01.207820 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e365ae01-b29e-4d03-b94f-55567a68b047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:01.208441 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365ae01-b29e-4d03-b94f-55567a68b047 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:01.209314 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365ae01-b29e-4d03-b94f-55567a68b047 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:01.209633 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365ae01-b29e-4d03-b94f-55567a68b047 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:01.210408 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e365ae01-b29e-4d03-b94f-55567a68b047 None admin] RBAC: Adding query filter params (role.id=3dfa1e29c6a0404388d256728d66e4a1, user.id=28a3dab1cce646dda12250bab1138205, scope.system=all) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:01.210713 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e365ae01-b29e-4d03-b94f-55567a68b047 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:01.212161 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e365ae01-b29e-4d03-b94f-55567a68b047 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:01.213945 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:01.231324 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 168/334] 10.222.0.60 () {56 vars in 1308 bytes} [Sat Sep 24 19:38:00 2022] GET /identity/v3/role_assignments?user.id=28a3dab1cce646dda12250bab1138205&scope.system=all&role.id=3dfa1e29c6a0404388d256728d66e4a1 => generated 510 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:02.709012 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50fdc3e-14eb-4fab-a7a2-cb53f6e03d7c None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:02.710029 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50fdc3e-14eb-4fab-a7a2-cb53f6e03d7c None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:02.710029 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50fdc3e-14eb-4fab-a7a2-cb53f6e03d7c None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:02.711370 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 167/335] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:38:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:38:02.716666 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b323d-19fe-42c2-af30-cfc77dc7088d None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:02.717232 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b323d-19fe-42c2-af30-cfc77dc7088d None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:02.717232 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b323d-19fe-42c2-af30-cfc77dc7088d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:02.738897 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-168b323d-19fe-42c2-af30-cfc77dc7088d None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:38:02.740714 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-168b323d-19fe-42c2-af30-cfc77dc7088d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:38:02.815231 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 169/336] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:38:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:38:02.841251 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d328a15-a289-4db3-9f71-204a2c23af52 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:02.841890 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d328a15-a289-4db3-9f71-204a2c23af52 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:02.842390 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d328a15-a289-4db3-9f71-204a2c23af52 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:02.844286 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 168/337] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:38:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:38:02.856117 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3acfcf-3b4f-4594-9524-99a68baf93ce None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:02.856415 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3acfcf-3b4f-4594-9524-99a68baf93ce None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:02.856662 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3acfcf-3b4f-4594-9524-99a68baf93ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:02.880115 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-cc3acfcf-3b4f-4594-9524-99a68baf93ce None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:38:02.881963 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-cc3acfcf-3b4f-4594-9524-99a68baf93ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:38:02.971604 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 170/338] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:38:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:38:03.368736 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444c741-a2fd-4ee9-8b77-5d588c6ebc6b None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:03.369115 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444c741-a2fd-4ee9-8b77-5d588c6ebc6b None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:03.369301 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444c741-a2fd-4ee9-8b77-5d588c6ebc6b None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:03.370945 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 169/339] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:38:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:38:03.376682 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbecad2a-de56-4c11-8c44-809311690dad None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:03.376964 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbecad2a-de56-4c11-8c44-809311690dad None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:03.377237 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbecad2a-de56-4c11-8c44-809311690dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:03.390845 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444c741-a2fd-4ee9-8b77-5d588c6ebc6b None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:03.405044 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-cbecad2a-de56-4c11-8c44-809311690dad None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:38:03.406286 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-cbecad2a-de56-4c11-8c44-809311690dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:38:03.500203 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:03.531263 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 171/340] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:38:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 19:38:03.542355 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbecad2a-de56-4c11-8c44-809311690dad None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:03.565465 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:03.602458 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444c741-a2fd-4ee9-8b77-5d588c6ebc6b None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:03.673644 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec34b0cc-7b98-4418-9457-b4524084bef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:03.673644 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34b0cc-7b98-4418-9457-b4524084bef5 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:03.673891 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34b0cc-7b98-4418-9457-b4524084bef5 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:03.674067 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34b0cc-7b98-4418-9457-b4524084bef5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:03.697304 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec34b0cc-7b98-4418-9457-b4524084bef5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:38:03.702359 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-ec34b0cc-7b98-4418-9457-b4524084bef5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 19:38:03.702359 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:03.702359 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:03.702359 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:03.702359 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:03.702359 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:03.702359 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:03.702359 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:03.702359 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:03.702359 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:03.702359 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:03.702359 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:03.702359 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:38:03.702359 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:38:03.702359 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:38:03.702359 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:38:03.703262 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:38:03.703262 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:38:03.703262 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:38:03.703262 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:38:03.703262 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:03.703262 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:03.703262 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:03.703262 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:03.703262 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:03.703262 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:03.703262 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:03.703262 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:03.703262 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:03.703262 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:03.703262 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:03.703262 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:03.704065 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:03.704065 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:03.704065 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:03.704065 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:03.704065 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:38:03.704065 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:38:03.704065 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:38:03.704065 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:38:03.704065 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:38:03.704065 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:38:03.704065 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 19:38:03.704065 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:03.704065 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 170/341] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Sep 24 19:38:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:38:03.712112 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec34b0cc-7b98-4418-9457-b4524084bef5 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:03.807334 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbecad2a-de56-4c11-8c44-809311690dad None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:03.845262 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec34b0cc-7b98-4418-9457-b4524084bef5 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:03.869555 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8216f57-31d2-4388-badd-67131f48ca59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:03.870214 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8216f57-31d2-4388-badd-67131f48ca59 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:03.870593 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8216f57-31d2-4388-badd-67131f48ca59 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:03.870865 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8216f57-31d2-4388-badd-67131f48ca59 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:03.882485 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ca503e-fca6-4ded-ad6c-194134660f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:03.883360 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca503e-fca6-4ded-ad6c-194134660f63 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:03.883635 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca503e-fca6-4ded-ad6c-194134660f63 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:03.883905 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca503e-fca6-4ded-ad6c-194134660f63 None admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:03.884572 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ca503e-fca6-4ded-ad6c-194134660f63 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:03.884685 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8216f57-31d2-4388-badd-67131f48ca59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:38:03.884871 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ca503e-fca6-4ded-ad6c-194134660f63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:03.886279 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ca503e-fca6-4ded-ad6c-194134660f63 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:03.894068 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-c8216f57-31d2-4388-badd-67131f48ca59 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:38:03.894068 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:03.894068 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:03.894068 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:03.894068 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:03.894068 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:03.894068 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:03.894068 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:03.894068 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:03.894068 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:03.894068 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:03.894068 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:03.894068 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:38:03.894068 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:38:03.894068 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:38:03.894068 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:38:03.894995 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:38:03.894995 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:38:03.894995 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:38:03.894995 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:38:03.894995 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:03.894995 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:03.894995 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:03.894995 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:03.894995 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:03.894995 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:03.894995 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:03.894995 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:03.894995 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:03.894995 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:03.894995 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:03.894995 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:03.895766 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:03.895766 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:03.895766 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:03.895766 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:03.895766 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:38:03.895766 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:38:03.895766 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:38:03.895766 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:38:03.895766 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:38:03.895766 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:38:03.895766 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:38:03.895766 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:03.898475 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 171/342] 10.222.0.60 () {56 vars in 1101 bytes} [Sat Sep 24 19:38:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:03.900757 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 172/343] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Sep 24 19:38:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:03.902004 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ca503e-fca6-4ded-ad6c-194134660f63 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:03.902836 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8216f57-31d2-4388-badd-67131f48ca59 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:03.923198 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:03.981964 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:04.046485 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8216f57-31d2-4388-badd-67131f48ca59 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:04.066495 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ca503e-fca6-4ded-ad6c-194134660f63 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:04.093543 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ee0a3-f2b7-4825-9e2a-b0fca0bd834e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:04.094194 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ee0a3-f2b7-4825-9e2a-b0fca0bd834e None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:04.094475 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ee0a3-f2b7-4825-9e2a-b0fca0bd834e None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:04.094744 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ee0a3-f2b7-4825-9e2a-b0fca0bd834e None admin] PATH_INFO: `/v3/users/c31733c37d9d40edbc1604ea7aea3c7e` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:04.096021 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083ee0a3-f2b7-4825-9e2a-b0fca0bd834e None admin] RBAC: Authorizing `identity:get_user(user_id=c31733c37d9d40edbc1604ea7aea3c7e)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:04.097604 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083ee0a3-f2b7-4825-9e2a-b0fca0bd834e None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:04.100007 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 173/344] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Sep 24 19:38:03 2022] GET /identity/v3/users/c31733c37d9d40edbc1604ea7aea3c7e => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:38:04.100860 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ee0a3-f2b7-4825-9e2a-b0fca0bd834e None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:04.110511 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37534adf-8ab7-4457-9dd5-8562e3a3855d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:04.111216 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37534adf-8ab7-4457-9dd5-8562e3a3855d None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:04.111557 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37534adf-8ab7-4457-9dd5-8562e3a3855d None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:04.111890 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37534adf-8ab7-4457-9dd5-8562e3a3855d None admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:04.112627 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37534adf-8ab7-4457-9dd5-8562e3a3855d None admin] RBAC: Adding query filter params (name=member) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:04.112996 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37534adf-8ab7-4457-9dd5-8562e3a3855d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:04.114575 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37534adf-8ab7-4457-9dd5-8562e3a3855d None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:04.125367 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 172/345] 10.222.0.60 () {56 vars in 1101 bytes} [Sat Sep 24 19:38:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:04.126875 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652a652-418e-4694-83d3-941c52b5e1c4 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:04.127160 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652a652-418e-4694-83d3-941c52b5e1c4 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:04.127430 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652a652-418e-4694-83d3-941c52b5e1c4 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:04.128669 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 173/346] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:38:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:38:04.129379 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652a652-418e-4694-83d3-941c52b5e1c4 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:04.226881 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:04.237532 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ee0a3-f2b7-4825-9e2a-b0fca0bd834e None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:04.254311 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:04.263558 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652a652-418e-4694-83d3-941c52b5e1c4 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:04.279756 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb4ab4c-1466-489a-ac0a-9012210a05ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:04.280389 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4ab4c-1466-489a-ac0a-9012210a05ab None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:04.280661 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4ab4c-1466-489a-ac0a-9012210a05ab None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:04.280928 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4ab4c-1466-489a-ac0a-9012210a05ab None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:04.293570 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb4ab4c-1466-489a-ac0a-9012210a05ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:38:04.298733 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-0fb4ab4c-1466-489a-ac0a-9012210a05ab None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:38:04.298733 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:04.298733 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:04.298733 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:04.298733 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:04.298733 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:04.298733 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:04.298733 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:04.298733 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:04.298733 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:04.298733 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:04.298733 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:04.298733 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:38:04.298733 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:38:04.298733 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:38:04.298733 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:38:04.299674 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:38:04.299674 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:38:04.299674 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:38:04.299674 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:38:04.299674 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:04.299674 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:04.299674 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:04.299674 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:04.299674 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:04.299674 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:04.299674 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:04.299674 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:04.299674 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:04.299674 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:04.299674 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:04.299674 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:04.301041 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:04.301041 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:04.301041 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:04.301041 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:04.301041 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:38:04.301041 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:38:04.301041 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:38:04.301041 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:38:04.301041 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:38:04.301041 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:38:04.301041 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:38:04.301041 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:04.301041 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 174/347] 10.222.0.60 () {56 vars in 1114 bytes} [Sat Sep 24 19:38:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:04.301971 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb4ab4c-1466-489a-ac0a-9012210a05ab None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:04.319604 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68527258-b161-4ef9-962b-e0e74344e413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:04.320269 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68527258-b161-4ef9-962b-e0e74344e413 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:04.320550 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68527258-b161-4ef9-962b-e0e74344e413 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:04.320969 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68527258-b161-4ef9-962b-e0e74344e413 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:04.322323 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68527258-b161-4ef9-962b-e0e74344e413 None admin] RBAC: Adding query filter params (role.id=632e24cff8a04bd598fbbb3b41c62218, user.id=c31733c37d9d40edbc1604ea7aea3c7e, scope.system=all) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:04.322861 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68527258-b161-4ef9-962b-e0e74344e413 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:04.325126 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68527258-b161-4ef9-962b-e0e74344e413 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:04.340986 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 174/348] 10.222.0.60 () {56 vars in 1308 bytes} [Sat Sep 24 19:38:04 2022] GET /identity/v3/role_assignments?user.id=c31733c37d9d40edbc1604ea7aea3c7e&scope.system=all&role.id=632e24cff8a04bd598fbbb3b41c62218 => generated 510 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:04.343041 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8710685-ad89-4db9-809c-831f85606a5a None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:04.343377 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8710685-ad89-4db9-809c-831f85606a5a None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:04.343653 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8710685-ad89-4db9-809c-831f85606a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:04.382929 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-f8710685-ad89-4db9-809c-831f85606a5a None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:38:04.384315 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-f8710685-ad89-4db9-809c-831f85606a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:38:04.437942 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb4ab4c-1466-489a-ac0a-9012210a05ab None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:04.481524 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed1fa0-1053-4fbc-8450-2f3acbf92142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:04.481524 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed1fa0-1053-4fbc-8450-2f3acbf92142 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:04.481524 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed1fa0-1053-4fbc-8450-2f3acbf92142 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:04.481524 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed1fa0-1053-4fbc-8450-2f3acbf92142 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:04.525264 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:04.531204 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 175/349] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:38:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:38:04.532204 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8710685-ad89-4db9-809c-831f85606a5a None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:04.582208 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed1fa0-1053-4fbc-8450-2f3acbf92142 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:04.586180 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed1fa0-1053-4fbc-8450-2f3acbf92142 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:04.651106 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:04.730323 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8710685-ad89-4db9-809c-831f85606a5a None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:04.792263 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 175/350] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Sep 24 19:38:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:38:04.798753 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed1fa0-1053-4fbc-8450-2f3acbf92142 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:04.802751 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aafac77-5bf5-4ae3-a807-d814e2f6c0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:04.803739 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafac77-5bf5-4ae3-a807-d814e2f6c0d8 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:04.803897 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafac77-5bf5-4ae3-a807-d814e2f6c0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:04.804123 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafac77-5bf5-4ae3-a807-d814e2f6c0d8 None admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:04.804759 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aafac77-5bf5-4ae3-a807-d814e2f6c0d8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:04.805059 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aafac77-5bf5-4ae3-a807-d814e2f6c0d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:04.807488 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aafac77-5bf5-4ae3-a807-d814e2f6c0d8 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:04.818416 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 176/351] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Sep 24 19:38:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:04.827146 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aafac77-5bf5-4ae3-a807-d814e2f6c0d8 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:04.961291 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:05.002769 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed1fa0-1053-4fbc-8450-2f3acbf92142 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:05.008398 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aafac77-5bf5-4ae3-a807-d814e2f6c0d8 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:05.044800 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bee240-f0a8-404e-8a09-93a3ca7d6694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:05.046208 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bee240-f0a8-404e-8a09-93a3ca7d6694 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:05.046654 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bee240-f0a8-404e-8a09-93a3ca7d6694 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:05.047077 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bee240-f0a8-404e-8a09-93a3ca7d6694 None admin] PATH_INFO: `/v3/projects/3363e1213c7f49a4bccd9116d9d698d0` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:05.048434 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bee240-f0a8-404e-8a09-93a3ca7d6694 None admin] RBAC: Authorizing `identity:get_project(project_id=3363e1213c7f49a4bccd9116d9d698d0)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:05.050099 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bee240-f0a8-404e-8a09-93a3ca7d6694 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:05.052955 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 176/352] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Sep 24 19:38:04 2022] GET /identity/v3/projects/3363e1213c7f49a4bccd9116d9d698d0 => generated 298 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:05.058465 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bee240-f0a8-404e-8a09-93a3ca7d6694 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:05.059472 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:05.094862 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8687ef5e-638b-4e35-996d-4a6e5fd9b05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:05.095500 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687ef5e-638b-4e35-996d-4a6e5fd9b05f None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:05.095783 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687ef5e-638b-4e35-996d-4a6e5fd9b05f None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:05.096059 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687ef5e-638b-4e35-996d-4a6e5fd9b05f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:05.195318 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8687ef5e-638b-4e35-996d-4a6e5fd9b05f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:05.197724 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8687ef5e-638b-4e35-996d-4a6e5fd9b05f None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:05.201079 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bee240-f0a8-404e-8a09-93a3ca7d6694 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:05.263935 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db464b-1795-4d6e-9ce3-d1e61ee6b9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:05.264589 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db464b-1795-4d6e-9ce3-d1e61ee6b9bd None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:05.264869 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db464b-1795-4d6e-9ce3-d1e61ee6b9bd None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:05.265138 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db464b-1795-4d6e-9ce3-d1e61ee6b9bd None admin] PATH_INFO: `/v3/groups/a1a236ee4b9e491da4269d2522fbbac3` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:05.276758 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91db464b-1795-4d6e-9ce3-d1e61ee6b9bd None admin] RBAC: Authorizing `identity:get_group(group_id=a1a236ee4b9e491da4269d2522fbbac3)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:05.278301 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91db464b-1795-4d6e-9ce3-d1e61ee6b9bd None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:05.280372 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 177/353] 10.222.0.60 () {56 vars in 1180 bytes} [Sat Sep 24 19:38:05 2022] GET /identity/v3/groups/a1a236ee4b9e491da4269d2522fbbac3 => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:05.281124 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db464b-1795-4d6e-9ce3-d1e61ee6b9bd None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:05.288944 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:05.359198 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 177/354] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Sep 24 19:38:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:38:05.360215 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a734e89-b0ee-400e-8599-76b677580c75 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:05.360498 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a734e89-b0ee-400e-8599-76b677580c75 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:05.361004 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a734e89-b0ee-400e-8599-76b677580c75 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:05.362229 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 178/355] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:38:05.368481 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a734e89-b0ee-400e-8599-76b677580c75 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:05.409099 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:05.437384 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db464b-1795-4d6e-9ce3-d1e61ee6b9bd None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:05.485237 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e207543e-f2f0-4f59-bf9e-b6a4232d527b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:05.486177 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207543e-f2f0-4f59-bf9e-b6a4232d527b None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:05.486594 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207543e-f2f0-4f59-bf9e-b6a4232d527b None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:05.487001 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207543e-f2f0-4f59-bf9e-b6a4232d527b None admin] PATH_INFO: `/v3/roles/member` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:05.502911 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e207543e-f2f0-4f59-bf9e-b6a4232d527b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:38:05.509614 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-e207543e-f2f0-4f59-bf9e-b6a4232d527b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:38:05.509614 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:05.509614 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:05.509614 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:05.509614 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:05.509614 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:05.509614 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:05.509614 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:05.509614 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:05.509614 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:05.509614 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:05.509614 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:05.509614 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:38:05.509614 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:38:05.509614 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:38:05.509614 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:38:05.510558 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:38:05.510558 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:38:05.510558 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:38:05.510558 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:38:05.510558 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:05.510558 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:05.510558 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:05.510558 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:05.510558 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:05.510558 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:05.510558 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:05.510558 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:05.510558 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:05.510558 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:05.510558 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:05.510558 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:05.511363 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:05.511363 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:05.511363 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:05.511363 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:05.511363 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:38:05.511363 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:38:05.511363 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:38:05.511363 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:38:05.511363 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:38:05.511363 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:38:05.511363 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:38:05.511363 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:05.511363 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 178/356] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Sep 24 19:38:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:05.514353 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e207543e-f2f0-4f59-bf9e-b6a4232d527b None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:05.520138 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a734e89-b0ee-400e-8599-76b677580c75 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:05.574656 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dc8f78-6961-466f-a74f-6463f85f37cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:05.575272 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc8f78-6961-466f-a74f-6463f85f37cb None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:05.575552 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc8f78-6961-466f-a74f-6463f85f37cb None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:05.575818 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc8f78-6961-466f-a74f-6463f85f37cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:05.576620 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dc8f78-6961-466f-a74f-6463f85f37cb None admin] RBAC: Adding query filter params (group.id=a1a236ee4b9e491da4269d2522fbbac3, role.id=3dfa1e29c6a0404388d256728d66e4a1, scope.project.id=3363e1213c7f49a4bccd9116d9d698d0) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:05.576931 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dc8f78-6961-466f-a74f-6463f85f37cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:05.578407 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dc8f78-6961-466f-a74f-6463f85f37cb None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:05.585879 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 179/357] 10.222.0.60 () {56 vars in 1376 bytes} [Sat Sep 24 19:38:05 2022] GET /identity/v3/role_assignments?group.id=a1a236ee4b9e491da4269d2522fbbac3&scope.project.id=3363e1213c7f49a4bccd9116d9d698d0&role.id=3dfa1e29c6a0404388d256728d66e4a1 => generated 260 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:05.587292 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88504a91-22c0-478e-ab07-91098d24c79a None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:05.587578 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88504a91-22c0-478e-ab07-91098d24c79a None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:05.587848 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88504a91-22c0-478e-ab07-91098d24c79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:05.610020 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-88504a91-22c0-478e-ab07-91098d24c79a None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:38:05.610667 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:05.611161 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-88504a91-22c0-478e-ab07-91098d24c79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:38:05.676304 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e207543e-f2f0-4f59-bf9e-b6a4232d527b None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:05.726451 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 180/358] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:38:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:38:05.727641 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c90127-8b8f-4092-8ac2-e45cb9210c69 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:05.727929 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c90127-8b8f-4092-8ac2-e45cb9210c69 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:05.728200 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c90127-8b8f-4092-8ac2-e45cb9210c69 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:05.730222 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 181/359] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:38:05.731277 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c90127-8b8f-4092-8ac2-e45cb9210c69 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:05.743059 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b115a582-a91c-4de5-bc19-ae14b684916c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:05.743714 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115a582-a91c-4de5-bc19-ae14b684916c None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:05.744107 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115a582-a91c-4de5-bc19-ae14b684916c None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:05.744387 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115a582-a91c-4de5-bc19-ae14b684916c None admin] PATH_INFO: `/v3/projects/3363e1213c7f49a4bccd9116d9d698d0` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:05.745766 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b115a582-a91c-4de5-bc19-ae14b684916c None admin] RBAC: Authorizing `identity:get_project(project_id=3363e1213c7f49a4bccd9116d9d698d0)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:05.747313 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b115a582-a91c-4de5-bc19-ae14b684916c None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:05.749454 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 179/360] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Sep 24 19:38:05 2022] GET /identity/v3/projects/3363e1213c7f49a4bccd9116d9d698d0 => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:05.750651 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca30846-c742-40a6-8d72-466dc5ea5e10 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:05.750939 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca30846-c742-40a6-8d72-466dc5ea5e10 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:05.751207 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca30846-c742-40a6-8d72-466dc5ea5e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:05.753047 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:05.774886 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-9ca30846-c742-40a6-8d72-466dc5ea5e10 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:38:05.776900 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-9ca30846-c742-40a6-8d72-466dc5ea5e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:38:05.885917 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 180/361] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:38:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:38:05.887806 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca30846-c742-40a6-8d72-466dc5ea5e10 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:05.893275 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c90127-8b8f-4092-8ac2-e45cb9210c69 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:05.975368 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebdaaa7-a11f-435f-95ea-302ab4ee80d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:05.975991 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebdaaa7-a11f-435f-95ea-302ab4ee80d5 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:05.976335 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebdaaa7-a11f-435f-95ea-302ab4ee80d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:05.976674 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebdaaa7-a11f-435f-95ea-302ab4ee80d5 None admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:05.977638 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebdaaa7-a11f-435f-95ea-302ab4ee80d5 None admin] RBAC: Adding query filter params (name=member) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:05.977747 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebdaaa7-a11f-435f-95ea-302ab4ee80d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:05.979182 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebdaaa7-a11f-435f-95ea-302ab4ee80d5 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:05.985151 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:05.999131 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 182/362] 10.222.0.60 () {56 vars in 1101 bytes} [Sat Sep 24 19:38:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:06.005041 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebdaaa7-a11f-435f-95ea-302ab4ee80d5 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:06.038241 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca30846-c742-40a6-8d72-466dc5ea5e10 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:06.082539 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a6ce1-4c94-484a-a31f-9cf065a402d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:06.083214 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a6ce1-4c94-484a-a31f-9cf065a402d5 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:06.083545 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a6ce1-4c94-484a-a31f-9cf065a402d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:06.083883 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a6ce1-4c94-484a-a31f-9cf065a402d5 None admin] PATH_INFO: `/v3/groups/a1a236ee4b9e491da4269d2522fbbac3` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:06.086259 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787a6ce1-4c94-484a-a31f-9cf065a402d5 None admin] RBAC: Authorizing `identity:get_group(group_id=a1a236ee4b9e491da4269d2522fbbac3)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:06.088887 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787a6ce1-4c94-484a-a31f-9cf065a402d5 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:06.091560 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 181/363] 10.222.0.60 () {56 vars in 1180 bytes} [Sat Sep 24 19:38:05 2022] GET /identity/v3/groups/a1a236ee4b9e491da4269d2522fbbac3 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:06.093534 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a6ce1-4c94-484a-a31f-9cf065a402d5 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:06.124068 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:06.154989 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebdaaa7-a11f-435f-95ea-302ab4ee80d5 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:06.214608 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d57e3-82f3-4d0e-b2ee-9673a448ccd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:06.215593 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d57e3-82f3-4d0e-b2ee-9673a448ccd8 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:06.216066 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d57e3-82f3-4d0e-b2ee-9673a448ccd8 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:06.216529 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d57e3-82f3-4d0e-b2ee-9673a448ccd8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:06.266854 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a6ce1-4c94-484a-a31f-9cf065a402d5 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:06.298727 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:06.308769 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982d57e3-82f3-4d0e-b2ee-9673a448ccd8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:06.309388 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b160d8-f384-4d56-a058-cec2a7954b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:06.310150 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b160d8-f384-4d56-a058-cec2a7954b62 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:06.312232 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982d57e3-82f3-4d0e-b2ee-9673a448ccd8 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:06.312340 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b160d8-f384-4d56-a058-cec2a7954b62 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:06.312340 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b160d8-f384-4d56-a058-cec2a7954b62 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:06.326715 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b160d8-f384-4d56-a058-cec2a7954b62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:38:06.333982 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-b8b160d8-f384-4d56-a058-cec2a7954b62 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:38:06.333982 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:06.333982 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:06.333982 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:06.333982 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:06.333982 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:06.333982 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:06.333982 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:06.333982 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:06.333982 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:06.333982 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:06.333982 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:06.333982 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:38:06.333982 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:38:06.333982 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:38:06.333982 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:38:06.334935 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:38:06.334935 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:38:06.334935 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:38:06.334935 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:38:06.334935 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:06.334935 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:06.334935 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:06.334935 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:06.334935 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:06.334935 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:06.334935 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:06.334935 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:06.334935 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:06.334935 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:06.334935 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:06.334935 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:06.335731 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:06.335731 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:06.335731 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:06.335731 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:06.335731 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:38:06.335731 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:38:06.335731 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:38:06.335731 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:38:06.335731 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:38:06.335731 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:38:06.335731 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:38:06.335731 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:06.338658 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 182/364] 10.222.0.60 () {56 vars in 1114 bytes} [Sat Sep 24 19:38:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:06.339411 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b160d8-f384-4d56-a058-cec2a7954b62 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:06.421666 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:06.448898 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 183/365] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Sep 24 19:38:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:38:06.450281 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d57e3-82f3-4d0e-b2ee-9673a448ccd8 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:06.470376 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b160d8-f384-4d56-a058-cec2a7954b62 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:06.514781 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d8517c-0674-4469-9f74-0f6b1e9a6f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:06.515595 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8517c-0674-4469-9f74-0f6b1e9a6f98 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:06.515876 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8517c-0674-4469-9f74-0f6b1e9a6f98 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:06.516147 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8517c-0674-4469-9f74-0f6b1e9a6f98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:06.516875 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d8517c-0674-4469-9f74-0f6b1e9a6f98 None admin] RBAC: Adding query filter params (group.id=a1a236ee4b9e491da4269d2522fbbac3, role.id=dd695228990e4288afe29e3cefb75823, scope.project.id=3363e1213c7f49a4bccd9116d9d698d0) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:06.517181 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d8517c-0674-4469-9f74-0f6b1e9a6f98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:06.518675 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d8517c-0674-4469-9f74-0f6b1e9a6f98 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:06.527039 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 183/366] 10.222.0.60 () {56 vars in 1376 bytes} [Sat Sep 24 19:38:06 2022] GET /identity/v3/role_assignments?group.id=a1a236ee4b9e491da4269d2522fbbac3&scope.project.id=3363e1213c7f49a4bccd9116d9d698d0&role.id=dd695228990e4288afe29e3cefb75823 => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:06.528202 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d8517c-0674-4469-9f74-0f6b1e9a6f98 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:06.601890 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:06.614566 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d57e3-82f3-4d0e-b2ee-9673a448ccd8 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:06.665159 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de0448-7043-4e81-ad5e-89c834df2639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:06.665839 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de0448-7043-4e81-ad5e-89c834df2639 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:06.666184 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de0448-7043-4e81-ad5e-89c834df2639 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:06.666558 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de0448-7043-4e81-ad5e-89c834df2639 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:06.680822 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45de0448-7043-4e81-ad5e-89c834df2639 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:38:06.682230 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d8517c-0674-4469-9f74-0f6b1e9a6f98 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:06.686801 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-45de0448-7043-4e81-ad5e-89c834df2639 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:38:06.686801 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:06.686801 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:06.686801 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:06.686801 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:06.686801 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:06.686801 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:06.686801 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:06.686801 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:06.686801 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:06.686801 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:06.686801 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:06.686801 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:38:06.686801 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:38:06.686801 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:38:06.686801 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:38:06.687767 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:38:06.687767 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:38:06.687767 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:38:06.687767 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:38:06.687767 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:06.687767 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:06.687767 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:06.687767 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:06.687767 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:06.687767 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:06.687767 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:06.687767 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:06.687767 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:06.687767 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:06.687767 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:06.687767 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:06.688869 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:06.688869 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:06.688869 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:06.688869 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:06.688869 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:38:06.688869 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:38:06.688869 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:38:06.688869 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:38:06.688869 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:38:06.688869 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:38:06.688869 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:38:06.688869 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:06.688869 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 184/367] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Sep 24 19:38:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:06.692114 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de0448-7043-4e81-ad5e-89c834df2639 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:06.747236 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98d6fbc-80ea-4069-8b45-c69b8b639282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:06.748184 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d6fbc-80ea-4069-8b45-c69b8b639282 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:06.748465 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d6fbc-80ea-4069-8b45-c69b8b639282 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:06.748824 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d6fbc-80ea-4069-8b45-c69b8b639282 None admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:06.749636 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98d6fbc-80ea-4069-8b45-c69b8b639282 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:06.750039 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98d6fbc-80ea-4069-8b45-c69b8b639282 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:06.751541 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98d6fbc-80ea-4069-8b45-c69b8b639282 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:06.763334 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 184/368] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Sep 24 19:38:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:06.764328 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98d6fbc-80ea-4069-8b45-c69b8b639282 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:06.770676 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:06.846510 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de0448-7043-4e81-ad5e-89c834df2639 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:06.892533 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98d6fbc-80ea-4069-8b45-c69b8b639282 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:06.899653 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38cfc42-7b6e-44b4-b842-b487c913de66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:06.900308 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38cfc42-7b6e-44b4-b842-b487c913de66 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:06.900589 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38cfc42-7b6e-44b4-b842-b487c913de66 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:06.900863 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38cfc42-7b6e-44b4-b842-b487c913de66 None admin] PATH_INFO: `/v3/projects/a67dea7cdf8d4c61b2758c16712e9c38` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:06.902092 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38cfc42-7b6e-44b4-b842-b487c913de66 None admin] RBAC: Authorizing `identity:get_project(project_id=a67dea7cdf8d4c61b2758c16712e9c38)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:06.903554 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38cfc42-7b6e-44b4-b842-b487c913de66 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:06.906713 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 185/369] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Sep 24 19:38:06 2022] GET /identity/v3/projects/a67dea7cdf8d4c61b2758c16712e9c38 => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:06.907536 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38cfc42-7b6e-44b4-b842-b487c913de66 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:06.918057 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:06.944346 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71dea61-af70-4bcc-bf92-00ba32f43a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:06.944883 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71dea61-af70-4bcc-bf92-00ba32f43a3d None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:06.945158 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71dea61-af70-4bcc-bf92-00ba32f43a3d None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:06.946283 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71dea61-af70-4bcc-bf92-00ba32f43a3d None admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:06.947025 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71dea61-af70-4bcc-bf92-00ba32f43a3d None admin] RBAC: Adding query filter params (name=admin) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:06.947314 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71dea61-af70-4bcc-bf92-00ba32f43a3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:06.949006 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71dea61-af70-4bcc-bf92-00ba32f43a3d None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:06.960964 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 185/370] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Sep 24 19:38:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:06.961903 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71dea61-af70-4bcc-bf92-00ba32f43a3d None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:07.051455 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38cfc42-7b6e-44b4-b842-b487c913de66 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:07.061879 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:07.102246 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71dea61-af70-4bcc-bf92-00ba32f43a3d None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:07.102781 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a50d19-68aa-48ad-b984-ff38682043a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:07.105583 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a50d19-68aa-48ad-b984-ff38682043a5 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:07.105583 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a50d19-68aa-48ad-b984-ff38682043a5 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:07.105583 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a50d19-68aa-48ad-b984-ff38682043a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:07.147510 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b058725-0966-45aa-a6f8-f3a95dcc47de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:07.148689 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b058725-0966-45aa-a6f8-f3a95dcc47de None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:07.148951 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b058725-0966-45aa-a6f8-f3a95dcc47de None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:07.150837 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b058725-0966-45aa-a6f8-f3a95dcc47de None admin] PATH_INFO: `/v3/groups/a1a236ee4b9e491da4269d2522fbbac3` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:07.150837 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b058725-0966-45aa-a6f8-f3a95dcc47de None admin] RBAC: Authorizing `identity:get_group(group_id=a1a236ee4b9e491da4269d2522fbbac3)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:07.151966 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b058725-0966-45aa-a6f8-f3a95dcc47de None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:07.154162 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 186/371] 10.222.0.60 () {56 vars in 1180 bytes} [Sat Sep 24 19:38:06 2022] GET /identity/v3/groups/a1a236ee4b9e491da4269d2522fbbac3 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:07.154997 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b058725-0966-45aa-a6f8-f3a95dcc47de None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:07.209889 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a50d19-68aa-48ad-b984-ff38682043a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:07.209889 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a50d19-68aa-48ad-b984-ff38682043a5 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:07.231792 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:07.311949 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b058725-0966-45aa-a6f8-f3a95dcc47de None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:07.341741 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 186/372] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Sep 24 19:38:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:38:07.342906 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a50d19-68aa-48ad-b984-ff38682043a5 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:07.360007 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:07.363367 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a22dfa5-bf2b-4c62-b044-03b61692da43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:07.364449 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22dfa5-bf2b-4c62-b044-03b61692da43 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:07.365451 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22dfa5-bf2b-4c62-b044-03b61692da43 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:07.365975 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22dfa5-bf2b-4c62-b044-03b61692da43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:07.469666 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a22dfa5-bf2b-4c62-b044-03b61692da43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:07.471249 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a22dfa5-bf2b-4c62-b044-03b61692da43 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:07.483254 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a50d19-68aa-48ad-b984-ff38682043a5 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:07.530779 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:07.538534 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a620ffa-20c8-448f-acd6-bf167be09cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:07.539524 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a620ffa-20c8-448f-acd6-bf167be09cb2 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:07.539996 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a620ffa-20c8-448f-acd6-bf167be09cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:07.540507 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a620ffa-20c8-448f-acd6-bf167be09cb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:07.541682 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a620ffa-20c8-448f-acd6-bf167be09cb2 None admin] RBAC: Adding query filter params (group.id=a1a236ee4b9e491da4269d2522fbbac3, role.id=3dfa1e29c6a0404388d256728d66e4a1, scope.project.id=a67dea7cdf8d4c61b2758c16712e9c38) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:07.543138 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a620ffa-20c8-448f-acd6-bf167be09cb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:07.547016 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a620ffa-20c8-448f-acd6-bf167be09cb2 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:07.551554 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 187/373] 10.222.0.60 () {56 vars in 1376 bytes} [Sat Sep 24 19:38:07 2022] GET /identity/v3/role_assignments?group.id=a1a236ee4b9e491da4269d2522fbbac3&scope.project.id=a67dea7cdf8d4c61b2758c16712e9c38&role.id=3dfa1e29c6a0404388d256728d66e4a1 => generated 260 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:07.553323 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a620ffa-20c8-448f-acd6-bf167be09cb2 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:07.633435 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 187/374] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Sep 24 19:38:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:38:07.643119 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a22dfa5-bf2b-4c62-b044-03b61692da43 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:07.724777 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:07.788527 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a620ffa-20c8-448f-acd6-bf167be09cb2 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:07.810479 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a22dfa5-bf2b-4c62-b044-03b61692da43 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:07.845333 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff95239-1214-4adf-b167-1d7995e5cde8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:07.846383 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff95239-1214-4adf-b167-1d7995e5cde8 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:07.846858 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff95239-1214-4adf-b167-1d7995e5cde8 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:07.847322 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff95239-1214-4adf-b167-1d7995e5cde8 None admin] PATH_INFO: `/v3/projects/a67dea7cdf8d4c61b2758c16712e9c38` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:07.848805 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff95239-1214-4adf-b167-1d7995e5cde8 None admin] RBAC: Authorizing `identity:get_project(project_id=a67dea7cdf8d4c61b2758c16712e9c38)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:07.851530 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff95239-1214-4adf-b167-1d7995e5cde8 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:07.853480 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 188/375] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Sep 24 19:38:07 2022] GET /identity/v3/projects/a67dea7cdf8d4c61b2758c16712e9c38 => generated 302 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:07.859352 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf5568-9619-4fc1-b11f-a4c2cf654fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:07.859684 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff95239-1214-4adf-b167-1d7995e5cde8 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:07.860011 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf5568-9619-4fc1-b11f-a4c2cf654fd1 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:07.860291 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf5568-9619-4fc1-b11f-a4c2cf654fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:07.860561 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf5568-9619-4fc1-b11f-a4c2cf654fd1 None admin] PATH_INFO: `/v3/projects/1efc13c179384208b08c31d1589c351f` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:07.862022 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caf5568-9619-4fc1-b11f-a4c2cf654fd1 None admin] RBAC: Authorizing `identity:get_project(project_id=1efc13c179384208b08c31d1589c351f)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:07.863714 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caf5568-9619-4fc1-b11f-a4c2cf654fd1 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:07.866681 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 188/376] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Sep 24 19:38:07 2022] GET /identity/v3/projects/1efc13c179384208b08c31d1589c351f => generated 344 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:07.874767 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf5568-9619-4fc1-b11f-a4c2cf654fd1 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:07.899609 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:07.971900 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff95239-1214-4adf-b167-1d7995e5cde8 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:08.008650 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf5568-9619-4fc1-b11f-a4c2cf654fd1 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:08.011817 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c52a578-191a-4bf4-b77a-ee6ecec9ddea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:08.012704 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52a578-191a-4bf4-b77a-ee6ecec9ddea None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:08.013179 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52a578-191a-4bf4-b77a-ee6ecec9ddea None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:08.013676 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52a578-191a-4bf4-b77a-ee6ecec9ddea None admin] PATH_INFO: `/v3/groups/a1a236ee4b9e491da4269d2522fbbac3` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:08.015041 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c52a578-191a-4bf4-b77a-ee6ecec9ddea None admin] RBAC: Authorizing `identity:get_group(group_id=a1a236ee4b9e491da4269d2522fbbac3)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:08.016735 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c52a578-191a-4bf4-b77a-ee6ecec9ddea None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:08.018633 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 189/377] 10.222.0.60 () {56 vars in 1180 bytes} [Sat Sep 24 19:38:07 2022] GET /identity/v3/groups/a1a236ee4b9e491da4269d2522fbbac3 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:38:08.025062 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c52a578-191a-4bf4-b77a-ee6ecec9ddea None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:08.036010 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:08.048884 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb89c95-f95e-425d-8815-a742e1ed5482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:08.049561 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb89c95-f95e-425d-8815-a742e1ed5482 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:08.049893 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb89c95-f95e-425d-8815-a742e1ed5482 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:08.050172 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb89c95-f95e-425d-8815-a742e1ed5482 None admin] PATH_INFO: `/v3/groups/ac3f9e58704b4a2686dd84db2239a250` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:08.056607 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb89c95-f95e-425d-8815-a742e1ed5482 None admin] RBAC: Authorizing `identity:get_group(group_id=ac3f9e58704b4a2686dd84db2239a250)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:08.058175 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb89c95-f95e-425d-8815-a742e1ed5482 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:08.060359 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 189/378] 10.222.0.60 () {56 vars in 1180 bytes} [Sat Sep 24 19:38:07 2022] GET /identity/v3/groups/ac3f9e58704b4a2686dd84db2239a250 => generated 229 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:08.065846 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb89c95-f95e-425d-8815-a742e1ed5482 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:08.152785 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c52a578-191a-4bf4-b77a-ee6ecec9ddea None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:08.157573 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:08.188007 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb89c95-f95e-425d-8815-a742e1ed5482 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:08.198483 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5300e-6327-4d10-b5de-d53bac408fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:08.199533 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5300e-6327-4d10-b5de-d53bac408fcc None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:08.200124 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5300e-6327-4d10-b5de-d53bac408fcc None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:08.200600 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5300e-6327-4d10-b5de-d53bac408fcc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:08.201630 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a5300e-6327-4d10-b5de-d53bac408fcc None admin] RBAC: Adding query filter params (group.id=a1a236ee4b9e491da4269d2522fbbac3, role.id=dd695228990e4288afe29e3cefb75823, scope.project.id=a67dea7cdf8d4c61b2758c16712e9c38) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:08.202165 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a5300e-6327-4d10-b5de-d53bac408fcc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:08.204131 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a5300e-6327-4d10-b5de-d53bac408fcc None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:08.212019 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 190/379] 10.222.0.60 () {56 vars in 1376 bytes} [Sat Sep 24 19:38:08 2022] GET /identity/v3/role_assignments?group.id=a1a236ee4b9e491da4269d2522fbbac3&scope.project.id=a67dea7cdf8d4c61b2758c16712e9c38&role.id=dd695228990e4288afe29e3cefb75823 => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:08.231439 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce4952-1c2e-4d26-8364-b4f0b62f36c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:08.232126 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce4952-1c2e-4d26-8364-b4f0b62f36c4 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:08.232457 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce4952-1c2e-4d26-8364-b4f0b62f36c4 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:08.232732 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce4952-1c2e-4d26-8364-b4f0b62f36c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:08.233484 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dce4952-1c2e-4d26-8364-b4f0b62f36c4 None admin] RBAC: Adding query filter params (group.id=ac3f9e58704b4a2686dd84db2239a250, role.id=f022705fa6ce43828345ef50b3f7efc9, scope.project.id=1efc13c179384208b08c31d1589c351f) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:08.237128 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dce4952-1c2e-4d26-8364-b4f0b62f36c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:08.239397 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dce4952-1c2e-4d26-8364-b4f0b62f36c4 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:08.249648 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 190/380] 10.222.0.60 () {56 vars in 1376 bytes} [Sat Sep 24 19:38:08 2022] GET /identity/v3/role_assignments?group.id=ac3f9e58704b4a2686dd84db2239a250&scope.project.id=1efc13c179384208b08c31d1589c351f&role.id=f022705fa6ce43828345ef50b3f7efc9 => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:38:08.303760 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f24b4-deb8-4781-91b5-62f3cd663c1d None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:08.304128 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f24b4-deb8-4781-91b5-62f3cd663c1d None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:08.304418 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f24b4-deb8-4781-91b5-62f3cd663c1d None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:08.307598 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 191/381] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:38:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:38:08.314878 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889801a-fea5-4f43-8d03-23ab4b05c452 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:08.315313 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889801a-fea5-4f43-8d03-23ab4b05c452 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:08.315589 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889801a-fea5-4f43-8d03-23ab4b05c452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:08.341216 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-2889801a-fea5-4f43-8d03-23ab4b05c452 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:38:08.342490 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-2889801a-fea5-4f43-8d03-23ab4b05c452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:38:08.439702 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 191/382] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:38:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:38:08.774184 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944f24b4-deb8-4781-91b5-62f3cd663c1d None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:08.865815 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:08.899785 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944f24b4-deb8-4781-91b5-62f3cd663c1d None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:08.941118 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12abe36e-7bf3-4ffc-b706-5de2b2652a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:08.941712 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12abe36e-7bf3-4ffc-b706-5de2b2652a69 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:08.941991 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12abe36e-7bf3-4ffc-b706-5de2b2652a69 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:08.942260 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12abe36e-7bf3-4ffc-b706-5de2b2652a69 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:08.955194 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12abe36e-7bf3-4ffc-b706-5de2b2652a69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:38:08.961852 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-12abe36e-7bf3-4ffc-b706-5de2b2652a69 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:38:08.961852 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:08.961852 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:08.961852 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:08.961852 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:08.961852 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:08.961852 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:08.961852 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:08.961852 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:08.961852 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:08.961852 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:08.961852 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:08.961852 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:38:08.961852 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:38:08.961852 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:38:08.961852 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:38:08.962803 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:38:08.962803 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:38:08.962803 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:38:08.962803 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:38:08.962803 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:08.962803 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:08.962803 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:08.962803 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:08.962803 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:08.962803 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:08.962803 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:08.962803 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:08.962803 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:08.962803 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:08.962803 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:08.962803 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:08.963843 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:08.963843 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:08.963843 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:08.963843 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:08.963843 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:38:08.963843 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:38:08.963843 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:38:08.963843 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:38:08.963843 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:38:08.963843 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:38:08.963843 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:38:08.963843 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:08.963843 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 192/383] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Sep 24 19:38:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:08.970459 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2889801a-fea5-4f43-8d03-23ab4b05c452 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:09.062264 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:09.095627 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2889801a-fea5-4f43-8d03-23ab4b05c452 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:09.143025 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f5522-631d-4a09-89ba-cac329b3e512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:09.143987 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f5522-631d-4a09-89ba-cac329b3e512 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:09.144485 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f5522-631d-4a09-89ba-cac329b3e512 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:09.144997 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f5522-631d-4a09-89ba-cac329b3e512 None admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:09.145956 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138f5522-631d-4a09-89ba-cac329b3e512 None admin] RBAC: Adding query filter params (name=member) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:09.146713 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138f5522-631d-4a09-89ba-cac329b3e512 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:09.148290 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138f5522-631d-4a09-89ba-cac329b3e512 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:09.160527 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 192/384] 10.222.0.60 () {56 vars in 1101 bytes} [Sat Sep 24 19:38:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:09.166044 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12abe36e-7bf3-4ffc-b706-5de2b2652a69 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:09.288234 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12abe36e-7bf3-4ffc-b706-5de2b2652a69 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:09.325875 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:09.330202 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb224f8-9ec1-4585-bc18-85a13e85d4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:09.330851 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb224f8-9ec1-4585-bc18-85a13e85d4e7 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:09.331127 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb224f8-9ec1-4585-bc18-85a13e85d4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:09.331392 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb224f8-9ec1-4585-bc18-85a13e85d4e7 None admin] PATH_INFO: `/v3/groups/a1a236ee4b9e491da4269d2522fbbac3` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:09.332703 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb224f8-9ec1-4585-bc18-85a13e85d4e7 None admin] RBAC: Authorizing `identity:get_group(group_id=a1a236ee4b9e491da4269d2522fbbac3)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:09.334429 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb224f8-9ec1-4585-bc18-85a13e85d4e7 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:09.336284 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 193/385] 10.222.0.60 () {56 vars in 1180 bytes} [Sat Sep 24 19:38:09 2022] GET /identity/v3/groups/a1a236ee4b9e491da4269d2522fbbac3 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:09.342222 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f5522-631d-4a09-89ba-cac329b3e512 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:09.479044 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f5522-631d-4a09-89ba-cac329b3e512 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:09.525242 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:09.531912 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1276d40d-a29b-4a16-80ae-2fa9205d1752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:09.532565 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276d40d-a29b-4a16-80ae-2fa9205d1752 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:09.532841 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276d40d-a29b-4a16-80ae-2fa9205d1752 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:09.533109 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276d40d-a29b-4a16-80ae-2fa9205d1752 None admin] PATH_INFO: `/v3/projects/3363e1213c7f49a4bccd9116d9d698d0` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:09.538332 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1276d40d-a29b-4a16-80ae-2fa9205d1752 None admin] RBAC: Authorizing `identity:get_project(project_id=3363e1213c7f49a4bccd9116d9d698d0)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:09.539739 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1276d40d-a29b-4a16-80ae-2fa9205d1752 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:09.541487 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 193/386] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Sep 24 19:38:09 2022] GET /identity/v3/projects/3363e1213c7f49a4bccd9116d9d698d0 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:09.547297 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb224f8-9ec1-4585-bc18-85a13e85d4e7 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:09.559963 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e637cb-3a2d-4557-bae7-3c25d3eed6d7 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:09.562076 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e637cb-3a2d-4557-bae7-3c25d3eed6d7 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:09.562353 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e637cb-3a2d-4557-bae7-3c25d3eed6d7 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:09.563742 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 194/387] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:38:09 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:38:09.569606 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc7445-e25c-4793-98b1-b05af5f9ddc8 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:09.569885 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc7445-e25c-4793-98b1-b05af5f9ddc8 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:09.570155 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc7445-e25c-4793-98b1-b05af5f9ddc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:09.608874 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-01dc7445-e25c-4793-98b1-b05af5f9ddc8 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:38:09.610114 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-01dc7445-e25c-4793-98b1-b05af5f9ddc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:38:09.751020 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 195/388] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:38:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:38:09.763825 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb224f8-9ec1-4585-bc18-85a13e85d4e7 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:09.813046 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42f1a4-c1c4-42a3-ae91-be3a0b5fa536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:09.813968 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42f1a4-c1c4-42a3-ae91-be3a0b5fa536 None admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:09.814455 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42f1a4-c1c4-42a3-ae91-be3a0b5fa536 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:09.814868 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42f1a4-c1c4-42a3-ae91-be3a0b5fa536 None admin] PATH_INFO: `/v3/projects/3363e1213c7f49a4bccd9116d9d698d0/groups/a1a236ee4b9e491da4269d2522fbbac3/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:09.816907 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc42f1a4-c1c4-42a3-ae91-be3a0b5fa536 None admin] RBAC: Authorizing `identity:create_grant(project_id=3363e1213c7f49a4bccd9116d9d698d0, group_id=a1a236ee4b9e491da4269d2522fbbac3, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:09.818731 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc42f1a4-c1c4-42a3-ae91-be3a0b5fa536 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:09.894331 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 194/389] 10.222.0.60 () {58 vars in 1442 bytes} [Sat Sep 24 19:38:09 2022] PUT /identity/v3/projects/3363e1213c7f49a4bccd9116d9d698d0/groups/a1a236ee4b9e491da4269d2522fbbac3/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:38:10.088047 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc7445-e25c-4793-98b1-b05af5f9ddc8 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:10.230319 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc7445-e25c-4793-98b1-b05af5f9ddc8 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:10.276033 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:10.283457 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045693c-4274-4b90-a942-a7e89508357c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:10.284174 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045693c-4274-4b90-a942-a7e89508357c None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:10.284452 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045693c-4274-4b90-a942-a7e89508357c None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:10.284721 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045693c-4274-4b90-a942-a7e89508357c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:10.304508 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e045693c-4274-4b90-a942-a7e89508357c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:38:10.316209 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-e045693c-4274-4b90-a942-a7e89508357c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:38:10.316209 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:10.316209 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:10.316209 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:10.316209 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:10.316209 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:10.316209 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:10.316209 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:10.316209 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:10.316209 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:10.316209 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:10.316209 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:10.316209 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:38:10.316209 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:38:10.316209 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:38:10.316209 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:38:10.317344 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:38:10.317344 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:38:10.317344 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:38:10.317344 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:38:10.317344 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:10.317344 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:10.317344 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:10.317344 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:10.317344 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:10.317344 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:10.317344 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:10.317344 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:10.317344 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:10.317344 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:10.317344 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:10.317344 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:10.318194 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:10.318194 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:10.318194 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:10.318194 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:10.318194 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:38:10.318194 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:38:10.318194 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:38:10.318194 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:38:10.318194 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:38:10.318194 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:38:10.318194 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:38:10.318194 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:10.320719 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 196/390] 10.222.0.60 () {56 vars in 1114 bytes} [Sat Sep 24 19:38:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:10.326183 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42f1a4-c1c4-42a3-ae91-be3a0b5fa536 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:10.419892 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:10.480406 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42f1a4-c1c4-42a3-ae91-be3a0b5fa536 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:10.530008 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca93ab-17f5-4e15-ba3c-de002b240854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:10.530644 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca93ab-17f5-4e15-ba3c-de002b240854 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:10.530971 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca93ab-17f5-4e15-ba3c-de002b240854 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:10.531247 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca93ab-17f5-4e15-ba3c-de002b240854 None admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:10.531979 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeca93ab-17f5-4e15-ba3c-de002b240854 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:10.532278 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeca93ab-17f5-4e15-ba3c-de002b240854 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:10.533761 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeca93ab-17f5-4e15-ba3c-de002b240854 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:10.545267 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 195/391] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Sep 24 19:38:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:10.550429 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045693c-4274-4b90-a942-a7e89508357c None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:10.640876 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79642b23-43d4-4dcc-9523-46d9fa0b68c9 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:10.641413 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79642b23-43d4-4dcc-9523-46d9fa0b68c9 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:10.641736 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79642b23-43d4-4dcc-9523-46d9fa0b68c9 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:10.643635 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 196/392] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:38:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:38:10.649293 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c8d45-2208-46af-86cf-1fc23c0f0828 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:10.649903 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c8d45-2208-46af-86cf-1fc23c0f0828 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:10.650378 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c8d45-2208-46af-86cf-1fc23c0f0828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:10.687248 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-a14c8d45-2208-46af-86cf-1fc23c0f0828 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:38:10.688488 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-a14c8d45-2208-46af-86cf-1fc23c0f0828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:38:10.730207 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045693c-4274-4b90-a942-a7e89508357c None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:10.809428 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd630586-dff9-4d59-af5d-7b917356af12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:10.810382 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd630586-dff9-4d59-af5d-7b917356af12 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:10.810824 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd630586-dff9-4d59-af5d-7b917356af12 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:10.811241 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd630586-dff9-4d59-af5d-7b917356af12 None admin] PATH_INFO: `/v3/groups/a1a236ee4b9e491da4269d2522fbbac3` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:10.812670 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd630586-dff9-4d59-af5d-7b917356af12 None admin] RBAC: Authorizing `identity:get_group(group_id=a1a236ee4b9e491da4269d2522fbbac3)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:10.816444 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd630586-dff9-4d59-af5d-7b917356af12 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:10.823345 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 197/393] 10.222.0.60 () {56 vars in 1180 bytes} [Sat Sep 24 19:38:10 2022] GET /identity/v3/groups/a1a236ee4b9e491da4269d2522fbbac3 => generated 226 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:10.825830 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 197/394] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:38:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:38:10.826881 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd630586-dff9-4d59-af5d-7b917356af12 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:10.922037 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:10.990431 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd630586-dff9-4d59-af5d-7b917356af12 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:11.041063 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae304bb-c7af-4f01-88f0-1324a0f8762c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:11.042014 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae304bb-c7af-4f01-88f0-1324a0f8762c None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:11.042430 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae304bb-c7af-4f01-88f0-1324a0f8762c None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:11.042839 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae304bb-c7af-4f01-88f0-1324a0f8762c None admin] PATH_INFO: `/v3/projects/3363e1213c7f49a4bccd9116d9d698d0` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:11.044145 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae304bb-c7af-4f01-88f0-1324a0f8762c None admin] RBAC: Authorizing `identity:get_project(project_id=3363e1213c7f49a4bccd9116d9d698d0)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:11.045769 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae304bb-c7af-4f01-88f0-1324a0f8762c None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:11.047894 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 198/395] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Sep 24 19:38:10 2022] GET /identity/v3/projects/3363e1213c7f49a4bccd9116d9d698d0 => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:11.054170 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c8d45-2208-46af-86cf-1fc23c0f0828 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:11.120522 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:11.187371 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c8d45-2208-46af-86cf-1fc23c0f0828 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:11.221983 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae304bb-c7af-4f01-88f0-1324a0f8762c None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:11.247452 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a099d93-31da-4218-9bde-a6ff44071bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:11.248060 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a099d93-31da-4218-9bde-a6ff44071bf4 None admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:11.248341 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a099d93-31da-4218-9bde-a6ff44071bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:11.248615 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a099d93-31da-4218-9bde-a6ff44071bf4 None admin] PATH_INFO: `/v3/projects/3363e1213c7f49a4bccd9116d9d698d0/groups/a1a236ee4b9e491da4269d2522fbbac3/roles/dd695228990e4288afe29e3cefb75823` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:11.251921 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a099d93-31da-4218-9bde-a6ff44071bf4 None admin] RBAC: Authorizing `identity:create_grant(project_id=3363e1213c7f49a4bccd9116d9d698d0, group_id=a1a236ee4b9e491da4269d2522fbbac3, role_id=dd695228990e4288afe29e3cefb75823)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:11.253937 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a099d93-31da-4218-9bde-a6ff44071bf4 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:11.337302 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 198/396] 10.222.0.60 () {58 vars in 1442 bytes} [Sat Sep 24 19:38:11 2022] PUT /identity/v3/projects/3363e1213c7f49a4bccd9116d9d698d0/groups/a1a236ee4b9e491da4269d2522fbbac3/roles/dd695228990e4288afe29e3cefb75823 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:38:11.339530 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de52e8f-0181-464d-aafe-f435d5a3f9c3 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:11.340584 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de52e8f-0181-464d-aafe-f435d5a3f9c3 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:11.341165 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de52e8f-0181-464d-aafe-f435d5a3f9c3 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:11.343125 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 199/397] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:38:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:38:11.343905 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae304bb-c7af-4f01-88f0-1324a0f8762c None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:11.350821 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffec097-993f-41ba-bd0d-184a9cb195db None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:11.351806 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffec097-993f-41ba-bd0d-184a9cb195db None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:11.352264 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffec097-993f-41ba-bd0d-184a9cb195db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:11.383220 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-6ffec097-993f-41ba-bd0d-184a9cb195db None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:38:11.385981 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-6ffec097-993f-41ba-bd0d-184a9cb195db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:38:11.400372 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:11.412711 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d728634-5cb9-4ab9-8808-0c7329f47d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:11.413719 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d728634-5cb9-4ab9-8808-0c7329f47d0d None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:11.414143 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d728634-5cb9-4ab9-8808-0c7329f47d0d None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:11.416452 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d728634-5cb9-4ab9-8808-0c7329f47d0d None admin] PATH_INFO: `/v3/roles/member` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:11.429542 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d728634-5cb9-4ab9-8808-0c7329f47d0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:38:11.435609 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-1d728634-5cb9-4ab9-8808-0c7329f47d0d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:38:11.435609 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:11.435609 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:11.435609 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:11.435609 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:11.435609 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:11.435609 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:11.435609 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:11.435609 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:11.435609 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:11.435609 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:11.435609 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:11.435609 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:38:11.435609 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:38:11.435609 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:38:11.435609 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:38:11.436559 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:38:11.436559 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:38:11.436559 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:38:11.436559 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:38:11.436559 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:11.436559 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:11.436559 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:11.436559 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:11.436559 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:11.436559 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:11.436559 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:11.436559 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:11.436559 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:11.436559 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:11.436559 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:11.436559 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:11.437336 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:11.437336 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:11.437336 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:11.437336 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:11.437336 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:38:11.437336 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:38:11.437336 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:38:11.437336 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:38:11.437336 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:38:11.437336 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:38:11.437336 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:38:11.437336 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:11.440260 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 199/398] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Sep 24 19:38:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:11.442420 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff30bc-fa6f-4e1c-bfbe-fc619e20db7b None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:11.443182 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff30bc-fa6f-4e1c-bfbe-fc619e20db7b None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:11.444132 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff30bc-fa6f-4e1c-bfbe-fc619e20db7b None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:11.451283 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 200/399] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:38:11 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:38:11.452514 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff30bc-fa6f-4e1c-bfbe-fc619e20db7b None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:11.490989 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 200/400] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:38:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:38:11.491615 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a7fb9-f2b7-48bd-b053-9ee36f336295 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:11.491909 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a7fb9-f2b7-48bd-b053-9ee36f336295 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:11.492753 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a7fb9-f2b7-48bd-b053-9ee36f336295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:11.518729 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-723a7fb9-f2b7-48bd-b053-9ee36f336295 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:38:11.520165 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-723a7fb9-f2b7-48bd-b053-9ee36f336295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:38:11.571348 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:11.589212 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff30bc-fa6f-4e1c-bfbe-fc619e20db7b None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:11.614001 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 201/401] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:38:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:38:11.634688 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea2d31c-0aae-46aa-b188-b67091623cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:11.635586 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2d31c-0aae-46aa-b188-b67091623cb1 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:11.636033 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2d31c-0aae-46aa-b188-b67091623cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:11.636462 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2d31c-0aae-46aa-b188-b67091623cb1 None admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:11.637276 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea2d31c-0aae-46aa-b188-b67091623cb1 None admin] RBAC: Adding query filter params (name=member) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:11.637755 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea2d31c-0aae-46aa-b188-b67091623cb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:11.639497 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea2d31c-0aae-46aa-b188-b67091623cb1 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:11.649946 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 201/402] 10.222.0.60 () {56 vars in 1101 bytes} [Sat Sep 24 19:38:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:11.656141 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723a7fb9-f2b7-48bd-b053-9ee36f336295 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:11.767755 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723a7fb9-f2b7-48bd-b053-9ee36f336295 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:11.805873 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548c440-1533-4f63-ab06-6500defa1f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:11.806519 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548c440-1533-4f63-ab06-6500defa1f68 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:11.806864 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548c440-1533-4f63-ab06-6500defa1f68 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:11.807143 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548c440-1533-4f63-ab06-6500defa1f68 None admin] PATH_INFO: `/v3/groups/a1a236ee4b9e491da4269d2522fbbac3` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:11.808323 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8548c440-1533-4f63-ab06-6500defa1f68 None admin] RBAC: Authorizing `identity:get_group(group_id=a1a236ee4b9e491da4269d2522fbbac3)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:11.809933 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8548c440-1533-4f63-ab06-6500defa1f68 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:11.811871 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 202/403] 10.222.0.60 () {56 vars in 1180 bytes} [Sat Sep 24 19:38:11 2022] GET /identity/v3/groups/a1a236ee4b9e491da4269d2522fbbac3 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:38:11.818222 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea2d31c-0aae-46aa-b188-b67091623cb1 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:11.828462 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548c440-1533-4f63-ab06-6500defa1f68 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:11.889219 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:11.897132 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:11.960140 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea2d31c-0aae-46aa-b188-b67091623cb1 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:12.019260 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548c440-1533-4f63-ab06-6500defa1f68 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:12.024692 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16913b35-826e-4194-aca5-e4ad3eb9ef44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:12.025341 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16913b35-826e-4194-aca5-e4ad3eb9ef44 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:12.025654 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16913b35-826e-4194-aca5-e4ad3eb9ef44 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:12.025931 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16913b35-826e-4194-aca5-e4ad3eb9ef44 None admin] PATH_INFO: `/v3/projects/a67dea7cdf8d4c61b2758c16712e9c38` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:12.027093 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16913b35-826e-4194-aca5-e4ad3eb9ef44 None admin] RBAC: Authorizing `identity:get_project(project_id=a67dea7cdf8d4c61b2758c16712e9c38)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:12.030724 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16913b35-826e-4194-aca5-e4ad3eb9ef44 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:12.031217 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 202/404] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Sep 24 19:38:11 2022] GET /identity/v3/projects/a67dea7cdf8d4c61b2758c16712e9c38 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:12.032135 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16913b35-826e-4194-aca5-e4ad3eb9ef44 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:12.060575 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf0234d-ee5c-4e01-a12f-e2cf281a58ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:12.061906 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0234d-ee5c-4e01-a12f-e2cf281a58ac None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:12.062358 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0234d-ee5c-4e01-a12f-e2cf281a58ac None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:12.062798 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0234d-ee5c-4e01-a12f-e2cf281a58ac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:12.075398 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf0234d-ee5c-4e01-a12f-e2cf281a58ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:38:12.080793 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-adf0234d-ee5c-4e01-a12f-e2cf281a58ac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:38:12.080793 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:12.080793 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:12.080793 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:12.080793 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:12.080793 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:12.080793 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:12.080793 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:12.080793 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:12.080793 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:12.080793 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:12.080793 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:12.080793 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:38:12.080793 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:38:12.080793 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:38:12.080793 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:38:12.081694 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:38:12.081694 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:38:12.081694 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:38:12.081694 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:38:12.081694 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:12.081694 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:12.081694 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:12.081694 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:12.081694 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:12.081694 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:12.081694 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:12.081694 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:12.081694 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:12.081694 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:12.081694 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:12.081694 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:12.082503 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:12.082503 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:12.082503 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:12.082503 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:12.082503 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:38:12.082503 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:38:12.082503 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:38:12.082503 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:38:12.082503 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:38:12.082503 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:38:12.082503 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:38:12.082503 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:12.089640 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 203/405] 10.222.0.60 () {56 vars in 1114 bytes} [Sat Sep 24 19:38:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:38:12.090737 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf0234d-ee5c-4e01-a12f-e2cf281a58ac None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:12.168646 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16913b35-826e-4194-aca5-e4ad3eb9ef44 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:12.192063 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:12.220537 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ddbece-ea63-4059-bc3c-a3e2164cb4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:12.221955 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:12.222260 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ddbece-ea63-4059-bc3c-a3e2164cb4a5 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:12.223511 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ddbece-ea63-4059-bc3c-a3e2164cb4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:12.224512 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ddbece-ea63-4059-bc3c-a3e2164cb4a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:12.226562 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf0234d-ee5c-4e01-a12f-e2cf281a58ac None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:12.242114 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ddbece-ea63-4059-bc3c-a3e2164cb4a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:38:12.250893 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-c1ddbece-ea63-4059-bc3c-a3e2164cb4a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:38:12.250893 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:12.250893 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:12.250893 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:12.250893 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:12.250893 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:12.250893 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:12.250893 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:12.250893 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:12.250893 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:12.250893 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:12.250893 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:12.250893 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:38:12.250893 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:38:12.250893 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:38:12.250893 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:38:12.251811 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:38:12.251811 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:38:12.251811 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:38:12.251811 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:38:12.251811 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:12.251811 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:12.251811 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:12.251811 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:12.251811 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:12.251811 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:12.251811 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:12.251811 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:12.251811 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:12.251811 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:12.251811 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:12.251811 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:12.252626 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:12.252626 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:12.252626 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:12.252626 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:12.252626 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:38:12.252626 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:38:12.252626 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:38:12.252626 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:38:12.252626 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:38:12.252626 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:38:12.252626 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:38:12.252626 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:12.255950 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 203/406] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Sep 24 19:38:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:12.261051 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ddbece-ea63-4059-bc3c-a3e2164cb4a5 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:12.276366 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702786a1-0b49-438c-8120-9e1967d3acad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:12.277654 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702786a1-0b49-438c-8120-9e1967d3acad None admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:12.278151 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702786a1-0b49-438c-8120-9e1967d3acad None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:12.278624 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702786a1-0b49-438c-8120-9e1967d3acad None admin] PATH_INFO: `/v3/projects/a67dea7cdf8d4c61b2758c16712e9c38/groups/a1a236ee4b9e491da4269d2522fbbac3/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:12.280956 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702786a1-0b49-438c-8120-9e1967d3acad None admin] RBAC: Authorizing `identity:create_grant(project_id=a67dea7cdf8d4c61b2758c16712e9c38, group_id=a1a236ee4b9e491da4269d2522fbbac3, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:12.282734 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702786a1-0b49-438c-8120-9e1967d3acad None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:12.385577 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ddbece-ea63-4059-bc3c-a3e2164cb4a5 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:12.417039 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 204/407] 10.222.0.60 () {58 vars in 1442 bytes} [Sat Sep 24 19:38:12 2022] PUT /identity/v3/projects/a67dea7cdf8d4c61b2758c16712e9c38/groups/a1a236ee4b9e491da4269d2522fbbac3/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:38:12.418276 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702786a1-0b49-438c-8120-9e1967d3acad None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:12.457939 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983adb18-95cd-4d54-9917-f08caf26cedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:12.459181 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983adb18-95cd-4d54-9917-f08caf26cedc None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:12.459518 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983adb18-95cd-4d54-9917-f08caf26cedc None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:12.459790 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983adb18-95cd-4d54-9917-f08caf26cedc None admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:12.460485 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983adb18-95cd-4d54-9917-f08caf26cedc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:12.460781 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983adb18-95cd-4d54-9917-f08caf26cedc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:12.462278 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983adb18-95cd-4d54-9917-f08caf26cedc None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:12.483739 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 204/408] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Sep 24 19:38:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:12.502040 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983adb18-95cd-4d54-9917-f08caf26cedc None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:12.565043 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702786a1-0b49-438c-8120-9e1967d3acad None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:12.610043 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0677fae2-e1aa-4c91-a18d-33168b04c5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:12.611066 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677fae2-e1aa-4c91-a18d-33168b04c5f8 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:12.611557 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677fae2-e1aa-4c91-a18d-33168b04c5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:12.612028 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677fae2-e1aa-4c91-a18d-33168b04c5f8 None admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:12.612917 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0677fae2-e1aa-4c91-a18d-33168b04c5f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:12.613441 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0677fae2-e1aa-4c91-a18d-33168b04c5f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:12.617232 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0677fae2-e1aa-4c91-a18d-33168b04c5f8 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:12.622864 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:12.630722 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 205/409] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Sep 24 19:38:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:12.645479 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0677fae2-e1aa-4c91-a18d-33168b04c5f8 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:12.697766 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:12.730964 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983adb18-95cd-4d54-9917-f08caf26cedc None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:12.771795 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a7298-8e49-40c6-908a-5dede6930bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:12.772815 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a7298-8e49-40c6-908a-5dede6930bbc None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:12.773293 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a7298-8e49-40c6-908a-5dede6930bbc None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:12.773807 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a7298-8e49-40c6-908a-5dede6930bbc None admin] PATH_INFO: `/v3/groups/a1a236ee4b9e491da4269d2522fbbac3` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:12.775214 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2a7298-8e49-40c6-908a-5dede6930bbc None admin] RBAC: Authorizing `identity:get_group(group_id=a1a236ee4b9e491da4269d2522fbbac3)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:12.776864 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2a7298-8e49-40c6-908a-5dede6930bbc None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:12.779082 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 205/410] 10.222.0.60 () {56 vars in 1180 bytes} [Sat Sep 24 19:38:12 2022] GET /identity/v3/groups/a1a236ee4b9e491da4269d2522fbbac3 => generated 226 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:12.780490 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6afdf8-a7aa-4585-9780-03e18e4cf5e5 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:12.780971 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6afdf8-a7aa-4585-9780-03e18e4cf5e5 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:12.781455 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6afdf8-a7aa-4585-9780-03e18e4cf5e5 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:12.782959 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 206/411] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:38:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:38:12.788311 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6afdf8-a7aa-4585-9780-03e18e4cf5e5 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:12.803408 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0677fae2-e1aa-4c91-a18d-33168b04c5f8 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:12.843651 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6925ee10-095b-4b37-a9cc-b5e0876627a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:12.844304 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6925ee10-095b-4b37-a9cc-b5e0876627a8 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:12.844589 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6925ee10-095b-4b37-a9cc-b5e0876627a8 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:12.844869 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6925ee10-095b-4b37-a9cc-b5e0876627a8 None admin] PATH_INFO: `/v3/groups/ac3f9e58704b4a2686dd84db2239a250` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:12.846027 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6925ee10-095b-4b37-a9cc-b5e0876627a8 None admin] RBAC: Authorizing `identity:get_group(group_id=ac3f9e58704b4a2686dd84db2239a250)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:12.847495 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6925ee10-095b-4b37-a9cc-b5e0876627a8 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:12.850131 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 206/412] 10.222.0.60 () {56 vars in 1180 bytes} [Sat Sep 24 19:38:12 2022] GET /identity/v3/groups/ac3f9e58704b4a2686dd84db2239a250 => generated 229 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:12.851415 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34cbab-c7a3-42d0-bfc6-8185ec7eec55 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:12.851705 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34cbab-c7a3-42d0-bfc6-8185ec7eec55 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:12.851983 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34cbab-c7a3-42d0-bfc6-8185ec7eec55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:12.871462 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-2a34cbab-c7a3-42d0-bfc6-8185ec7eec55 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:38:12.872693 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-2a34cbab-c7a3-42d0-bfc6-8185ec7eec55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:38:12.905590 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6afdf8-a7aa-4585-9780-03e18e4cf5e5 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:12.913891 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:12.945679 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68cd7c-fab0-4841-b124-88263e58be4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:12.946737 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68cd7c-fab0-4841-b124-88263e58be4d None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:12.947250 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68cd7c-fab0-4841-b124-88263e58be4d None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:12.947745 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68cd7c-fab0-4841-b124-88263e58be4d None admin] PATH_INFO: `/v3/projects/a67dea7cdf8d4c61b2758c16712e9c38` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:12.949139 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe68cd7c-fab0-4841-b124-88263e58be4d None admin] RBAC: Authorizing `identity:get_project(project_id=a67dea7cdf8d4c61b2758c16712e9c38)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:12.951051 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe68cd7c-fab0-4841-b124-88263e58be4d None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:12.954356 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 207/414] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Sep 24 19:38:12 2022] GET /identity/v3/projects/a67dea7cdf8d4c61b2758c16712e9c38 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:12.955435 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68cd7c-fab0-4841-b124-88263e58be4d None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:12.957597 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 207/414] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:38:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:38:12.964215 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a34cbab-c7a3-42d0-bfc6-8185ec7eec55 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:12.996860 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:13.147099 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a34cbab-c7a3-42d0-bfc6-8185ec7eec55 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:13.180710 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68cd7c-fab0-4841-b124-88263e58be4d None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:13.224889 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da67695-6d97-4ab3-9abf-3f677c185063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:13.225597 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da67695-6d97-4ab3-9abf-3f677c185063 None admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:13.225879 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da67695-6d97-4ab3-9abf-3f677c185063 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:13.226157 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da67695-6d97-4ab3-9abf-3f677c185063 None admin] PATH_INFO: `/v3/projects/a67dea7cdf8d4c61b2758c16712e9c38/groups/a1a236ee4b9e491da4269d2522fbbac3/roles/dd695228990e4288afe29e3cefb75823` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:13.231916 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da67695-6d97-4ab3-9abf-3f677c185063 None admin] RBAC: Authorizing `identity:create_grant(project_id=a67dea7cdf8d4c61b2758c16712e9c38, group_id=a1a236ee4b9e491da4269d2522fbbac3, role_id=dd695228990e4288afe29e3cefb75823)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:13.233372 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da67695-6d97-4ab3-9abf-3f677c185063 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:13.254182 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88373ced-8274-423a-a23c-4daa42adf21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:13.255453 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88373ced-8274-423a-a23c-4daa42adf21e None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:13.255733 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88373ced-8274-423a-a23c-4daa42adf21e None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:13.256174 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88373ced-8274-423a-a23c-4daa42adf21e None admin] PATH_INFO: `/v3/projects/1efc13c179384208b08c31d1589c351f` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:13.260355 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88373ced-8274-423a-a23c-4daa42adf21e None admin] RBAC: Authorizing `identity:get_project(project_id=1efc13c179384208b08c31d1589c351f)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:13.260355 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88373ced-8274-423a-a23c-4daa42adf21e None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:13.261302 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 208/415] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Sep 24 19:38:12 2022] GET /identity/v3/projects/1efc13c179384208b08c31d1589c351f => generated 344 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:13.261964 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88373ced-8274-423a-a23c-4daa42adf21e None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:13.318483 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:13.323962 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 208/416] 10.222.0.60 () {58 vars in 1442 bytes} [Sat Sep 24 19:38:12 2022] PUT /identity/v3/projects/a67dea7cdf8d4c61b2758c16712e9c38/groups/a1a236ee4b9e491da4269d2522fbbac3/roles/dd695228990e4288afe29e3cefb75823 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 19:38:13.325259 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da67695-6d97-4ab3-9abf-3f677c185063 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:13.467352 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88373ced-8274-423a-a23c-4daa42adf21e None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:13.501874 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:13.526698 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da67695-6d97-4ab3-9abf-3f677c185063 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:13.561751 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f6f844-8f31-48c8-9bc5-94e5ea37bb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:13.562397 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6f844-8f31-48c8-9bc5-94e5ea37bb10 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:13.562673 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6f844-8f31-48c8-9bc5-94e5ea37bb10 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:13.562943 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6f844-8f31-48c8-9bc5-94e5ea37bb10 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:13.573842 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94887ba-4de3-488e-906b-7122fe0ae31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:13.575180 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94887ba-4de3-488e-906b-7122fe0ae31d None admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:13.575667 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94887ba-4de3-488e-906b-7122fe0ae31d None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:13.576134 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94887ba-4de3-488e-906b-7122fe0ae31d None admin] PATH_INFO: `/v3/projects/1efc13c179384208b08c31d1589c351f/groups/ac3f9e58704b4a2686dd84db2239a250/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:13.578650 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94887ba-4de3-488e-906b-7122fe0ae31d None admin] RBAC: Authorizing `identity:create_grant(project_id=1efc13c179384208b08c31d1589c351f, group_id=ac3f9e58704b4a2686dd84db2239a250, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:13.580702 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94887ba-4de3-488e-906b-7122fe0ae31d None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:13.592150 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f6f844-8f31-48c8-9bc5-94e5ea37bb10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:38:13.598079 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-f5f6f844-8f31-48c8-9bc5-94e5ea37bb10 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:38:13.598079 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:13.598079 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:13.598079 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:13.598079 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:13.598079 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:13.598079 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:13.598079 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:13.598079 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:13.598079 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:13.598079 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:13.598079 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:13.598079 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:38:13.598079 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:38:13.598079 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:38:13.598079 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:38:13.599515 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:38:13.599515 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:38:13.599515 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:38:13.599515 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:38:13.599515 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:13.599515 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:13.599515 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:13.599515 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:13.599515 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:13.599515 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:13.599515 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:13.599515 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:13.599515 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:13.599515 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:13.599515 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:13.599515 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:13.601053 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:13.601053 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:13.601053 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:13.601053 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:13.601053 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:38:13.601053 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:38:13.601053 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:38:13.601053 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:38:13.601053 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:38:13.601053 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:38:13.601053 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:38:13.601053 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:13.601053 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 209/417] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Sep 24 19:38:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:13.608420 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f6f844-8f31-48c8-9bc5-94e5ea37bb10 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:13.646111 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 209/418] 10.222.0.60 () {58 vars in 1442 bytes} [Sat Sep 24 19:38:13 2022] PUT /identity/v3/projects/1efc13c179384208b08c31d1589c351f/groups/ac3f9e58704b4a2686dd84db2239a250/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:38:13.774439 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f6f844-8f31-48c8-9bc5-94e5ea37bb10 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:13.776684 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:13.830268 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a87f2-6c9d-41b5-ba96-92ba29c76cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:13.831352 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a87f2-6c9d-41b5-ba96-92ba29c76cb5 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:13.831888 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a87f2-6c9d-41b5-ba96-92ba29c76cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:13.832367 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a87f2-6c9d-41b5-ba96-92ba29c76cb5 None admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:13.834620 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40a87f2-6c9d-41b5-ba96-92ba29c76cb5 None admin] RBAC: Adding query filter params (name=member) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:13.835204 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40a87f2-6c9d-41b5-ba96-92ba29c76cb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:13.836880 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40a87f2-6c9d-41b5-ba96-92ba29c76cb5 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:13.853666 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 210/419] 10.222.0.60 () {56 vars in 1101 bytes} [Sat Sep 24 19:38:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:38:13.860583 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94887ba-4de3-488e-906b-7122fe0ae31d None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:13.978174 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94887ba-4de3-488e-906b-7122fe0ae31d None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:13.984203 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7770d48-35d1-4c0c-908b-75be981fe59d None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:13.984393 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7770d48-35d1-4c0c-908b-75be981fe59d None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:13.984668 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7770d48-35d1-4c0c-908b-75be981fe59d None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:13.986251 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 211/420] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:38:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:38:13.993149 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612159be-7324-4042-9a97-6b9bda9ea4f2 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:13.993564 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612159be-7324-4042-9a97-6b9bda9ea4f2 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:13.993739 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612159be-7324-4042-9a97-6b9bda9ea4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:14.018755 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-612159be-7324-4042-9a97-6b9bda9ea4f2 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:38:14.019973 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-612159be-7324-4042-9a97-6b9bda9ea4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:38:14.021904 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1d8bf-e24f-4215-8029-5649b9e9c9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:14.022525 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1d8bf-e24f-4215-8029-5649b9e9c9d6 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:14.022808 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1d8bf-e24f-4215-8029-5649b9e9c9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:14.023081 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1d8bf-e24f-4215-8029-5649b9e9c9d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:14.032208 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:14.141066 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb1d8bf-e24f-4215-8029-5649b9e9c9d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:14.143927 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb1d8bf-e24f-4215-8029-5649b9e9c9d6 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:14.176972 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 212/421] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:38:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 24 19:38:14.307330 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 210/422] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Sep 24 19:38:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:38:14.313113 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612159be-7324-4042-9a97-6b9bda9ea4f2 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:14.515487 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:14.532927 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612159be-7324-4042-9a97-6b9bda9ea4f2 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:14.601011 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1d8bf-e24f-4215-8029-5649b9e9c9d6 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:14.613145 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70459b0-6396-4acf-9504-16cca40fc86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:14.614705 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70459b0-6396-4acf-9504-16cca40fc86d None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:14.615351 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70459b0-6396-4acf-9504-16cca40fc86d None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:14.616503 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70459b0-6396-4acf-9504-16cca40fc86d None admin] PATH_INFO: `/v3/projects/3363e1213c7f49a4bccd9116d9d698d0` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:14.618618 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70459b0-6396-4acf-9504-16cca40fc86d None admin] RBAC: Authorizing `identity:get_project(project_id=3363e1213c7f49a4bccd9116d9d698d0)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:14.621270 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70459b0-6396-4acf-9504-16cca40fc86d None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:14.624783 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 213/423] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Sep 24 19:38:14 2022] GET /identity/v3/projects/3363e1213c7f49a4bccd9116d9d698d0 => generated 298 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:38:14.633428 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70459b0-6396-4acf-9504-16cca40fc86d None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:14.672738 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:14.742343 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1d8bf-e24f-4215-8029-5649b9e9c9d6 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:14.796252 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12af14d4-4534-421e-ae6e-fac0bb17bcb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:14.797203 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af14d4-4534-421e-ae6e-fac0bb17bcb2 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:14.797692 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af14d4-4534-421e-ae6e-fac0bb17bcb2 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:14.798167 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af14d4-4534-421e-ae6e-fac0bb17bcb2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:14.803319 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70459b0-6396-4acf-9504-16cca40fc86d None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:14.811126 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12af14d4-4534-421e-ae6e-fac0bb17bcb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:38:14.817278 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-12af14d4-4534-421e-ae6e-fac0bb17bcb2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:38:14.817278 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:14.817278 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:14.817278 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:14.817278 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:14.817278 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:14.817278 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:14.817278 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:14.817278 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:14.817278 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:14.817278 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:14.817278 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:14.817278 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:38:14.817278 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:38:14.817278 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:38:14.817278 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:38:14.818805 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:38:14.818805 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:38:14.818805 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:38:14.818805 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:38:14.818805 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:14.818805 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:14.818805 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:14.818805 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:14.818805 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:14.818805 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:14.818805 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:14.818805 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:14.818805 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:14.818805 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:14.818805 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:14.818805 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:14.819579 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:14.819579 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:14.819579 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:14.819579 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:14.819579 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:38:14.819579 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:38:14.819579 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:38:14.819579 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:38:14.819579 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:38:14.819579 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:38:14.819579 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:38:14.819579 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:14.822231 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 211/424] 10.222.0.60 () {56 vars in 1114 bytes} [Sat Sep 24 19:38:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:14.828125 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12af14d4-4534-421e-ae6e-fac0bb17bcb2 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:14.861828 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e18a54-9588-4843-bc47-4d94d4763012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:14.862500 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e18a54-9588-4843-bc47-4d94d4763012 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:14.862674 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e18a54-9588-4843-bc47-4d94d4763012 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:14.862950 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e18a54-9588-4843-bc47-4d94d4763012 None admin] PATH_INFO: `/v3/groups/a1a236ee4b9e491da4269d2522fbbac3` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:14.866397 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e18a54-9588-4843-bc47-4d94d4763012 None admin] RBAC: Authorizing `identity:get_group(group_id=a1a236ee4b9e491da4269d2522fbbac3)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:14.869534 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e18a54-9588-4843-bc47-4d94d4763012 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:14.873146 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 214/425] 10.222.0.60 () {56 vars in 1180 bytes} [Sat Sep 24 19:38:14 2022] GET /identity/v3/groups/a1a236ee4b9e491da4269d2522fbbac3 => generated 226 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:14.883833 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e18a54-9588-4843-bc47-4d94d4763012 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:14.956325 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:14.956670 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:14.961944 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12af14d4-4534-421e-ae6e-fac0bb17bcb2 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:15.008457 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae011279-8319-4a1f-9f21-4ff674e990f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:15.009450 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae011279-8319-4a1f-9f21-4ff674e990f1 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:15.009958 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae011279-8319-4a1f-9f21-4ff674e990f1 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:15.010421 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae011279-8319-4a1f-9f21-4ff674e990f1 None admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:15.011304 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae011279-8319-4a1f-9f21-4ff674e990f1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:15.011817 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae011279-8319-4a1f-9f21-4ff674e990f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:15.013375 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae011279-8319-4a1f-9f21-4ff674e990f1 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:15.030271 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 212/426] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Sep 24 19:38:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:15.040622 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae011279-8319-4a1f-9f21-4ff674e990f1 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:15.104069 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e18a54-9588-4843-bc47-4d94d4763012 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:15.184974 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282205cc-8b13-461d-b686-f98f7a2cdf42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:15.186187 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282205cc-8b13-461d-b686-f98f7a2cdf42 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:15.187637 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282205cc-8b13-461d-b686-f98f7a2cdf42 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:15.188263 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282205cc-8b13-461d-b686-f98f7a2cdf42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:15.190404 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282205cc-8b13-461d-b686-f98f7a2cdf42 None admin] RBAC: Adding query filter params (group.id=a1a236ee4b9e491da4269d2522fbbac3, role.id=3dfa1e29c6a0404388d256728d66e4a1, scope.project.id=3363e1213c7f49a4bccd9116d9d698d0) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:15.191334 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282205cc-8b13-461d-b686-f98f7a2cdf42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:15.193723 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282205cc-8b13-461d-b686-f98f7a2cdf42 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:15.213692 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 215/427] 10.222.0.60 () {56 vars in 1376 bytes} [Sat Sep 24 19:38:14 2022] GET /identity/v3/role_assignments?group.id=a1a236ee4b9e491da4269d2522fbbac3&scope.project.id=3363e1213c7f49a4bccd9116d9d698d0&role.id=3dfa1e29c6a0404388d256728d66e4a1 => generated 611 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:38:15.261451 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae011279-8319-4a1f-9f21-4ff674e990f1 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:15.271408 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27e100-077d-42c0-b2cd-d669bc83c7e9 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:15.271725 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27e100-077d-42c0-b2cd-d669bc83c7e9 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:15.272075 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27e100-077d-42c0-b2cd-d669bc83c7e9 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:15.273828 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 216/428] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:38:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:38:15.286131 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de16292-1344-4906-b5d3-eec1b8f95867 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:15.287054 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de16292-1344-4906-b5d3-eec1b8f95867 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:15.287428 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de16292-1344-4906-b5d3-eec1b8f95867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:15.307545 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-2de16292-1344-4906-b5d3-eec1b8f95867 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:38:15.309074 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-2de16292-1344-4906-b5d3-eec1b8f95867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:38:15.335692 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d90c7d-3a1f-416b-8aa0-28f9ef0f5a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:15.336912 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d90c7d-3a1f-416b-8aa0-28f9ef0f5a6d None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:15.337366 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d90c7d-3a1f-416b-8aa0-28f9ef0f5a6d None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:15.337803 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d90c7d-3a1f-416b-8aa0-28f9ef0f5a6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:15.409876 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:15.423361 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 217/429] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:38:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:38:15.474716 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d90c7d-3a1f-416b-8aa0-28f9ef0f5a6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:15.476503 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d90c7d-3a1f-416b-8aa0-28f9ef0f5a6d None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:15.587782 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 213/430] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Sep 24 19:38:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:38:15.593225 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de16292-1344-4906-b5d3-eec1b8f95867 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:15.625788 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:15.734646 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de16292-1344-4906-b5d3-eec1b8f95867 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:15.767373 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d90c7d-3a1f-416b-8aa0-28f9ef0f5a6d None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:15.784726 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf7676-587e-4b25-8d4e-090e130d2534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:15.785759 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf7676-587e-4b25-8d4e-090e130d2534 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:15.786290 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf7676-587e-4b25-8d4e-090e130d2534 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:15.787070 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf7676-587e-4b25-8d4e-090e130d2534 None admin] PATH_INFO: `/v3/projects/3363e1213c7f49a4bccd9116d9d698d0` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:15.788712 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cf7676-587e-4b25-8d4e-090e130d2534 None admin] RBAC: Authorizing `identity:get_project(project_id=3363e1213c7f49a4bccd9116d9d698d0)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:15.790418 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cf7676-587e-4b25-8d4e-090e130d2534 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:15.792770 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 218/431] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Sep 24 19:38:15 2022] GET /identity/v3/projects/3363e1213c7f49a4bccd9116d9d698d0 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:38:15.803648 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf7676-587e-4b25-8d4e-090e130d2534 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:15.858057 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:15.932812 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d90c7d-3a1f-416b-8aa0-28f9ef0f5a6d None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:15.957532 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:15.981435 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf7676-587e-4b25-8d4e-090e130d2534 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:15.986139 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f5af39-731b-4102-a6cd-025a780a3972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:15.987158 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5af39-731b-4102-a6cd-025a780a3972 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:15.987646 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5af39-731b-4102-a6cd-025a780a3972 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:15.988124 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5af39-731b-4102-a6cd-025a780a3972 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:16.005838 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f5af39-731b-4102-a6cd-025a780a3972 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:38:16.012620 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-e9f5af39-731b-4102-a6cd-025a780a3972 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:38:16.012620 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:16.012620 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:16.012620 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:16.012620 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:16.012620 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:16.012620 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:16.012620 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:16.012620 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:16.012620 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:16.012620 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:16.012620 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:16.012620 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:38:16.012620 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:38:16.012620 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:38:16.012620 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:38:16.013576 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:38:16.013576 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:38:16.013576 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:38:16.013576 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:38:16.013576 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:16.013576 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:16.013576 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:16.013576 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:16.013576 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:16.013576 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:16.013576 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:16.013576 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:16.013576 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:16.013576 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:16.013576 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:16.013576 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:16.014369 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:16.014369 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:16.014369 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:16.014369 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:16.014369 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:38:16.014369 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:38:16.014369 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:38:16.014369 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:38:16.014369 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:38:16.014369 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:38:16.014369 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:38:16.014369 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:16.018550 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 214/432] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Sep 24 19:38:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:38:16.022878 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f5af39-731b-4102-a6cd-025a780a3972 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:16.040441 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1ac5a-3f8d-4ddf-b2ad-b61d8ea16760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:16.041082 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1ac5a-3f8d-4ddf-b2ad-b61d8ea16760 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:16.041364 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1ac5a-3f8d-4ddf-b2ad-b61d8ea16760 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:16.041675 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1ac5a-3f8d-4ddf-b2ad-b61d8ea16760 None admin] PATH_INFO: `/v3/groups/a1a236ee4b9e491da4269d2522fbbac3` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:16.043918 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f1ac5a-3f8d-4ddf-b2ad-b61d8ea16760 None admin] RBAC: Authorizing `identity:get_group(group_id=a1a236ee4b9e491da4269d2522fbbac3)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:16.046230 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f1ac5a-3f8d-4ddf-b2ad-b61d8ea16760 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:16.053402 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 219/433] 10.222.0.60 () {56 vars in 1180 bytes} [Sat Sep 24 19:38:15 2022] GET /identity/v3/groups/a1a236ee4b9e491da4269d2522fbbac3 => generated 226 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:38:16.055820 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1ac5a-3f8d-4ddf-b2ad-b61d8ea16760 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:16.176686 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f5af39-731b-4102-a6cd-025a780a3972 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:16.181923 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1ac5a-3f8d-4ddf-b2ad-b61d8ea16760 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:16.204549 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:16.219209 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c29d392-afad-4725-8fbe-2e193a86bf87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:16.219751 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837326b-336c-48a0-950e-8b4dcc7f3c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:16.219886 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29d392-afad-4725-8fbe-2e193a86bf87 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:16.220092 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29d392-afad-4725-8fbe-2e193a86bf87 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:16.220356 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837326b-336c-48a0-950e-8b4dcc7f3c3a None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:16.220453 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29d392-afad-4725-8fbe-2e193a86bf87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:16.220632 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837326b-336c-48a0-950e-8b4dcc7f3c3a None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:16.220899 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837326b-336c-48a0-950e-8b4dcc7f3c3a None admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:16.221074 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c29d392-afad-4725-8fbe-2e193a86bf87 None admin] RBAC: Adding query filter params (group.id=a1a236ee4b9e491da4269d2522fbbac3, role.id=dd695228990e4288afe29e3cefb75823, scope.project.id=3363e1213c7f49a4bccd9116d9d698d0) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:16.221383 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c29d392-afad-4725-8fbe-2e193a86bf87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:16.221650 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9837326b-336c-48a0-950e-8b4dcc7f3c3a None admin] RBAC: Adding query filter params (name=member) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:16.221957 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9837326b-336c-48a0-950e-8b4dcc7f3c3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:16.222880 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c29d392-afad-4725-8fbe-2e193a86bf87 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:16.223344 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9837326b-336c-48a0-950e-8b4dcc7f3c3a None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:16.235988 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 220/434] 10.222.0.60 () {56 vars in 1376 bytes} [Sat Sep 24 19:38:16 2022] GET /identity/v3/role_assignments?group.id=a1a236ee4b9e491da4269d2522fbbac3&scope.project.id=3363e1213c7f49a4bccd9116d9d698d0&role.id=dd695228990e4288afe29e3cefb75823 => generated 611 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:38:16.235988 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31814975-edf8-42a4-a84f-9ef45cf1d499 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:16.235988 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31814975-edf8-42a4-a84f-9ef45cf1d499 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:16.235988 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31814975-edf8-42a4-a84f-9ef45cf1d499 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:16.236464 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 215/435] 10.222.0.60 () {56 vars in 1101 bytes} [Sat Sep 24 19:38:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:16.236560 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 221/436] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:38:16.240961 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837326b-336c-48a0-950e-8b4dcc7f3c3a None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:16.242070 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a794b2-de32-4aec-8baf-26b18b8c3b23 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:16.242354 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a794b2-de32-4aec-8baf-26b18b8c3b23 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:16.242631 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a794b2-de32-4aec-8baf-26b18b8c3b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:16.267804 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-06a794b2-de32-4aec-8baf-26b18b8c3b23 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:38:16.269433 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-06a794b2-de32-4aec-8baf-26b18b8c3b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:38:16.297832 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:16.366001 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 222/437] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:38:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:38:16.380886 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837326b-336c-48a0-950e-8b4dcc7f3c3a None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:16.420823 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476bbeef-fa8f-40f2-8105-41fe59c9123a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:16.421441 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476bbeef-fa8f-40f2-8105-41fe59c9123a None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:16.421763 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476bbeef-fa8f-40f2-8105-41fe59c9123a None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:16.422037 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476bbeef-fa8f-40f2-8105-41fe59c9123a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:16.480854 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:16.502270 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476bbeef-fa8f-40f2-8105-41fe59c9123a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:16.503649 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476bbeef-fa8f-40f2-8105-41fe59c9123a None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:16.623299 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 216/438] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Sep 24 19:38:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:38:16.629050 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a794b2-de32-4aec-8baf-26b18b8c3b23 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:16.689029 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350142eb-e384-4026-8260-e2f3487f6b02 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:16.689332 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350142eb-e384-4026-8260-e2f3487f6b02 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:16.691363 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350142eb-e384-4026-8260-e2f3487f6b02 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:16.693688 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 217/439] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:38:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:38:16.699064 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a047a9-e4aa-473d-a4c7-5d381b565cb3 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:16.699347 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a047a9-e4aa-473d-a4c7-5d381b565cb3 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:16.699611 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a047a9-e4aa-473d-a4c7-5d381b565cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:16.725746 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-79a047a9-e4aa-473d-a4c7-5d381b565cb3 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:38:16.729325 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-79a047a9-e4aa-473d-a4c7-5d381b565cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:38:16.750698 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a794b2-de32-4aec-8baf-26b18b8c3b23 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:16.798404 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a65d4ed-9aac-433d-a5b7-83647bd36cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:16.799053 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65d4ed-9aac-433d-a5b7-83647bd36cc8 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:16.799326 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65d4ed-9aac-433d-a5b7-83647bd36cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:16.799590 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65d4ed-9aac-433d-a5b7-83647bd36cc8 None admin] PATH_INFO: `/v3/projects/a67dea7cdf8d4c61b2758c16712e9c38` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:16.800819 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a65d4ed-9aac-433d-a5b7-83647bd36cc8 None admin] RBAC: Authorizing `identity:get_project(project_id=a67dea7cdf8d4c61b2758c16712e9c38)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:16.802357 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a65d4ed-9aac-433d-a5b7-83647bd36cc8 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:16.804251 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 223/440] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Sep 24 19:38:16 2022] GET /identity/v3/projects/a67dea7cdf8d4c61b2758c16712e9c38 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:38:16.804829 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a65d4ed-9aac-433d-a5b7-83647bd36cc8 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:16.815646 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 218/441] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:38:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 19:38:16.816329 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a047a9-e4aa-473d-a4c7-5d381b565cb3 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:16.834035 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:16.839705 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:16.937012 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a047a9-e4aa-473d-a4c7-5d381b565cb3 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:16.945064 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a65d4ed-9aac-433d-a5b7-83647bd36cc8 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:16.979784 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9633ebde-f039-4a0d-9ebf-a4d5af062b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:16.980787 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633ebde-f039-4a0d-9ebf-a4d5af062b23 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:16.981320 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633ebde-f039-4a0d-9ebf-a4d5af062b23 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:16.981819 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633ebde-f039-4a0d-9ebf-a4d5af062b23 None admin] PATH_INFO: `/v3/groups/a1a236ee4b9e491da4269d2522fbbac3` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:16.983182 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9633ebde-f039-4a0d-9ebf-a4d5af062b23 None admin] RBAC: Authorizing `identity:get_group(group_id=a1a236ee4b9e491da4269d2522fbbac3)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:16.984881 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9633ebde-f039-4a0d-9ebf-a4d5af062b23 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:16.989544 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ed3cb-b7aa-4a93-90e4-bf93e34fffba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:16.989544 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ed3cb-b7aa-4a93-90e4-bf93e34fffba None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:16.989544 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ed3cb-b7aa-4a93-90e4-bf93e34fffba None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:16.989544 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ed3cb-b7aa-4a93-90e4-bf93e34fffba None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:16.991673 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 219/442] 10.222.0.60 () {56 vars in 1180 bytes} [Sat Sep 24 19:38:16 2022] GET /identity/v3/groups/a1a236ee4b9e491da4269d2522fbbac3 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:16.992677 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9633ebde-f039-4a0d-9ebf-a4d5af062b23 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:17.003641 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7ed3cb-b7aa-4a93-90e4-bf93e34fffba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:38:17.009710 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-8c7ed3cb-b7aa-4a93-90e4-bf93e34fffba None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:38:17.009710 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:17.009710 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:17.009710 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:17.009710 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:17.009710 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:17.009710 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:17.009710 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:17.009710 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:17.009710 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:17.009710 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:17.009710 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:17.009710 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:38:17.009710 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:38:17.009710 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:38:17.009710 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:38:17.010812 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:38:17.010812 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:38:17.010812 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:38:17.010812 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:38:17.010812 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:17.010812 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:17.010812 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:17.010812 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:17.010812 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:17.010812 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:17.010812 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:17.010812 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:17.010812 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:17.010812 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:17.010812 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:17.010812 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:17.011784 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:17.011784 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:17.011784 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:17.011784 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:17.011784 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:38:17.011784 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:38:17.011784 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:38:17.011784 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:38:17.011784 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:38:17.011784 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:38:17.011784 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:38:17.011784 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:17.015757 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 224/443] 10.222.0.60 () {56 vars in 1114 bytes} [Sat Sep 24 19:38:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:17.016630 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ed3cb-b7aa-4a93-90e4-bf93e34fffba None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:17.095219 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:17.115727 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9633ebde-f039-4a0d-9ebf-a4d5af062b23 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:17.122675 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:17.146382 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ed3cb-b7aa-4a93-90e4-bf93e34fffba None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:17.155209 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d93e4-dc09-48c5-abc0-7f89ceae11ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:17.155815 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d93e4-dc09-48c5-abc0-7f89ceae11ba None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:17.156091 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d93e4-dc09-48c5-abc0-7f89ceae11ba None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:17.156359 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d93e4-dc09-48c5-abc0-7f89ceae11ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:17.157285 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243d93e4-dc09-48c5-abc0-7f89ceae11ba None admin] RBAC: Adding query filter params (group.id=a1a236ee4b9e491da4269d2522fbbac3, role.id=3dfa1e29c6a0404388d256728d66e4a1, scope.project.id=a67dea7cdf8d4c61b2758c16712e9c38) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:17.157659 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243d93e4-dc09-48c5-abc0-7f89ceae11ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:17.159142 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243d93e4-dc09-48c5-abc0-7f89ceae11ba None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:17.165335 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 220/444] 10.222.0.60 () {56 vars in 1376 bytes} [Sat Sep 24 19:38:16 2022] GET /identity/v3/role_assignments?group.id=a1a236ee4b9e491da4269d2522fbbac3&scope.project.id=a67dea7cdf8d4c61b2758c16712e9c38&role.id=3dfa1e29c6a0404388d256728d66e4a1 => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:17.166655 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d93e4-dc09-48c5-abc0-7f89ceae11ba None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:17.183045 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ed261-a536-4b6c-9c2f-16241c6a182f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:17.183734 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ed261-a536-4b6c-9c2f-16241c6a182f None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:17.184020 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ed261-a536-4b6c-9c2f-16241c6a182f None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:17.184288 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ed261-a536-4b6c-9c2f-16241c6a182f None admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:17.184979 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ed261-a536-4b6c-9c2f-16241c6a182f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:17.185277 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ed261-a536-4b6c-9c2f-16241c6a182f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:17.186727 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ed261-a536-4b6c-9c2f-16241c6a182f None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:17.196808 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 225/445] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Sep 24 19:38:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:17.202719 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ed261-a536-4b6c-9c2f-16241c6a182f None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:17.318216 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d93e4-dc09-48c5-abc0-7f89ceae11ba None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:17.332189 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ed261-a536-4b6c-9c2f-16241c6a182f None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:17.360227 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b5c5f1-638f-4373-a36c-13ad3aedb7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:17.360796 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5c5f1-638f-4373-a36c-13ad3aedb7eb None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:17.361078 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5c5f1-638f-4373-a36c-13ad3aedb7eb None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:17.361350 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5c5f1-638f-4373-a36c-13ad3aedb7eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:17.374469 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f4360-4234-4d1d-822c-3d135d908c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:17.375101 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f4360-4234-4d1d-822c-3d135d908c00 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:17.375378 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f4360-4234-4d1d-822c-3d135d908c00 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:17.375648 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f4360-4234-4d1d-822c-3d135d908c00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:17.377649 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b5c5f1-638f-4373-a36c-13ad3aedb7eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:38:17.384668 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-b0b5c5f1-638f-4373-a36c-13ad3aedb7eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:38:17.384668 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:17.384668 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:17.384668 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:17.384668 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:17.384668 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:17.384668 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:17.384668 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:17.384668 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:17.384668 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:17.384668 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:17.384668 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:17.384668 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:38:17.384668 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:38:17.384668 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:38:17.384668 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:38:17.386097 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:38:17.386097 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:38:17.386097 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:38:17.386097 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:38:17.386097 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:17.386097 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:17.386097 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:17.386097 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:17.386097 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:17.386097 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:17.386097 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:17.386097 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:17.386097 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:17.386097 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:17.386097 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:17.386097 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:17.386951 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:17.386951 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:17.386951 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:17.386951 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:17.386951 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:38:17.386951 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:38:17.386951 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:38:17.386951 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:38:17.386951 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:38:17.386951 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:38:17.386951 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:38:17.386951 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:17.386951 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 221/446] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Sep 24 19:38:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:17.391714 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b5c5f1-638f-4373-a36c-13ad3aedb7eb None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:17.396314 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:17.399559 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:17.462004 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f4360-4234-4d1d-822c-3d135d908c00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:17.463478 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f4360-4234-4d1d-822c-3d135d908c00 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:17.514686 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b5c5f1-638f-4373-a36c-13ad3aedb7eb None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:17.559722 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bc8d6a-40f4-4798-b558-fe9ab12c494e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:17.560750 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc8d6a-40f4-4798-b558-fe9ab12c494e None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:17.561036 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc8d6a-40f4-4798-b558-fe9ab12c494e None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:17.561694 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc8d6a-40f4-4798-b558-fe9ab12c494e None admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:17.562036 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bc8d6a-40f4-4798-b558-fe9ab12c494e None admin] RBAC: Adding query filter params (name=admin) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:17.562350 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bc8d6a-40f4-4798-b558-fe9ab12c494e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:17.563753 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bc8d6a-40f4-4798-b558-fe9ab12c494e None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:17.576745 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 222/447] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Sep 24 19:38:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:38:17.584842 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bc8d6a-40f4-4798-b558-fe9ab12c494e None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:17.597836 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 226/448] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Sep 24 19:38:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 24 19:38:17.604038 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f4360-4234-4d1d-822c-3d135d908c00 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:17.649978 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:17.671635 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:17.706993 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bc8d6a-40f4-4798-b558-fe9ab12c494e None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:17.712889 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f4360-4234-4d1d-822c-3d135d908c00 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:17.742242 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae84135-b08d-46b4-99db-c8a59e1a6f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:17.742852 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae84135-b08d-46b4-99db-c8a59e1a6f36 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:17.743137 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae84135-b08d-46b4-99db-c8a59e1a6f36 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:17.743406 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae84135-b08d-46b4-99db-c8a59e1a6f36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:17.748377 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e77c7b-5727-4491-a73c-80a422c29c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:17.749010 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e77c7b-5727-4491-a73c-80a422c29c03 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:17.749287 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e77c7b-5727-4491-a73c-80a422c29c03 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:17.749585 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e77c7b-5727-4491-a73c-80a422c29c03 None admin] PATH_INFO: `/v3/projects/a67dea7cdf8d4c61b2758c16712e9c38` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:17.751170 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e77c7b-5727-4491-a73c-80a422c29c03 None admin] RBAC: Authorizing `identity:get_project(project_id=a67dea7cdf8d4c61b2758c16712e9c38)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:17.752643 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e77c7b-5727-4491-a73c-80a422c29c03 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:17.754369 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 227/449] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Sep 24 19:38:17 2022] GET /identity/v3/projects/a67dea7cdf8d4c61b2758c16712e9c38 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:38:17.760663 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e77c7b-5727-4491-a73c-80a422c29c03 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:17.816761 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae84135-b08d-46b4-99db-c8a59e1a6f36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:17.818554 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae84135-b08d-46b4-99db-c8a59e1a6f36 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:17.868700 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e77c7b-5727-4491-a73c-80a422c29c03 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:17.882549 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:17.884660 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:17.904248 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b07a5b-1fbf-423b-8906-c41f10435029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:17.904804 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b07a5b-1fbf-423b-8906-c41f10435029 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:17.905080 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b07a5b-1fbf-423b-8906-c41f10435029 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:17.905352 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b07a5b-1fbf-423b-8906-c41f10435029 None admin] PATH_INFO: `/v3/groups/a1a236ee4b9e491da4269d2522fbbac3` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:17.906737 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b07a5b-1fbf-423b-8906-c41f10435029 None admin] RBAC: Authorizing `identity:get_group(group_id=a1a236ee4b9e491da4269d2522fbbac3)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:17.908191 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b07a5b-1fbf-423b-8906-c41f10435029 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:17.909814 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 228/450] 10.222.0.60 () {56 vars in 1180 bytes} [Sat Sep 24 19:38:17 2022] GET /identity/v3/groups/a1a236ee4b9e491da4269d2522fbbac3 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:38:17.917299 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b07a5b-1fbf-423b-8906-c41f10435029 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:17.921708 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 223/451] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Sep 24 19:38:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 24 19:38:17.928612 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae84135-b08d-46b4-99db-c8a59e1a6f36 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:18.031840 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b07a5b-1fbf-423b-8906-c41f10435029 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:18.034764 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae84135-b08d-46b4-99db-c8a59e1a6f36 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:18.066859 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f3cb6-3af7-44e2-899c-d9521a0b3415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:18.067497 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f3cb6-3af7-44e2-899c-d9521a0b3415 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:18.067782 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f3cb6-3af7-44e2-899c-d9521a0b3415 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:18.068097 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f3cb6-3af7-44e2-899c-d9521a0b3415 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:18.068816 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49f3cb6-3af7-44e2-899c-d9521a0b3415 None admin] RBAC: Adding query filter params (group.id=a1a236ee4b9e491da4269d2522fbbac3, role.id=dd695228990e4288afe29e3cefb75823, scope.project.id=a67dea7cdf8d4c61b2758c16712e9c38) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:18.069118 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49f3cb6-3af7-44e2-899c-d9521a0b3415 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:18.069737 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01538b1c-4da4-4784-8d6a-eda7e07f2216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:18.070379 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01538b1c-4da4-4784-8d6a-eda7e07f2216 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:18.070594 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49f3cb6-3af7-44e2-899c-d9521a0b3415 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:18.070691 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01538b1c-4da4-4784-8d6a-eda7e07f2216 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:18.070925 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01538b1c-4da4-4784-8d6a-eda7e07f2216 None admin] PATH_INFO: `/v3/projects/1efc13c179384208b08c31d1589c351f` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:18.072088 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01538b1c-4da4-4784-8d6a-eda7e07f2216 None admin] RBAC: Authorizing `identity:get_project(project_id=1efc13c179384208b08c31d1589c351f)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:18.073540 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01538b1c-4da4-4784-8d6a-eda7e07f2216 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:18.075198 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 224/452] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Sep 24 19:38:17 2022] GET /identity/v3/projects/1efc13c179384208b08c31d1589c351f => generated 344 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:38:18.076997 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 229/453] 10.222.0.60 () {56 vars in 1376 bytes} [Sat Sep 24 19:38:17 2022] GET /identity/v3/role_assignments?group.id=a1a236ee4b9e491da4269d2522fbbac3&scope.project.id=a67dea7cdf8d4c61b2758c16712e9c38&role.id=dd695228990e4288afe29e3cefb75823 => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:18.080753 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01538b1c-4da4-4784-8d6a-eda7e07f2216 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:18.121298 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:18.202081 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01538b1c-4da4-4784-8d6a-eda7e07f2216 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:18.241483 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd55665-b792-45f9-9a9a-bd045afc84a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:18.242230 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd55665-b792-45f9-9a9a-bd045afc84a8 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:18.242508 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd55665-b792-45f9-9a9a-bd045afc84a8 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:18.242781 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd55665-b792-45f9-9a9a-bd045afc84a8 None admin] PATH_INFO: `/v3/groups/ac3f9e58704b4a2686dd84db2239a250` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:18.243962 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd55665-b792-45f9-9a9a-bd045afc84a8 None admin] RBAC: Authorizing `identity:get_group(group_id=ac3f9e58704b4a2686dd84db2239a250)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:18.245403 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd55665-b792-45f9-9a9a-bd045afc84a8 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:18.247226 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 225/454] 10.222.0.60 () {56 vars in 1180 bytes} [Sat Sep 24 19:38:18 2022] GET /identity/v3/groups/ac3f9e58704b4a2686dd84db2239a250 => generated 229 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:18.253228 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f3cb6-3af7-44e2-899c-d9521a0b3415 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:18.305838 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:18.367024 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f3cb6-3af7-44e2-899c-d9521a0b3415 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:18.403762 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae135ac-2da1-46e1-b9d2-20107c1ebaf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:18.403762 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae135ac-2da1-46e1-b9d2-20107c1ebaf1 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:18.403762 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae135ac-2da1-46e1-b9d2-20107c1ebaf1 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:18.403762 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae135ac-2da1-46e1-b9d2-20107c1ebaf1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:18.405676 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae135ac-2da1-46e1-b9d2-20107c1ebaf1 None admin] RBAC: Adding query filter params (group.id=ac3f9e58704b4a2686dd84db2239a250, role.id=f022705fa6ce43828345ef50b3f7efc9, scope.project.id=1efc13c179384208b08c31d1589c351f) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:18.405988 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae135ac-2da1-46e1-b9d2-20107c1ebaf1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:18.407423 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae135ac-2da1-46e1-b9d2-20107c1ebaf1 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:18.414097 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 230/455] 10.222.0.60 () {56 vars in 1376 bytes} [Sat Sep 24 19:38:18 2022] GET /identity/v3/role_assignments?group.id=ac3f9e58704b4a2686dd84db2239a250&scope.project.id=1efc13c179384208b08c31d1589c351f&role.id=f022705fa6ce43828345ef50b3f7efc9 => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:21.144160 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453892ac-1a43-44ef-bacc-90e10a51c404 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:21.144160 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453892ac-1a43-44ef-bacc-90e10a51c404 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:21.144160 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453892ac-1a43-44ef-bacc-90e10a51c404 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:21.145413 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 226/456] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:38:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:38:21.149630 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850d242-0d31-4509-b1ce-49cdbb87b4b2 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:21.150499 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850d242-0d31-4509-b1ce-49cdbb87b4b2 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:21.150979 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850d242-0d31-4509-b1ce-49cdbb87b4b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:21.179318 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-b850d242-0d31-4509-b1ce-49cdbb87b4b2 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:38:21.180864 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-b850d242-0d31-4509-b1ce-49cdbb87b4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:38:21.266350 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 231/457] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:38:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 24 19:38:21.398950 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2431ae-6100-48c7-87b9-352c84bac7de None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:21.399577 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2431ae-6100-48c7-87b9-352c84bac7de None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:21.400048 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2431ae-6100-48c7-87b9-352c84bac7de None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:21.401899 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 227/458] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:38:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:38:21.407082 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ad6fb-46fa-40a1-a3f9-628331b2aeeb None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:21.407619 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ad6fb-46fa-40a1-a3f9-628331b2aeeb None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:21.408113 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ad6fb-46fa-40a1-a3f9-628331b2aeeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:21.432144 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-0d8ad6fb-46fa-40a1-a3f9-628331b2aeeb None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:38:21.433732 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-0d8ad6fb-46fa-40a1-a3f9-628331b2aeeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:38:21.475795 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:21.525745 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 232/459] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:38:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:38:21.613860 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2431ae-6100-48c7-87b9-352c84bac7de None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:21.750731 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2431ae-6100-48c7-87b9-352c84bac7de None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:21.752432 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:21.794153 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d5f573-1e9b-4dcd-9a9d-52c2cf7f868b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:21.795016 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d5f573-1e9b-4dcd-9a9d-52c2cf7f868b None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:21.795336 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d5f573-1e9b-4dcd-9a9d-52c2cf7f868b None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:21.795772 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d5f573-1e9b-4dcd-9a9d-52c2cf7f868b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:21.806937 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d5f573-1e9b-4dcd-9a9d-52c2cf7f868b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:21.808384 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d5f573-1e9b-4dcd-9a9d-52c2cf7f868b None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:21.828915 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-46d5f573-1e9b-4dcd-9a9d-52c2cf7f868b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:21.828915 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:21.828915 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:21.828915 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:21.828915 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:21.828915 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:21.828915 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:21.828915 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:21.828915 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:21.828915 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:21.828915 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:21.828915 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:21.828915 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:38:21.828915 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:38:21.828915 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:38:21.828915 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:38:21.829910 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:21.829910 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:21.829910 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:21.829910 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:21.829910 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:21.829910 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:21.829910 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:21.829910 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:21.829910 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:21.829910 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:21.829910 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:21.829910 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:21.829910 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:21.829910 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:21.829910 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:21.829910 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:21.829910 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:38:21.830745 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:38:21.830745 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:21.830745 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:21.832546 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 228/460] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:38:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:21.838738 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ad6fb-46fa-40a1-a3f9-628331b2aeeb None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:21.862938 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7512345-cf29-4f46-90f3-51ec06c4b2c1 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:21.863224 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7512345-cf29-4f46-90f3-51ec06c4b2c1 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:21.863507 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7512345-cf29-4f46-90f3-51ec06c4b2c1 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:21.865356 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 229/461] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:38:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:38:21.871019 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c11af-bb81-4200-ba94-44e7ed6aef99 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:21.871301 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c11af-bb81-4200-ba94-44e7ed6aef99 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:21.871574 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c11af-bb81-4200-ba94-44e7ed6aef99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:21.906515 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-532c11af-bb81-4200-ba94-44e7ed6aef99 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:38:21.907735 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-532c11af-bb81-4200-ba94-44e7ed6aef99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:38:21.967205 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ad6fb-46fa-40a1-a3f9-628331b2aeeb None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:21.984427 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 230/462] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:38:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:38:21.985303 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c11af-bb81-4200-ba94-44e7ed6aef99 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:22.007242 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfcdeab-be16-4941-9ffb-d8051a52f2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:22.007855 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfcdeab-be16-4941-9ffb-d8051a52f2fc None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:22.008132 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfcdeab-be16-4941-9ffb-d8051a52f2fc None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:22.008404 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfcdeab-be16-4941-9ffb-d8051a52f2fc None admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:22.009070 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfcdeab-be16-4941-9ffb-d8051a52f2fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:22.009371 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfcdeab-be16-4941-9ffb-d8051a52f2fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:22.010804 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfcdeab-be16-4941-9ffb-d8051a52f2fc None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:22.023461 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 233/463] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:38:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:22.029352 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfcdeab-be16-4941-9ffb-d8051a52f2fc None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:22.095133 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:22.106251 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:22.119696 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c11af-bb81-4200-ba94-44e7ed6aef99 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:22.156497 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b55c47-c95d-4671-8f09-ed609008816a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:22.157122 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b55c47-c95d-4671-8f09-ed609008816a None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:22.157408 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b55c47-c95d-4671-8f09-ed609008816a None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:22.157722 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b55c47-c95d-4671-8f09-ed609008816a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:22.169975 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b55c47-c95d-4671-8f09-ed609008816a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:22.171432 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b55c47-c95d-4671-8f09-ed609008816a None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:22.187914 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-b6b55c47-c95d-4671-8f09-ed609008816a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:22.187914 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:22.187914 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:22.187914 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:22.187914 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:22.187914 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:22.187914 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:22.187914 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:22.187914 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:22.187914 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:22.187914 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:22.187914 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:22.187914 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:38:22.187914 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:38:22.187914 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:38:22.187914 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:38:22.188903 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:22.188903 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:22.188903 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:22.188903 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:22.188903 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:22.188903 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:22.188903 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:22.188903 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:22.188903 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:22.188903 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:22.188903 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:22.188903 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:22.188903 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:22.188903 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:22.188903 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:22.188903 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:22.188903 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:38:22.190093 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:38:22.190093 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:22.190093 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:22.190093 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 231/464] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:38:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:22.197103 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b55c47-c95d-4671-8f09-ed609008816a None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:22.243413 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfcdeab-be16-4941-9ffb-d8051a52f2fc None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:22.297965 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210547f2-961e-4b76-9784-b9c740e445e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:22.298891 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210547f2-961e-4b76-9784-b9c740e445e4 None admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:22.299272 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210547f2-961e-4b76-9784-b9c740e445e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:22.299644 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210547f2-961e-4b76-9784-b9c740e445e4 None admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:22.300686 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210547f2-961e-4b76-9784-b9c740e445e4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:22.303272 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210547f2-961e-4b76-9784-b9c740e445e4 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:22.320885 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b55c47-c95d-4671-8f09-ed609008816a None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:22.357943 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9018c4-4e43-4fef-a54e-d978c7863f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:22.358542 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9018c4-4e43-4fef-a54e-d978c7863f47 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:22.358823 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9018c4-4e43-4fef-a54e-d978c7863f47 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:22.359099 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9018c4-4e43-4fef-a54e-d978c7863f47 None admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:22.359811 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9018c4-4e43-4fef-a54e-d978c7863f47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:22.360203 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9018c4-4e43-4fef-a54e-d978c7863f47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:22.361642 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9018c4-4e43-4fef-a54e-d978c7863f47 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:22.367413 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:22.386685 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 232/465] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:38:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:22.386685 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09655a24-435c-4370-bf96-7d0f3d4036a9 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:22.386685 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09655a24-435c-4370-bf96-7d0f3d4036a9 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:22.386685 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09655a24-435c-4370-bf96-7d0f3d4036a9 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:22.386685 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 233/466] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:38:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:38:22.386685 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09655a24-435c-4370-bf96-7d0f3d4036a9 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:22.420139 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 234/467] 10.222.0.60 () {60 vars in 1132 bytes} [Sat Sep 24 19:38:22 2022] POST /identity/v3/users => generated 246 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:38:22.421309 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210547f2-961e-4b76-9784-b9c740e445e4 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:22.515576 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09655a24-435c-4370-bf96-7d0f3d4036a9 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:22.559610 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:22.563651 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f663678-85a2-4de8-9eae-d2012d8225f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:22.564607 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f663678-85a2-4de8-9eae-d2012d8225f7 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:22.570546 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f663678-85a2-4de8-9eae-d2012d8225f7 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:22.570546 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f663678-85a2-4de8-9eae-d2012d8225f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:22.585100 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210547f2-961e-4b76-9784-b9c740e445e4 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:22.586040 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f663678-85a2-4de8-9eae-d2012d8225f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:22.589156 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f663678-85a2-4de8-9eae-d2012d8225f7 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:22.618444 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-4f663678-85a2-4de8-9eae-d2012d8225f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:22.618444 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:22.618444 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:22.618444 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:22.618444 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:22.618444 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:22.618444 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:22.618444 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:22.618444 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:22.618444 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:22.618444 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:22.618444 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:22.618444 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:38:22.618444 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:38:22.618444 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:38:22.618444 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:38:22.624089 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:22.624089 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:22.624089 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:22.624089 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:22.624089 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:22.624089 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:22.624089 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:22.624089 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:22.624089 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:22.624089 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:22.624089 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:22.624089 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:22.624089 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:22.624089 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:22.624089 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:22.624089 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:22.624089 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:38:22.625164 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:38:22.625164 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:22.625164 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:22.625164 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 234/468] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:38:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:22.625164 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3bcf9-2990-45f4-bccd-0bc06972fb7b None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:22.625164 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3bcf9-2990-45f4-bccd-0bc06972fb7b None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:22.625164 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3bcf9-2990-45f4-bccd-0bc06972fb7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:22.644578 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-c7e3bcf9-2990-45f4-bccd-0bc06972fb7b None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:38:22.646529 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-c7e3bcf9-2990-45f4-bccd-0bc06972fb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:38:22.646756 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca011a8-26f6-4c54-b3ab-b7e32799bae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:22.647332 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca011a8-26f6-4c54-b3ab-b7e32799bae9 None admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:22.647608 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca011a8-26f6-4c54-b3ab-b7e32799bae9 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:22.647885 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca011a8-26f6-4c54-b3ab-b7e32799bae9 None admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:22.648741 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca011a8-26f6-4c54-b3ab-b7e32799bae9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:22.651156 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca011a8-26f6-4c54-b3ab-b7e32799bae9 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:22.703691 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:22.729771 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 235/469] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:38:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:38:22.730667 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e3bcf9-2990-45f4-bccd-0bc06972fb7b None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:22.756240 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 235/470] 10.222.0.60 () {60 vars in 1132 bytes} [Sat Sep 24 19:38:22 2022] POST /identity/v3/users => generated 248 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:38:22.758712 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c03300-b727-430f-9039-42ed0057c887 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:22.758991 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c03300-b727-430f-9039-42ed0057c887 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:22.759319 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c03300-b727-430f-9039-42ed0057c887 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:22.760841 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 236/471] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:38:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:38:22.768825 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aab55e-600b-44d5-bf8d-191c698ad71e None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:22.768825 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aab55e-600b-44d5-bf8d-191c698ad71e None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:22.768825 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aab55e-600b-44d5-bf8d-191c698ad71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:22.805398 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-57aab55e-600b-44d5-bf8d-191c698ad71e None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:38:22.806853 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-57aab55e-600b-44d5-bf8d-191c698ad71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:38:22.947181 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e3bcf9-2990-45f4-bccd-0bc06972fb7b None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:22.985858 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 237/472] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:38:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:38:22.993281 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ec637-02e7-4ee4-b719-b8658687768a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:22.993950 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ec637-02e7-4ee4-b719-b8658687768a None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:22.994227 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ec637-02e7-4ee4-b719-b8658687768a None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:22.994496 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ec637-02e7-4ee4-b719-b8658687768a None admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:22.995141 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972ec637-02e7-4ee4-b719-b8658687768a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:22.995440 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972ec637-02e7-4ee4-b719-b8658687768a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:22.996835 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972ec637-02e7-4ee4-b719-b8658687768a None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:23.010121 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 236/473] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:38:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:23.018346 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aab55e-600b-44d5-bf8d-191c698ad71e None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:23.114886 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:23.142840 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aab55e-600b-44d5-bf8d-191c698ad71e None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:23.181801 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ec637-02e7-4ee4-b719-b8658687768a None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:23.225691 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af776fd3-0c16-46f3-b8e9-35f4bf235ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:23.226685 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af776fd3-0c16-46f3-b8e9-35f4bf235ff9 None admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:23.227294 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af776fd3-0c16-46f3-b8e9-35f4bf235ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:23.227896 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af776fd3-0c16-46f3-b8e9-35f4bf235ff9 None admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:23.229074 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af776fd3-0c16-46f3-b8e9-35f4bf235ff9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:23.231711 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af776fd3-0c16-46f3-b8e9-35f4bf235ff9 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:23.233362 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:23.327067 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 238/474] 10.222.0.60 () {60 vars in 1132 bytes} [Sat Sep 24 19:38:23 2022] POST /identity/v3/users => generated 248 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:38:23.334303 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ec637-02e7-4ee4-b719-b8658687768a None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:23.387685 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def7461-c156-421e-bb68-4433d04f4ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:23.388263 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def7461-c156-421e-bb68-4433d04f4ef2 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:23.388546 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def7461-c156-421e-bb68-4433d04f4ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:23.388818 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def7461-c156-421e-bb68-4433d04f4ef2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:23.397911 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af776fd3-0c16-46f3-b8e9-35f4bf235ff9 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:23.402207 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3def7461-c156-421e-bb68-4433d04f4ef2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:23.403755 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3def7461-c156-421e-bb68-4433d04f4ef2 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:23.424984 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-3def7461-c156-421e-bb68-4433d04f4ef2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:23.424984 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:23.424984 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:23.424984 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:23.424984 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:23.424984 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:23.424984 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:23.424984 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:23.424984 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:23.424984 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:23.424984 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:23.424984 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:23.424984 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:38:23.424984 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:38:23.424984 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:38:23.424984 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:38:23.427148 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:23.427148 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:23.427148 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:23.427148 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:23.427148 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:23.427148 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:23.427148 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:23.427148 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:23.427148 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:23.427148 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:23.427148 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:23.427148 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:23.427148 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:23.427148 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:23.427148 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:23.427148 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:23.427148 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:38:23.429112 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:38:23.429112 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:23.429112 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:23.429112 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 237/475] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:38:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:38:23.434980 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def7461-c156-421e-bb68-4433d04f4ef2 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:23.579530 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:23.592706 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def7461-c156-421e-bb68-4433d04f4ef2 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:23.649623 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d35f9-6617-4cee-887d-27e59456e1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:23.650511 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d35f9-6617-4cee-887d-27e59456e1c3 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:23.650807 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d35f9-6617-4cee-887d-27e59456e1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:23.651071 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d35f9-6617-4cee-887d-27e59456e1c3 None admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:23.652006 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5d35f9-6617-4cee-887d-27e59456e1c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:23.652311 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5d35f9-6617-4cee-887d-27e59456e1c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:23.654579 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5d35f9-6617-4cee-887d-27e59456e1c3 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:23.671527 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 238/476] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:38:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:23.679463 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d35f9-6617-4cee-887d-27e59456e1c3 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:23.690825 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af776fd3-0c16-46f3-b8e9-35f4bf235ff9 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:23.733869 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:23.743512 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf517b1-0ff7-4f06-bf1a-667ba328ac0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:23.744136 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf517b1-0ff7-4f06-bf1a-667ba328ac0c None admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:23.744413 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf517b1-0ff7-4f06-bf1a-667ba328ac0c None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:23.744754 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf517b1-0ff7-4f06-bf1a-667ba328ac0c None admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:23.745444 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf517b1-0ff7-4f06-bf1a-667ba328ac0c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:23.747433 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf517b1-0ff7-4f06-bf1a-667ba328ac0c None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:23.804808 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.sql.core [None req-6bf517b1-0ff7-4f06-bf1a-667ba328ac0c None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 24 19:38:23.804808 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 24 19:38:23.804808 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [parameters: {'id': 'e09bc0fe096c40c6a31decd49b7813c5', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 24 19:38:23.804808 dv-cinder-859191-1-smb devstack@keystone.service[93399]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93399) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 24 19:38:23.810089 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d35f9-6617-4cee-887d-27e59456e1c3 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:23.827799 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-6bf517b1-0ff7-4f06-bf1a-667ba328ac0c None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 24 19:38:23.827799 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:23.827799 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 24 19:38:23.827799 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 24 19:38:23.827799 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 24 19:38:23.827799 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 24 19:38:23.827799 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 24 19:38:23.827799 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application result = self._query(query) Sep 24 19:38:23.827799 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 24 19:38:23.827799 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application conn.query(q) Sep 24 19:38:23.827799 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 24 19:38:23.827799 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 24 19:38:23.827799 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 24 19:38:23.827799 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application result.read() Sep 24 19:38:23.827799 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 24 19:38:23.830344 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 24 19:38:23.830344 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 24 19:38:23.830344 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 24 19:38:23.830344 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 24 19:38:23.830344 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 24 19:38:23.830344 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 24 19:38:23.830344 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 24 19:38:23.830344 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 24 19:38:23.830344 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:23.830344 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 24 19:38:23.830344 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:23.830344 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:23.830344 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 24 19:38:23.830344 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 24 19:38:23.830344 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 24 19:38:23.830344 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return ref.to_dict() Sep 24 19:38:23.830344 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 24 19:38:23.830344 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application next(self.gen) Sep 24 19:38:23.832882 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 24 19:38:23.832882 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application yield resource Sep 24 19:38:23.832882 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 24 19:38:23.832882 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application next(self.gen) Sep 24 19:38:23.832882 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 24 19:38:23.832882 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application self.session.rollback() Sep 24 19:38:23.832882 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 24 19:38:23.832882 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application self.force_reraise() Sep 24 19:38:23.832882 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 24 19:38:23.832882 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise self.value Sep 24 19:38:23.832882 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 24 19:38:23.832882 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 24 19:38:23.832882 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 24 19:38:23.832882 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application session.commit() Sep 24 19:38:23.832882 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 24 19:38:23.832882 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 24 19:38:23.832882 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 24 19:38:23.834952 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application self._prepare_impl() Sep 24 19:38:23.834952 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 24 19:38:23.834952 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application self.session.flush() Sep 24 19:38:23.834952 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 24 19:38:23.834952 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application self._flush(objects) Sep 24 19:38:23.834952 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 24 19:38:23.834952 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 24 19:38:23.834952 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 24 19:38:23.834952 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application compat.raise_( Sep 24 19:38:23.834952 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 24 19:38:23.834952 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception Sep 24 19:38:23.834952 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 24 19:38:23.834952 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application flush_context.execute() Sep 24 19:38:23.834952 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 24 19:38:23.834952 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rec.execute(self) Sep 24 19:38:23.834952 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 24 19:38:23.834952 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 24 19:38:23.841641 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 24 19:38:23.841641 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 24 19:38:23.841641 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 24 19:38:23.841641 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 24 19:38:23.841641 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 24 19:38:23.841641 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 24 19:38:23.841641 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 24 19:38:23.841641 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 24 19:38:23.841641 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 24 19:38:23.841641 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 24 19:38:23.841641 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 24 19:38:23.841641 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 24 19:38:23.841641 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 24 19:38:23.841641 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 24 19:38:23.841641 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 24 19:38:23.841641 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception Sep 24 19:38:23.844298 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 24 19:38:23.844298 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 24 19:38:23.844298 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 24 19:38:23.844298 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 24 19:38:23.844298 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 24 19:38:23.844298 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application result = self._query(query) Sep 24 19:38:23.844298 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 24 19:38:23.844298 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application conn.query(q) Sep 24 19:38:23.844298 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 24 19:38:23.844298 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 24 19:38:23.844298 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 24 19:38:23.844298 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application result.read() Sep 24 19:38:23.844298 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 24 19:38:23.844298 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 24 19:38:23.844298 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 24 19:38:23.844298 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 24 19:38:23.846245 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 24 19:38:23.846245 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 24 19:38:23.846245 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 24 19:38:23.846245 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 24 19:38:23.846245 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 24 19:38:23.846245 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 24 19:38:23.846245 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [parameters: {'id': 'e09bc0fe096c40c6a31decd49b7813c5', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 24 19:38:23.846245 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 24 19:38:23.846245 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:23.846245 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:38:23.846245 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:23.846245 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:23.846245 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:23.846245 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:23.846245 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:23.846245 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:23.848823 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:23.848823 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:23.848823 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:23.848823 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:23.848823 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:23.848823 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:23.848823 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 24 19:38:23.848823 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 24 19:38:23.848823 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:23.848823 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:23.848823 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 24 19:38:23.848823 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 24 19:38:23.848823 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 24 19:38:23.848823 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 24 19:38:23.848823 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 24 19:38:23.848823 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:23.852191 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 239/477] 10.222.0.60 () {60 vars in 1131 bytes} [Sat Sep 24 19:38:23 2022] POST /identity/v3/roles => generated 144 bytes in 432 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:38:23.854084 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf517b1-0ff7-4f06-bf1a-667ba328ac0c None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:23.865424 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0750b292-67c2-4738-b8df-616440506702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:23.865424 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750b292-67c2-4738-b8df-616440506702 None admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:23.865424 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750b292-67c2-4738-b8df-616440506702 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:23.865424 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750b292-67c2-4738-b8df-616440506702 None admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:23.866249 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0750b292-67c2-4738-b8df-616440506702 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:23.866249 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0750b292-67c2-4738-b8df-616440506702 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:23.950888 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 239/478] 10.222.0.60 () {60 vars in 1132 bytes} [Sat Sep 24 19:38:23 2022] POST /identity/v3/users => generated 249 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:38:24.023210 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf517b1-0ff7-4f06-bf1a-667ba328ac0c None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:24.063144 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce55ba4c-dc4f-4ece-ab2a-bdf558c7148b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:24.063809 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55ba4c-dc4f-4ece-ab2a-bdf558c7148b None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:24.064091 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55ba4c-dc4f-4ece-ab2a-bdf558c7148b None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:24.064362 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55ba4c-dc4f-4ece-ab2a-bdf558c7148b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:24.077615 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce55ba4c-dc4f-4ece-ab2a-bdf558c7148b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:38:24.083192 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-ce55ba4c-dc4f-4ece-ab2a-bdf558c7148b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:38:24.083192 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:24.083192 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:24.083192 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:24.083192 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:24.083192 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:24.083192 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:24.083192 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:24.083192 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:24.083192 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:24.083192 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:24.083192 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:24.083192 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:38:24.083192 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:38:24.083192 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:38:24.083192 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:38:24.084129 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:38:24.084129 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:38:24.084129 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:38:24.084129 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:38:24.084129 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:24.084129 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:24.084129 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:24.084129 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:24.084129 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:24.084129 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:24.084129 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:24.084129 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:24.084129 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:24.084129 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:24.084129 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:24.084129 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:24.084897 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:24.084897 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:24.084897 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:24.084897 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:24.084897 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:38:24.084897 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:38:24.084897 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:38:24.084897 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:38:24.084897 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:38:24.084897 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:38:24.084897 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:38:24.084897 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:24.084897 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 240/479] 10.222.0.60 () {56 vars in 1114 bytes} [Sat Sep 24 19:38:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:24.092118 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0750b292-67c2-4738-b8df-616440506702 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:24.102740 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:24.244175 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0750b292-67c2-4738-b8df-616440506702 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:24.283255 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3039973f-9fc1-49cb-88d5-55521187710d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:24.283872 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039973f-9fc1-49cb-88d5-55521187710d None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:24.284156 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039973f-9fc1-49cb-88d5-55521187710d None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:24.284431 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039973f-9fc1-49cb-88d5-55521187710d None admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:24.285109 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3039973f-9fc1-49cb-88d5-55521187710d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:24.285414 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3039973f-9fc1-49cb-88d5-55521187710d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:24.287998 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3039973f-9fc1-49cb-88d5-55521187710d None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:24.299145 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 240/480] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Sep 24 19:38:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:24.906144 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2ab79-77fb-4dff-a616-19c36533cb17 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:24.906667 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2ab79-77fb-4dff-a616-19c36533cb17 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:24.906667 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2ab79-77fb-4dff-a616-19c36533cb17 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:24.908238 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 241/481] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:38:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:38:24.914999 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473d35a-bc6f-447f-a415-4408c3c306e0 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:24.915288 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473d35a-bc6f-447f-a415-4408c3c306e0 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:24.915559 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473d35a-bc6f-447f-a415-4408c3c306e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:24.935025 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-6473d35a-bc6f-447f-a415-4408c3c306e0 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:38:24.936149 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-6473d35a-bc6f-447f-a415-4408c3c306e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:38:25.017915 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:25.024461 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 241/482] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:38:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:38:25.384511 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2ab79-77fb-4dff-a616-19c36533cb17 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:25.455901 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:25.531242 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2ab79-77fb-4dff-a616-19c36533cb17 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:25.580626 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4fe9c-8bbb-4ddd-8115-f8ff977ac823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:25.581692 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4fe9c-8bbb-4ddd-8115-f8ff977ac823 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:25.582175 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4fe9c-8bbb-4ddd-8115-f8ff977ac823 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:25.583972 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4fe9c-8bbb-4ddd-8115-f8ff977ac823 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:25.606536 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f4fe9c-8bbb-4ddd-8115-f8ff977ac823 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:38:25.612320 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-89f4fe9c-8bbb-4ddd-8115-f8ff977ac823 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:38:25.612320 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:25.612320 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:25.612320 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:25.612320 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:25.612320 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:25.612320 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:25.612320 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:25.612320 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:25.612320 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:25.612320 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:25.612320 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:25.612320 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:38:25.612320 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:38:25.612320 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:38:25.612320 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:38:25.613219 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:38:25.613219 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:38:25.613219 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:38:25.613219 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:38:25.613219 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:25.613219 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:25.613219 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:25.613219 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:25.613219 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:25.613219 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:25.613219 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:25.613219 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:25.613219 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:25.613219 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:25.613219 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:25.613219 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:25.614729 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:25.614729 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:25.614729 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:25.614729 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:25.614729 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:38:25.614729 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:38:25.614729 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:38:25.614729 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:38:25.614729 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:38:25.614729 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:38:25.614729 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:38:25.614729 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:25.617106 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 242/483] 10.222.0.60 () {56 vars in 1102 bytes} [Sat Sep 24 19:38:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:25.623059 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6473d35a-bc6f-447f-a415-4408c3c306e0 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:25.811589 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6473d35a-bc6f-447f-a415-4408c3c306e0 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:25.867620 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7830b-749a-4584-b9b4-25a5d25b6029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:25.868327 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7830b-749a-4584-b9b4-25a5d25b6029 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:25.868614 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7830b-749a-4584-b9b4-25a5d25b6029 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:25.868889 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7830b-749a-4584-b9b4-25a5d25b6029 None admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:25.869591 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe7830b-749a-4584-b9b4-25a5d25b6029 None admin] RBAC: Adding query filter params (name=service) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:25.869901 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe7830b-749a-4584-b9b4-25a5d25b6029 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:25.871292 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe7830b-749a-4584-b9b4-25a5d25b6029 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:25.886560 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 242/484] 10.222.0.60 () {56 vars in 1103 bytes} [Sat Sep 24 19:38:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:25.891913 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4fe9c-8bbb-4ddd-8115-f8ff977ac823 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:25.941247 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef01913e-019d-4e7a-9c48-e2cbc888ba99 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:25.941574 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef01913e-019d-4e7a-9c48-e2cbc888ba99 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:25.942728 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef01913e-019d-4e7a-9c48-e2cbc888ba99 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:25.945138 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 243/485] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:38:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:38:25.951524 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f3988-05ce-4836-9d51-20a2a919fce5 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:25.951949 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f3988-05ce-4836-9d51-20a2a919fce5 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:25.952228 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f3988-05ce-4836-9d51-20a2a919fce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:25.989608 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-fc2f3988-05ce-4836-9d51-20a2a919fce5 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:38:25.990615 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-fc2f3988-05ce-4836-9d51-20a2a919fce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:38:26.090200 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:26.104325 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4fe9c-8bbb-4ddd-8115-f8ff977ac823 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:26.119145 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 244/486] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:38:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:38:26.154017 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:26.161886 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677eb0c1-e45c-40df-92dc-75341f72f3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:26.162645 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677eb0c1-e45c-40df-92dc-75341f72f3c2 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:26.162926 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677eb0c1-e45c-40df-92dc-75341f72f3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:26.168277 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677eb0c1-e45c-40df-92dc-75341f72f3c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:26.180420 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677eb0c1-e45c-40df-92dc-75341f72f3c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:26.181937 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677eb0c1-e45c-40df-92dc-75341f72f3c2 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:26.208945 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-677eb0c1-e45c-40df-92dc-75341f72f3c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:26.208945 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:26.208945 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:26.208945 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:26.208945 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:26.208945 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:26.208945 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:26.208945 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:26.208945 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:26.208945 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:26.208945 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:26.208945 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:26.208945 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:38:26.208945 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:38:26.208945 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:38:26.208945 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:38:26.209912 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:26.209912 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:26.209912 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:26.209912 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:26.209912 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:26.209912 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:26.209912 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:26.209912 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:26.209912 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:26.209912 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:26.209912 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:26.209912 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:26.209912 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:26.209912 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:26.209912 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:26.209912 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:26.209912 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:38:26.211319 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:38:26.211319 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:26.211319 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:26.211319 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 243/487] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:38:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:26.215795 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f3988-05ce-4836-9d51-20a2a919fce5 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:26.341623 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f3988-05ce-4836-9d51-20a2a919fce5 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:26.382980 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dcda3b-dafe-46c4-8309-d6ac73b7b0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:26.383604 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dcda3b-dafe-46c4-8309-d6ac73b7b0ee None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:26.383883 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dcda3b-dafe-46c4-8309-d6ac73b7b0ee None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:26.384155 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dcda3b-dafe-46c4-8309-d6ac73b7b0ee None admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:26.384806 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dcda3b-dafe-46c4-8309-d6ac73b7b0ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:26.385110 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dcda3b-dafe-46c4-8309-d6ac73b7b0ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:26.386511 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dcda3b-dafe-46c4-8309-d6ac73b7b0ee None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:26.404061 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 245/488] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:38:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:26.409262 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677eb0c1-e45c-40df-92dc-75341f72f3c2 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:26.499475 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dcda3b-dafe-46c4-8309-d6ac73b7b0ee None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:26.549408 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677eb0c1-e45c-40df-92dc-75341f72f3c2 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:26.562543 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:26.594797 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c7511-b181-4a7f-b7fb-0034d3785bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:26.595688 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c7511-b181-4a7f-b7fb-0034d3785bba None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:26.596456 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c7511-b181-4a7f-b7fb-0034d3785bba None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:26.596907 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c7511-b181-4a7f-b7fb-0034d3785bba None admin] PATH_INFO: `/v3/users/nova` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:26.608950 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42c7511-b181-4a7f-b7fb-0034d3785bba None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:26.611090 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42c7511-b181-4a7f-b7fb-0034d3785bba None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:26.622182 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dcda3b-dafe-46c4-8309-d6ac73b7b0ee None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:26.628725 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-f42c7511-b181-4a7f-b7fb-0034d3785bba None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 24 19:38:26.628725 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:26.628725 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:26.628725 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:26.628725 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:26.628725 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:26.628725 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:26.628725 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:26.628725 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:26.628725 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:26.628725 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:26.628725 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:26.628725 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:38:26.628725 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:38:26.628725 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:38:26.628725 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:38:26.629976 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:26.629976 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:26.629976 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:38:26.629976 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:38:26.629976 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:38:26.629976 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:38:26.629976 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:26.629976 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:26.629976 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:26.629976 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:26.629976 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:26.629976 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:26.629976 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:26.629976 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:26.629976 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:26.629976 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:26.629976 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:26.629976 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:26.631020 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:26.631020 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:26.631020 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:38:26.631020 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:38:26.631020 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:38:26.631020 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:38:26.631020 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:38:26.631020 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:38:26.631020 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 24 19:38:26.631020 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:26.631020 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 244/489] 10.222.0.60 () {56 vars in 1093 bytes} [Sat Sep 24 19:38:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:26.631589 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771553d-b82d-4d21-8cf7-330cb73338e8 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:26.631589 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771553d-b82d-4d21-8cf7-330cb73338e8 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:26.631958 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771553d-b82d-4d21-8cf7-330cb73338e8 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:26.635369 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 245/490] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:38:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:38:26.640282 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771553d-b82d-4d21-8cf7-330cb73338e8 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:26.673603 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6b8eb-8a54-4507-af7f-0299fe008665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:26.674344 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6b8eb-8a54-4507-af7f-0299fe008665 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:26.674538 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6b8eb-8a54-4507-af7f-0299fe008665 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:26.674818 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6b8eb-8a54-4507-af7f-0299fe008665 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:26.681998 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:26.689183 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a6b8eb-8a54-4507-af7f-0299fe008665 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:38:26.695996 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-a8a6b8eb-8a54-4507-af7f-0299fe008665 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:38:26.695996 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:26.695996 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:26.695996 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:26.695996 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:26.695996 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:26.695996 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:26.695996 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:26.695996 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:26.695996 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:26.695996 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:26.695996 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:26.695996 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:38:26.695996 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:38:26.695996 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:38:26.695996 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:38:26.706630 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:38:26.706630 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:38:26.706630 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:38:26.706630 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:38:26.706630 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:26.706630 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:26.706630 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:26.706630 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:26.706630 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:26.706630 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:26.706630 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:26.706630 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:26.706630 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:26.706630 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:26.706630 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:26.706630 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:26.708144 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:26.708144 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:26.708144 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:26.708144 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:26.708144 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:38:26.708144 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:38:26.708144 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:38:26.708144 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:38:26.708144 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:38:26.708144 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:38:26.708144 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:38:26.708144 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:26.708144 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 246/491] 10.222.0.60 () {56 vars in 1102 bytes} [Sat Sep 24 19:38:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:26.708144 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d21e9-15b2-4e49-8033-31dd949d16e9 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:26.709348 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d21e9-15b2-4e49-8033-31dd949d16e9 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:26.709348 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d21e9-15b2-4e49-8033-31dd949d16e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:26.725930 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-996d21e9-15b2-4e49-8033-31dd949d16e9 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:38:26.727325 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-996d21e9-15b2-4e49-8033-31dd949d16e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:38:26.787685 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771553d-b82d-4d21-8cf7-330cb73338e8 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:26.821672 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 247/492] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:38:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:38:26.822640 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d21e9-15b2-4e49-8033-31dd949d16e9 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:26.824129 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2821773-f4c4-4782-aa96-c93b2ab66e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:26.824750 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2821773-f4c4-4782-aa96-c93b2ab66e2e None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:26.825024 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2821773-f4c4-4782-aa96-c93b2ab66e2e None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:26.825289 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2821773-f4c4-4782-aa96-c93b2ab66e2e None admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:26.826058 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2821773-f4c4-4782-aa96-c93b2ab66e2e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:26.826380 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2821773-f4c4-4782-aa96-c93b2ab66e2e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:26.828507 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2821773-f4c4-4782-aa96-c93b2ab66e2e None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:26.870406 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 246/493] 10.222.0.60 () {56 vars in 1133 bytes} [Sat Sep 24 19:38:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:26.874870 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41acc90-1c6b-4547-8bfb-d7d98e951a88 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:26.875380 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41acc90-1c6b-4547-8bfb-d7d98e951a88 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:26.875847 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41acc90-1c6b-4547-8bfb-d7d98e951a88 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:26.877372 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 247/494] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:38:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:38:26.878320 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41acc90-1c6b-4547-8bfb-d7d98e951a88 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:26.889373 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:26.967322 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d21e9-15b2-4e49-8033-31dd949d16e9 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:26.996786 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:27.013791 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361deb05-af31-4007-87d3-b8e6b5fdb5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:27.015381 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361deb05-af31-4007-87d3-b8e6b5fdb5c8 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:27.015381 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361deb05-af31-4007-87d3-b8e6b5fdb5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:27.015381 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361deb05-af31-4007-87d3-b8e6b5fdb5c8 None admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:27.015804 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361deb05-af31-4007-87d3-b8e6b5fdb5c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:27.016108 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361deb05-af31-4007-87d3-b8e6b5fdb5c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:27.017511 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361deb05-af31-4007-87d3-b8e6b5fdb5c8 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:27.026160 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41acc90-1c6b-4547-8bfb-d7d98e951a88 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:27.031828 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 248/495] 10.222.0.60 () {56 vars in 1103 bytes} [Sat Sep 24 19:38:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:27.031828 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489dd71-a7d6-43b9-bf2b-f7e87888c1a7 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:27.031828 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489dd71-a7d6-43b9-bf2b-f7e87888c1a7 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:27.031828 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489dd71-a7d6-43b9-bf2b-f7e87888c1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:27.052658 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-8489dd71-a7d6-43b9-bf2b-f7e87888c1a7 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:38:27.054651 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-8489dd71-a7d6-43b9-bf2b-f7e87888c1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:38:27.072747 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2b85b-6f3f-4bcb-b380-4639da7e11ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:27.073417 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2b85b-6f3f-4bcb-b380-4639da7e11ec None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:27.073723 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2b85b-6f3f-4bcb-b380-4639da7e11ec None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:27.073989 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2b85b-6f3f-4bcb-b380-4639da7e11ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:27.151200 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 249/496] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:38:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:38:27.151200 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8489dd71-a7d6-43b9-bf2b-f7e87888c1a7 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:27.193531 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f2b85b-6f3f-4bcb-b380-4639da7e11ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:27.193531 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f2b85b-6f3f-4bcb-b380-4639da7e11ec None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:27.199150 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:27.303038 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8489dd71-a7d6-43b9-bf2b-f7e87888c1a7 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:27.343954 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:27.353568 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ed9f6-e7b3-41f9-a086-49a316f2bd87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:27.359779 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ed9f6-e7b3-41f9-a086-49a316f2bd87 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:27.359779 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ed9f6-e7b3-41f9-a086-49a316f2bd87 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:27.359779 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ed9f6-e7b3-41f9-a086-49a316f2bd87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:27.370791 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232ed9f6-e7b3-41f9-a086-49a316f2bd87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:27.372946 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232ed9f6-e7b3-41f9-a086-49a316f2bd87 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:27.385311 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 248/497] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Sep 24 19:38:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:38:27.387203 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2b85b-6f3f-4bcb-b380-4639da7e11ec None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:27.403135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-232ed9f6-e7b3-41f9-a086-49a316f2bd87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:27.403135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:27.403135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:27.403135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:27.403135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:27.403135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:27.403135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:27.403135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:27.403135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:27.403135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:27.403135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:27.403135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:27.403135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:38:27.403135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:38:27.403135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:38:27.403135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:38:27.404164 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:27.404164 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:27.404164 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:27.404164 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:27.404164 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:27.404164 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:27.404164 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:27.404164 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:27.404164 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:27.404164 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:27.404164 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:27.404164 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:27.404164 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:27.404164 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:27.404164 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:27.404164 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:27.404164 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:38:27.405058 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:38:27.405058 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:27.405058 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:27.407854 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 250/498] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:38:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:27.408932 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ed9f6-e7b3-41f9-a086-49a316f2bd87 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:27.516877 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:27.530609 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2b85b-6f3f-4bcb-b380-4639da7e11ec None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:27.536180 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ed9f6-e7b3-41f9-a086-49a316f2bd87 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:27.576922 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b038e7-217b-40db-bb26-079b7f31a99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:27.577763 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b038e7-217b-40db-bb26-079b7f31a99b None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:27.577986 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b038e7-217b-40db-bb26-079b7f31a99b None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:27.578255 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b038e7-217b-40db-bb26-079b7f31a99b None admin] PATH_INFO: `/v3/roles/service` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:27.578407 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd9db6-b9d2-4999-8bea-f76e875f2522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:27.579009 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd9db6-b9d2-4999-8bea-f76e875f2522 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:27.579283 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd9db6-b9d2-4999-8bea-f76e875f2522 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:27.579551 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd9db6-b9d2-4999-8bea-f76e875f2522 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:27.589213 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b038e7-217b-40db-bb26-079b7f31a99b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:38:27.590718 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd9db6-b9d2-4999-8bea-f76e875f2522 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:27.592161 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd9db6-b9d2-4999-8bea-f76e875f2522 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:27.594310 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-21b038e7-217b-40db-bb26-079b7f31a99b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:38:27.594310 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:27.594310 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:27.594310 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:27.594310 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:27.594310 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:27.594310 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:27.594310 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:27.594310 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:27.594310 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:27.594310 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:27.594310 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:27.594310 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:38:27.594310 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:38:27.594310 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:38:27.594310 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:38:27.595294 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:38:27.595294 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:38:27.595294 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:38:27.595294 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:38:27.595294 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:27.595294 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:27.595294 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:27.595294 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:27.595294 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:27.595294 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:27.595294 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:27.595294 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:27.595294 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:27.595294 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:27.595294 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:27.595294 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:27.596319 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:27.596319 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:27.596319 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:27.596319 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:27.596319 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:38:27.596319 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:38:27.596319 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:38:27.596319 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:38:27.596319 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:38:27.596319 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:38:27.596319 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:38:27.596319 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:27.596319 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 249/499] 10.222.0.60 () {56 vars in 1102 bytes} [Sat Sep 24 19:38:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:27.597116 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b038e7-217b-40db-bb26-079b7f31a99b None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:27.610418 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-a8cd9db6-b9d2-4999-8bea-f76e875f2522 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:27.610418 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:27.610418 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:27.610418 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:27.610418 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:27.610418 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:27.610418 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:27.610418 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:27.610418 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:27.610418 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:27.610418 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:27.610418 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:27.610418 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:38:27.610418 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:38:27.610418 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:38:27.610418 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:38:27.611544 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:27.611544 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:27.611544 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:27.611544 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:27.611544 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:27.611544 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:27.611544 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:27.611544 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:27.611544 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:27.611544 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:27.611544 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:27.611544 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:27.611544 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:27.611544 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:27.611544 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:27.611544 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:27.611544 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:38:27.612411 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:38:27.612411 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:27.612411 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:27.612411 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 251/500] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:38:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:27.614417 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149cfbd4-3763-4992-bf81-6758eff69faa None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:27.614759 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149cfbd4-3763-4992-bf81-6758eff69faa None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:27.615246 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149cfbd4-3763-4992-bf81-6758eff69faa None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:27.616672 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 252/501] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:38:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:38:27.617551 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149cfbd4-3763-4992-bf81-6758eff69faa None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:27.652755 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:27.715049 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b038e7-217b-40db-bb26-079b7f31a99b None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:27.729844 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149cfbd4-3763-4992-bf81-6758eff69faa None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:27.751619 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6701fb60-8e4b-4dca-a7a0-e71a2ebf42c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:27.752219 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701fb60-8e4b-4dca-a7a0-e71a2ebf42c3 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:27.752491 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701fb60-8e4b-4dca-a7a0-e71a2ebf42c3 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:27.752755 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701fb60-8e4b-4dca-a7a0-e71a2ebf42c3 None admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:27.753393 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6701fb60-8e4b-4dca-a7a0-e71a2ebf42c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:27.753719 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6701fb60-8e4b-4dca-a7a0-e71a2ebf42c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:27.755181 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6701fb60-8e4b-4dca-a7a0-e71a2ebf42c3 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:27.765523 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5defb052-b318-4d65-909a-f8becb830499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:27.766164 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5defb052-b318-4d65-909a-f8becb830499 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:27.766440 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5defb052-b318-4d65-909a-f8becb830499 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:27.766708 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5defb052-b318-4d65-909a-f8becb830499 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:27.767249 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 250/502] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:38:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:27.768078 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6701fb60-8e4b-4dca-a7a0-e71a2ebf42c3 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:27.770602 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:27.780599 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5defb052-b318-4d65-909a-f8becb830499 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:38:27.787091 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-5defb052-b318-4d65-909a-f8becb830499 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:38:27.787091 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:27.787091 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:27.787091 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:27.787091 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:27.787091 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:27.787091 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:27.787091 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:27.787091 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:27.787091 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:27.787091 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:27.787091 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:27.787091 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:38:27.787091 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:38:27.787091 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:38:27.787091 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:38:27.788173 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:38:27.788173 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:38:27.788173 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:38:27.788173 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:38:27.788173 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:27.788173 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:27.788173 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:27.788173 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:27.788173 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:27.788173 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:27.788173 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:27.788173 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:27.788173 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:27.788173 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:27.788173 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:27.788173 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:27.789211 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:27.789211 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:27.789211 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:27.789211 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:27.789211 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:38:27.789211 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:38:27.789211 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:38:27.789211 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:38:27.789211 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:38:27.789211 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:38:27.789211 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:38:27.789211 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:27.789211 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 253/503] 10.222.0.60 () {56 vars in 1102 bytes} [Sat Sep 24 19:38:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:27.789211 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5defb052-b318-4d65-909a-f8becb830499 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:27.876798 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:27.879650 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6701fb60-8e4b-4dca-a7a0-e71a2ebf42c3 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:27.899001 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5defb052-b318-4d65-909a-f8becb830499 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:27.914446 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a8725b-8f75-446e-8a06-9646b0e0152c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:27.915060 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8725b-8f75-446e-8a06-9646b0e0152c None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:27.915334 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8725b-8f75-446e-8a06-9646b0e0152c None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:27.915600 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8725b-8f75-446e-8a06-9646b0e0152c None admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:27.916270 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a8725b-8f75-446e-8a06-9646b0e0152c None admin] RBAC: Adding query filter params (name=service) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:27.916569 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a8725b-8f75-446e-8a06-9646b0e0152c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:27.918018 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a8725b-8f75-446e-8a06-9646b0e0152c None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:27.929836 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 251/504] 10.222.0.60 () {56 vars in 1103 bytes} [Sat Sep 24 19:38:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:27.931173 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae81a1-766d-4557-b4ab-230e177429a2 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:27.931461 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae81a1-766d-4557-b4ab-230e177429a2 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:27.931736 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae81a1-766d-4557-b4ab-230e177429a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:27.939737 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faded092-f6c4-4240-9d9c-82883c9fde6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:27.940348 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faded092-f6c4-4240-9d9c-82883c9fde6e None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:27.940621 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faded092-f6c4-4240-9d9c-82883c9fde6e None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:27.940896 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faded092-f6c4-4240-9d9c-82883c9fde6e None admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:27.941615 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faded092-f6c4-4240-9d9c-82883c9fde6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:27.941986 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faded092-f6c4-4240-9d9c-82883c9fde6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:27.943374 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faded092-f6c4-4240-9d9c-82883c9fde6e None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:27.950366 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-11ae81a1-766d-4557-b4ab-230e177429a2 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:38:27.951546 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-11ae81a1-766d-4557-b4ab-230e177429a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:38:27.955625 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 254/505] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:38:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:27.956466 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faded092-f6c4-4240-9d9c-82883c9fde6e None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:28.018426 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:28.021426 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 252/506] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:38:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:38:28.036431 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ae81a1-766d-4557-b4ab-230e177429a2 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:28.079370 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faded092-f6c4-4240-9d9c-82883c9fde6e None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:28.126681 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a6108d-c7c9-4c9b-aaf3-ada83fdbdef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:28.127376 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a6108d-c7c9-4c9b-aaf3-ada83fdbdef6 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:28.127606 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a6108d-c7c9-4c9b-aaf3-ada83fdbdef6 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:28.127877 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a6108d-c7c9-4c9b-aaf3-ada83fdbdef6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:28.128127 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:28.137811 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a6108d-c7c9-4c9b-aaf3-ada83fdbdef6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:28.141536 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ae81a1-766d-4557-b4ab-230e177429a2 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:28.141669 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a6108d-c7c9-4c9b-aaf3-ada83fdbdef6 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:28.153711 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-a4a6108d-c7c9-4c9b-aaf3-ada83fdbdef6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 24 19:38:28.153711 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:28.153711 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:28.153711 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:28.153711 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:28.153711 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:28.153711 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:28.153711 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:28.153711 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:28.153711 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:28.153711 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:28.153711 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:28.153711 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:38:28.153711 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:38:28.153711 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:38:28.153711 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:38:28.154853 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:28.154853 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:28.154853 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:38:28.154853 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:38:28.154853 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:38:28.154853 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:38:28.154853 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:28.154853 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:28.154853 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:28.154853 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:28.154853 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:28.154853 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:28.154853 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:28.154853 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:28.154853 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:28.154853 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:28.154853 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:28.154853 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:28.155949 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:28.155949 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:28.155949 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:38:28.155949 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:38:28.155949 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:38:28.155949 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:38:28.155949 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:38:28.155949 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:38:28.155949 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 24 19:38:28.155949 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:28.161891 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 255/507] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Sep 24 19:38:27 2022] GET /identity/v3/users/glance => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:28.162764 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a6108d-c7c9-4c9b-aaf3-ada83fdbdef6 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:28.182921 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd07ada-a1d6-4303-bad1-59ef5c3a26fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:28.183536 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd07ada-a1d6-4303-bad1-59ef5c3a26fa None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:28.183812 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd07ada-a1d6-4303-bad1-59ef5c3a26fa None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:28.184085 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd07ada-a1d6-4303-bad1-59ef5c3a26fa None admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:28.184755 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd07ada-a1d6-4303-bad1-59ef5c3a26fa None admin] RBAC: Adding query filter params (name=service) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:28.185113 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd07ada-a1d6-4303-bad1-59ef5c3a26fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:28.186583 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd07ada-a1d6-4303-bad1-59ef5c3a26fa None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:28.201152 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 253/508] 10.222.0.60 () {56 vars in 1103 bytes} [Sat Sep 24 19:38:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:28.201152 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd07ada-a1d6-4303-bad1-59ef5c3a26fa None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:28.279513 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a6108d-c7c9-4c9b-aaf3-ada83fdbdef6 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:28.296238 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:28.315130 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd07ada-a1d6-4303-bad1-59ef5c3a26fa None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:28.315393 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a8dd10-0a66-4266-9f3f-753545da6ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:28.315794 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8dd10-0a66-4266-9f3f-753545da6ebd None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:28.316160 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8dd10-0a66-4266-9f3f-753545da6ebd None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:28.316341 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8dd10-0a66-4266-9f3f-753545da6ebd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:28.328010 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a8dd10-0a66-4266-9f3f-753545da6ebd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:28.329475 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a8dd10-0a66-4266-9f3f-753545da6ebd None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:28.346401 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-c2a8dd10-0a66-4266-9f3f-753545da6ebd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:28.346401 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:28.346401 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:28.346401 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:28.346401 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:28.346401 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:28.346401 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:28.346401 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:28.346401 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:28.346401 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:28.346401 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:28.346401 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:28.346401 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:38:28.346401 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:38:28.346401 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:38:28.346401 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:38:28.347543 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:28.347543 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:28.347543 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:28.347543 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:28.347543 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:28.347543 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:28.347543 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:28.347543 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:28.347543 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:28.347543 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:28.347543 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:28.347543 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:28.347543 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:28.347543 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:28.347543 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:28.347543 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:28.347543 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:38:28.349244 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:38:28.349244 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:28.349244 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:28.349244 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 256/509] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:38:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:28.349244 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a8dd10-0a66-4266-9f3f-753545da6ebd None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:28.354411 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f024c43a-1e7d-4cba-a20e-817a0dfcae99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:28.355072 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024c43a-1e7d-4cba-a20e-817a0dfcae99 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:28.355339 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024c43a-1e7d-4cba-a20e-817a0dfcae99 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:28.355611 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024c43a-1e7d-4cba-a20e-817a0dfcae99 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:28.362979 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f024c43a-1e7d-4cba-a20e-817a0dfcae99 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:28.364623 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f024c43a-1e7d-4cba-a20e-817a0dfcae99 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:28.376970 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-f024c43a-1e7d-4cba-a20e-817a0dfcae99 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:38:28.376970 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:28.376970 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:28.376970 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:28.376970 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:28.376970 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:28.376970 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:28.376970 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:28.376970 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:28.376970 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:28.376970 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:28.376970 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:28.376970 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:38:28.376970 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:38:28.376970 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:38:28.377994 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:38:28.377994 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:28.377994 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:28.377994 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:28.377994 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:28.377994 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:28.377994 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:28.377994 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:28.377994 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:28.377994 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:28.377994 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:28.377994 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:28.377994 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:28.377994 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:28.377994 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:28.377994 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:28.377994 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:28.378850 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:38:28.378850 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:38:28.378850 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:38:28.378850 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:38:28.378850 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:38:28.378850 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:38:28.378850 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:38:28.378850 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:28.378850 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 254/510] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Sep 24 19:38:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:28.379944 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f024c43a-1e7d-4cba-a20e-817a0dfcae99 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:28.399027 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:28.455591 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a8dd10-0a66-4266-9f3f-753545da6ebd None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:28.489653 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f024c43a-1e7d-4cba-a20e-817a0dfcae99 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:28.491394 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970f2a1-c0e4-4d03-ab58-ffa1d2c17cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:28.492007 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970f2a1-c0e4-4d03-ab58-ffa1d2c17cb2 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:28.492285 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970f2a1-c0e4-4d03-ab58-ffa1d2c17cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:28.492559 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970f2a1-c0e4-4d03-ab58-ffa1d2c17cb2 None admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:28.493299 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970f2a1-c0e4-4d03-ab58-ffa1d2c17cb2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:28.493635 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970f2a1-c0e4-4d03-ab58-ffa1d2c17cb2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:28.495065 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970f2a1-c0e4-4d03-ab58-ffa1d2c17cb2 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:28.527066 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b40f88-c5b3-4dd9-92e5-0f14245f4304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:28.527709 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b40f88-c5b3-4dd9-92e5-0f14245f4304 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:28.527972 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b40f88-c5b3-4dd9-92e5-0f14245f4304 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:28.528250 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b40f88-c5b3-4dd9-92e5-0f14245f4304 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:28.534151 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 257/511] 10.222.0.60 () {56 vars in 1137 bytes} [Sat Sep 24 19:38:28 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:28.539112 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970f2a1-c0e4-4d03-ab58-ffa1d2c17cb2 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:28.543349 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b40f88-c5b3-4dd9-92e5-0f14245f4304 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:28.544810 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b40f88-c5b3-4dd9-92e5-0f14245f4304 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:28.560026 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-22b40f88-c5b3-4dd9-92e5-0f14245f4304 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:28.560026 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:28.560026 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:28.560026 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:28.560026 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:28.560026 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:28.560026 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:28.560026 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:28.560026 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:28.560026 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:28.560026 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:28.560026 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:28.560026 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:38:28.560026 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:38:28.560026 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:38:28.560026 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:38:28.560956 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:28.560956 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:28.560956 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:28.560956 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:28.560956 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:28.560956 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:28.560956 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:28.560956 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:28.560956 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:28.560956 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:28.560956 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:28.560956 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:28.560956 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:28.560956 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:28.560956 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:28.560956 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:28.560956 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:38:28.561835 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:38:28.561835 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:28.561835 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:28.561835 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 255/512] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:38:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:28.562074 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b40f88-c5b3-4dd9-92e5-0f14245f4304 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:28.566033 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:28.628799 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:28.643710 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970f2a1-c0e4-4d03-ab58-ffa1d2c17cb2 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:28.667058 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b40f88-c5b3-4dd9-92e5-0f14245f4304 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:28.682545 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e673ae-e558-4908-9cfc-cbb06cb3281f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:28.683180 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e673ae-e558-4908-9cfc-cbb06cb3281f None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:28.683453 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e673ae-e558-4908-9cfc-cbb06cb3281f None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:28.683717 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e673ae-e558-4908-9cfc-cbb06cb3281f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:28.694527 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e673ae-e558-4908-9cfc-cbb06cb3281f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:28.695980 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e673ae-e558-4908-9cfc-cbb06cb3281f None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:28.705473 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70e6f2-fcba-4da3-8bf8-5cead695fc6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:28.706204 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70e6f2-fcba-4da3-8bf8-5cead695fc6e None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:28.706480 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70e6f2-fcba-4da3-8bf8-5cead695fc6e None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:28.706745 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70e6f2-fcba-4da3-8bf8-5cead695fc6e None admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:28.707388 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f70e6f2-fcba-4da3-8bf8-5cead695fc6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:28.708154 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f70e6f2-fcba-4da3-8bf8-5cead695fc6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:28.709048 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f70e6f2-fcba-4da3-8bf8-5cead695fc6e None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:28.711508 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-37e673ae-e558-4908-9cfc-cbb06cb3281f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:28.711508 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:28.711508 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:28.711508 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:28.711508 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:28.711508 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:28.711508 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:28.711508 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:28.711508 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:28.711508 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:28.711508 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:28.711508 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:28.711508 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:38:28.711508 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:38:28.711508 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:38:28.711508 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:38:28.712456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:28.712456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:28.712456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:28.712456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:28.712456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:28.712456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:28.712456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:28.712456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:28.712456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:28.712456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:28.712456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:28.712456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:28.712456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:28.712456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:28.712456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:28.712456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:28.712456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:38:28.713290 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:38:28.713290 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:28.713290 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:28.713290 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 258/513] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:38:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:28.714050 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e673ae-e558-4908-9cfc-cbb06cb3281f None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:28.724040 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 256/514] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:38:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:28.724899 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70e6f2-fcba-4da3-8bf8-5cead695fc6e None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:28.799760 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:28.822865 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e673ae-e558-4908-9cfc-cbb06cb3281f None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:28.838233 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70e6f2-fcba-4da3-8bf8-5cead695fc6e None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:28.860127 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f125df-d7f6-48c8-bfb6-3ec6774e7865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:28.860732 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f125df-d7f6-48c8-bfb6-3ec6774e7865 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:28.861010 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f125df-d7f6-48c8-bfb6-3ec6774e7865 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:28.861279 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f125df-d7f6-48c8-bfb6-3ec6774e7865 None admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:28.862000 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f125df-d7f6-48c8-bfb6-3ec6774e7865 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:28.862306 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f125df-d7f6-48c8-bfb6-3ec6774e7865 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:28.864553 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f125df-d7f6-48c8-bfb6-3ec6774e7865 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:28.865117 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:28.875640 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79625031-119b-4ced-9b2a-cdb556701b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:28.880901 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79625031-119b-4ced-9b2a-cdb556701b37 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:28.880901 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79625031-119b-4ced-9b2a-cdb556701b37 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:28.880901 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79625031-119b-4ced-9b2a-cdb556701b37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:28.883146 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 259/515] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Sep 24 19:38:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:28.883997 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f125df-d7f6-48c8-bfb6-3ec6774e7865 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:28.952925 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79625031-119b-4ced-9b2a-cdb556701b37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:28.954420 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79625031-119b-4ced-9b2a-cdb556701b37 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:29.000310 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f125df-d7f6-48c8-bfb6-3ec6774e7865 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:29.038616 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a978a72b-1b34-46b6-a2cf-dec6d548b7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:29.039225 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978a72b-1b34-46b6-a2cf-dec6d548b7fc None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:29.039504 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978a72b-1b34-46b6-a2cf-dec6d548b7fc None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:29.039776 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978a72b-1b34-46b6-a2cf-dec6d548b7fc None admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:29.040449 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a978a72b-1b34-46b6-a2cf-dec6d548b7fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:29.040755 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a978a72b-1b34-46b6-a2cf-dec6d548b7fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:29.042156 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a978a72b-1b34-46b6-a2cf-dec6d548b7fc None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:29.048983 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:29.054895 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 260/516] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:38:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:29.055694 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a978a72b-1b34-46b6-a2cf-dec6d548b7fc None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:29.059296 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 257/517] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Sep 24 19:38:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:38:29.060211 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79625031-119b-4ced-9b2a-cdb556701b37 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:29.087112 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:29.169681 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a978a72b-1b34-46b6-a2cf-dec6d548b7fc None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:29.171524 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79625031-119b-4ced-9b2a-cdb556701b37 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:29.205097 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b13ed-2926-4e05-965a-6a4f43608731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:29.205743 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b13ed-2926-4e05-965a-6a4f43608731 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:29.206022 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b13ed-2926-4e05-965a-6a4f43608731 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:29.206294 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b13ed-2926-4e05-965a-6a4f43608731 None admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:29.206936 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12b13ed-2926-4e05-965a-6a4f43608731 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:29.207770 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12b13ed-2926-4e05-965a-6a4f43608731 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:29.209224 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12b13ed-2926-4e05-965a-6a4f43608731 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:29.209769 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd415f73-59b6-4845-8c04-72492ae76dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:29.210409 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd415f73-59b6-4845-8c04-72492ae76dfd None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:29.210687 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd415f73-59b6-4845-8c04-72492ae76dfd None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:29.210955 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd415f73-59b6-4845-8c04-72492ae76dfd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:29.218389 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd415f73-59b6-4845-8c04-72492ae76dfd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:29.219816 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd415f73-59b6-4845-8c04-72492ae76dfd None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:29.221332 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 261/518] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:38:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:29.222423 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b13ed-2926-4e05-965a-6a4f43608731 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:29.236751 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-bd415f73-59b6-4845-8c04-72492ae76dfd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 24 19:38:29.236751 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:29.236751 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:29.236751 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:29.236751 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:29.236751 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:29.236751 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:29.236751 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:29.236751 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:29.236751 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:29.236751 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:29.236751 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:29.236751 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:38:29.236751 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:38:29.236751 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:38:29.236751 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:38:29.237959 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:29.237959 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:29.237959 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:38:29.237959 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:38:29.237959 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:38:29.237959 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:38:29.237959 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:29.237959 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:29.237959 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:29.237959 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:29.237959 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:29.237959 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:29.237959 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:29.237959 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:29.237959 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:29.237959 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:29.237959 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:29.237959 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:29.239202 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:29.239202 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:29.239202 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:38:29.239202 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:38:29.239202 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:38:29.239202 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:38:29.239202 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:38:29.239202 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:38:29.239202 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 24 19:38:29.239202 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:29.239935 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 258/519] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Sep 24 19:38:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:29.240824 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd415f73-59b6-4845-8c04-72492ae76dfd None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:29.288946 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:29.332029 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:29.332776 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b13ed-2926-4e05-965a-6a4f43608731 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:29.349983 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd415f73-59b6-4845-8c04-72492ae76dfd None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:29.369073 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeddf26-1aa6-4c3e-b501-b77abf742489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:29.369715 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeddf26-1aa6-4c3e-b501-b77abf742489 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:29.369993 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeddf26-1aa6-4c3e-b501-b77abf742489 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:29.370262 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeddf26-1aa6-4c3e-b501-b77abf742489 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:29.370982 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeddf26-1aa6-4c3e-b501-b77abf742489 None admin] RBAC: Adding query filter params (role.id=e9acf72f841f4030a76e8f9c41c95d7f, scope.project.id=5c2da88af5714e619238772bde676a42, user.id=f3b5047a59bc4547be643ffa78808a6d) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:29.371289 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeddf26-1aa6-4c3e-b501-b77abf742489 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:29.372719 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeddf26-1aa6-4c3e-b501-b77abf742489 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:29.378526 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 262/520] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Sep 24 19:38:29 2022] GET /identity/v3/role_assignments?user.id=f3b5047a59bc4547be643ffa78808a6d&scope.project.id=5c2da88af5714e619238772bde676a42&role.id=e9acf72f841f4030a76e8f9c41c95d7f => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:29.379392 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeddf26-1aa6-4c3e-b501-b77abf742489 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:29.386296 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16757e6d-ae8f-482a-ab51-3c99197e71d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:29.386957 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16757e6d-ae8f-482a-ab51-3c99197e71d2 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:29.387232 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16757e6d-ae8f-482a-ab51-3c99197e71d2 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:29.387498 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16757e6d-ae8f-482a-ab51-3c99197e71d2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:29.398724 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16757e6d-ae8f-482a-ab51-3c99197e71d2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:29.400224 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16757e6d-ae8f-482a-ab51-3c99197e71d2 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:29.414397 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-16757e6d-ae8f-482a-ab51-3c99197e71d2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 24 19:38:29.414397 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:29.414397 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:29.414397 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:29.414397 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:29.414397 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:29.414397 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:29.414397 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:29.414397 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:29.414397 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:29.414397 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:29.414397 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:29.414397 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:38:29.414397 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:38:29.414397 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:38:29.414397 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:38:29.415555 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:29.415555 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:29.415555 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:38:29.415555 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:38:29.415555 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:38:29.415555 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:38:29.415555 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:29.415555 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:29.415555 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:29.415555 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:29.415555 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:29.415555 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:29.415555 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:29.415555 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:29.415555 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:29.415555 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:29.415555 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:29.415555 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:29.416665 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:29.416665 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:29.416665 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:38:29.416665 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:38:29.416665 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:38:29.416665 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:38:29.416665 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:38:29.416665 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:38:29.416665 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 24 19:38:29.416665 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:29.417782 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 259/521] 10.222.0.60 () {56 vars in 1102 bytes} [Sat Sep 24 19:38:29 2022] GET /identity/v3/users/neutron => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:29.418389 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16757e6d-ae8f-482a-ab51-3c99197e71d2 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:29.540368 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeddf26-1aa6-4c3e-b501-b77abf742489 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:29.549007 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16757e6d-ae8f-482a-ab51-3c99197e71d2 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:29.565305 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:29.578676 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a826d-57e9-4694-9591-63b8339eeef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:29.580067 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a826d-57e9-4694-9591-63b8339eeef8 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:29.580067 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a826d-57e9-4694-9591-63b8339eeef8 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:29.580067 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a826d-57e9-4694-9591-63b8339eeef8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:29.599402 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241a826d-57e9-4694-9591-63b8339eeef8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:29.599602 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a299a1df-f0dc-439c-a6fc-5d7cf97ea575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:29.600212 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299a1df-f0dc-439c-a6fc-5d7cf97ea575 None admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:29.602855 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299a1df-f0dc-439c-a6fc-5d7cf97ea575 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:29.602855 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299a1df-f0dc-439c-a6fc-5d7cf97ea575 None admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:29.603090 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241a826d-57e9-4694-9591-63b8339eeef8 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:29.603177 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a299a1df-f0dc-439c-a6fc-5d7cf97ea575 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:29.603177 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a299a1df-f0dc-439c-a6fc-5d7cf97ea575 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:29.621105 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-241a826d-57e9-4694-9591-63b8339eeef8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:29.621105 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:29.621105 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:29.621105 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:29.621105 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:29.621105 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:29.621105 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:29.621105 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:29.621105 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:29.621105 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:29.621105 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:29.621105 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:29.621105 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:38:29.621105 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:38:29.621105 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:38:29.621105 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:38:29.623021 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:29.623021 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:29.623021 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:29.623021 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:29.623021 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:29.623021 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:29.623021 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:29.623021 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:29.623021 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:29.623021 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:29.623021 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:29.623021 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:29.623021 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:29.623021 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:29.623021 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:29.623021 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:29.623021 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:38:29.624688 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:38:29.624688 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:29.624688 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:29.624688 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 263/522] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:38:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:29.624688 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a826d-57e9-4694-9591-63b8339eeef8 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:29.689582 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 260/523] 10.222.0.60 () {60 vars in 1132 bytes} [Sat Sep 24 19:38:29 2022] POST /identity/v3/users => generated 247 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:38:29.689582 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a299a1df-f0dc-439c-a6fc-5d7cf97ea575 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:29.689582 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:29.772659 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a826d-57e9-4694-9591-63b8339eeef8 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:29.824298 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a299a1df-f0dc-439c-a6fc-5d7cf97ea575 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:29.828160 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d46657f-9a03-4bad-b7f5-e49232c8d47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:29.828955 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46657f-9a03-4bad-b7f5-e49232c8d47c None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:29.829234 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46657f-9a03-4bad-b7f5-e49232c8d47c None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:29.829528 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46657f-9a03-4bad-b7f5-e49232c8d47c None admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:29.830314 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d46657f-9a03-4bad-b7f5-e49232c8d47c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:29.830691 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d46657f-9a03-4bad-b7f5-e49232c8d47c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:29.832838 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d46657f-9a03-4bad-b7f5-e49232c8d47c None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:29.856113 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 264/524] 10.222.0.60 () {56 vars in 1137 bytes} [Sat Sep 24 19:38:29 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:29.856993 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d46657f-9a03-4bad-b7f5-e49232c8d47c None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:29.877787 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601362e0-efd3-4fd8-80be-6bab9069bef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:29.880413 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601362e0-efd3-4fd8-80be-6bab9069bef6 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:29.882311 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601362e0-efd3-4fd8-80be-6bab9069bef6 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:29.882311 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601362e0-efd3-4fd8-80be-6bab9069bef6 None admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:29.883551 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601362e0-efd3-4fd8-80be-6bab9069bef6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:29.883988 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601362e0-efd3-4fd8-80be-6bab9069bef6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:29.885596 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601362e0-efd3-4fd8-80be-6bab9069bef6 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:29.905685 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:29.909378 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 261/525] 10.222.0.60 () {56 vars in 1139 bytes} [Sat Sep 24 19:38:29 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:29.914578 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601362e0-efd3-4fd8-80be-6bab9069bef6 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:29.983529 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:30.010536 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d46657f-9a03-4bad-b7f5-e49232c8d47c None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:30.057968 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601362e0-efd3-4fd8-80be-6bab9069bef6 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:30.060753 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc88c1-657e-4867-96a5-415739203ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:30.062015 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc88c1-657e-4867-96a5-415739203ef2 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:30.062015 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc88c1-657e-4867-96a5-415739203ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:30.062015 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc88c1-657e-4867-96a5-415739203ef2 None admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:30.062888 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cc88c1-657e-4867-96a5-415739203ef2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:30.063287 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cc88c1-657e-4867-96a5-415739203ef2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:30.064774 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cc88c1-657e-4867-96a5-415739203ef2 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:30.078608 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 265/526] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:38:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:30.079612 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc88c1-657e-4867-96a5-415739203ef2 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:30.103783 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d0436-957f-425a-8df5-b8038b8993c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:30.104721 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d0436-957f-425a-8df5-b8038b8993c9 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:30.105127 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d0436-957f-425a-8df5-b8038b8993c9 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:30.105564 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d0436-957f-425a-8df5-b8038b8993c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:30.185916 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83d0436-957f-425a-8df5-b8038b8993c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:30.188071 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83d0436-957f-425a-8df5-b8038b8993c9 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:30.192081 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:30.201949 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc88c1-657e-4867-96a5-415739203ef2 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:30.239739 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b462be24-3015-49b4-a293-3eb3c928d142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:30.240468 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462be24-3015-49b4-a293-3eb3c928d142 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:30.240846 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462be24-3015-49b4-a293-3eb3c928d142 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:30.241222 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462be24-3015-49b4-a293-3eb3c928d142 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:30.259562 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:30.306736 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 262/527] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Sep 24 19:38:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:38:30.308245 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d0436-957f-425a-8df5-b8038b8993c9 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:30.322061 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b462be24-3015-49b4-a293-3eb3c928d142 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:30.323705 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b462be24-3015-49b4-a293-3eb3c928d142 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:30.418155 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d0436-957f-425a-8df5-b8038b8993c9 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:30.423050 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:30.434370 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 266/528] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Sep 24 19:38:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:38:30.435361 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b462be24-3015-49b4-a293-3eb3c928d142 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:30.458166 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0683e0d-5efb-448c-96fe-fe6835646336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:30.459094 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0683e0d-5efb-448c-96fe-fe6835646336 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:30.459499 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0683e0d-5efb-448c-96fe-fe6835646336 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:30.459904 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0683e0d-5efb-448c-96fe-fe6835646336 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:30.467531 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0683e0d-5efb-448c-96fe-fe6835646336 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:30.469218 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0683e0d-5efb-448c-96fe-fe6835646336 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:30.481541 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-d0683e0d-5efb-448c-96fe-fe6835646336 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:38:30.481541 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:30.481541 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:30.481541 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:30.481541 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:30.481541 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:30.481541 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:30.481541 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:30.481541 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:30.481541 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:30.481541 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:30.481541 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:30.481541 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:38:30.481541 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:38:30.481541 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:38:30.482611 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:38:30.482611 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:30.482611 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:30.482611 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:30.482611 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:30.482611 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:30.482611 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:30.482611 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:30.482611 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:30.482611 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:30.482611 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:30.482611 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:30.482611 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:30.482611 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:30.482611 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:30.482611 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:30.482611 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:30.483617 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:38:30.483617 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:38:30.483617 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:38:30.483617 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:38:30.483617 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:38:30.483617 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:38:30.483617 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:38:30.483617 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:30.485788 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 263/529] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Sep 24 19:38:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:30.486767 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0683e0d-5efb-448c-96fe-fe6835646336 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:30.513992 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:30.558490 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b462be24-3015-49b4-a293-3eb3c928d142 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:30.596548 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62973b5-85dc-49d4-b152-e2cadd689ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:30.597342 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62973b5-85dc-49d4-b152-e2cadd689ef6 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:30.597984 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62973b5-85dc-49d4-b152-e2cadd689ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:30.598266 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62973b5-85dc-49d4-b152-e2cadd689ef6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:30.600489 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0683e0d-5efb-448c-96fe-fe6835646336 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:30.609835 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62973b5-85dc-49d4-b152-e2cadd689ef6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:30.611286 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62973b5-85dc-49d4-b152-e2cadd689ef6 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:30.627807 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-a62973b5-85dc-49d4-b152-e2cadd689ef6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:30.627807 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:30.627807 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:30.627807 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:30.627807 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:30.627807 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:30.627807 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:30.627807 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:30.627807 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:30.627807 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:30.627807 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:30.627807 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:30.627807 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:38:30.627807 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:38:30.627807 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:38:30.627807 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:38:30.628795 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:30.628795 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:30.628795 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:30.628795 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:30.628795 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:30.628795 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:30.628795 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:30.628795 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:30.628795 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:30.628795 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:30.628795 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:30.628795 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:30.628795 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:30.628795 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:30.628795 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:30.628795 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:30.628795 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:38:30.630189 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:38:30.630189 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:30.630189 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:30.630189 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 267/530] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:38:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:30.631702 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62973b5-85dc-49d4-b152-e2cadd689ef6 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:30.648361 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c75a0-6990-4858-aadc-211360c1e69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:30.649015 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c75a0-6990-4858-aadc-211360c1e69b None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:30.649325 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c75a0-6990-4858-aadc-211360c1e69b None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:30.651159 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c75a0-6990-4858-aadc-211360c1e69b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:30.664358 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0c75a0-6990-4858-aadc-211360c1e69b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:30.666200 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0c75a0-6990-4858-aadc-211360c1e69b None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:30.684225 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-6a0c75a0-6990-4858-aadc-211360c1e69b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:30.684225 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:30.684225 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:30.684225 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:30.684225 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:30.684225 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:30.684225 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:30.684225 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:30.684225 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:30.684225 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:30.684225 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:30.684225 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:30.684225 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:38:30.684225 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:38:30.684225 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:38:30.684225 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:38:30.685876 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:30.685876 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:30.685876 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:30.685876 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:30.685876 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:30.685876 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:30.685876 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:30.685876 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:30.685876 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:30.685876 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:30.685876 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:30.685876 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:30.685876 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:30.685876 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:30.685876 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:30.685876 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:30.685876 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:38:30.686939 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:38:30.686939 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:30.686939 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:30.686939 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 264/531] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:38:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:30.687404 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c75a0-6990-4858-aadc-211360c1e69b None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:30.711807 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:30.784230 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62973b5-85dc-49d4-b152-e2cadd689ef6 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:30.790009 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:30.827761 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c75a0-6990-4858-aadc-211360c1e69b None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:30.837838 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c01b054-b615-4bb5-aa66-d76bc77db507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:30.839550 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01b054-b615-4bb5-aa66-d76bc77db507 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:30.840501 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01b054-b615-4bb5-aa66-d76bc77db507 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:30.840980 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01b054-b615-4bb5-aa66-d76bc77db507 None admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:30.842134 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c01b054-b615-4bb5-aa66-d76bc77db507 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:30.842593 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c01b054-b615-4bb5-aa66-d76bc77db507 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:30.844992 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c01b054-b615-4bb5-aa66-d76bc77db507 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:30.863452 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 268/532] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Sep 24 19:38:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:30.864532 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c01b054-b615-4bb5-aa66-d76bc77db507 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:30.873080 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799582f3-9729-4c47-aa79-8c6abaef0388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:30.874323 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799582f3-9729-4c47-aa79-8c6abaef0388 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:30.874323 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799582f3-9729-4c47-aa79-8c6abaef0388 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:30.874673 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799582f3-9729-4c47-aa79-8c6abaef0388 None admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:30.875428 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799582f3-9729-4c47-aa79-8c6abaef0388 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:30.875831 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799582f3-9729-4c47-aa79-8c6abaef0388 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:30.877302 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799582f3-9729-4c47-aa79-8c6abaef0388 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:30.893757 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 265/533] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:38:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:30.896165 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799582f3-9729-4c47-aa79-8c6abaef0388 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:30.985734 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c01b054-b615-4bb5-aa66-d76bc77db507 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:30.988568 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:31.022126 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799582f3-9729-4c47-aa79-8c6abaef0388 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:31.023537 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ec7b7-6509-44a7-85e2-69fbb94d4835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:31.024426 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ec7b7-6509-44a7-85e2-69fbb94d4835 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:31.024944 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ec7b7-6509-44a7-85e2-69fbb94d4835 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:31.025345 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ec7b7-6509-44a7-85e2-69fbb94d4835 None admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:31.026421 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ec7b7-6509-44a7-85e2-69fbb94d4835 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:31.027308 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ec7b7-6509-44a7-85e2-69fbb94d4835 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:31.029291 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ec7b7-6509-44a7-85e2-69fbb94d4835 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:31.043220 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 269/534] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:38:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:31.044476 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ec7b7-6509-44a7-85e2-69fbb94d4835 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:31.059055 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:31.069778 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d0daf4-d459-4afa-917f-6c6d3c5ed867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:31.070628 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d0daf4-d459-4afa-917f-6c6d3c5ed867 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:31.075372 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d0daf4-d459-4afa-917f-6c6d3c5ed867 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:31.075372 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d0daf4-d459-4afa-917f-6c6d3c5ed867 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:31.075372 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d0daf4-d459-4afa-917f-6c6d3c5ed867 None admin] RBAC: Adding query filter params (role.id=e9acf72f841f4030a76e8f9c41c95d7f, scope.project.id=5c2da88af5714e619238772bde676a42, user.id=aaf6ec7f5b4f490aa22a8e3bea91da39) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:31.075372 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d0daf4-d459-4afa-917f-6c6d3c5ed867 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:31.075372 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d0daf4-d459-4afa-917f-6c6d3c5ed867 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:31.080492 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 266/535] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Sep 24 19:38:30 2022] GET /identity/v3/role_assignments?user.id=aaf6ec7f5b4f490aa22a8e3bea91da39&scope.project.id=5c2da88af5714e619238772bde676a42&role.id=e9acf72f841f4030a76e8f9c41c95d7f => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:31.081520 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d0daf4-d459-4afa-917f-6c6d3c5ed867 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:31.321815 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ec7b7-6509-44a7-85e2-69fbb94d4835 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:31.372585 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d0daf4-d459-4afa-917f-6c6d3c5ed867 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:31.402579 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b32d60-deff-4982-a3be-8bb70be05796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:31.403234 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b32d60-deff-4982-a3be-8bb70be05796 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:31.403511 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b32d60-deff-4982-a3be-8bb70be05796 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:31.403782 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b32d60-deff-4982-a3be-8bb70be05796 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:31.422782 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b32d60-deff-4982-a3be-8bb70be05796 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:31.424282 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b32d60-deff-4982-a3be-8bb70be05796 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:31.426933 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e25af22-16e6-45d6-9845-44f4ab77d584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:31.427576 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25af22-16e6-45d6-9845-44f4ab77d584 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:31.427853 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25af22-16e6-45d6-9845-44f4ab77d584 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:31.428119 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25af22-16e6-45d6-9845-44f4ab77d584 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:31.435672 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e25af22-16e6-45d6-9845-44f4ab77d584 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:31.437155 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e25af22-16e6-45d6-9845-44f4ab77d584 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:31.447758 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-55b32d60-deff-4982-a3be-8bb70be05796 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:38:31.447758 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:31.447758 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:31.447758 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:31.447758 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:31.447758 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:31.447758 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:31.447758 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:31.447758 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:31.447758 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:31.447758 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:31.447758 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:31.447758 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:38:31.447758 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:38:31.447758 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:38:31.448809 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:38:31.448809 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:31.448809 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:31.448809 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:31.448809 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:31.448809 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:31.448809 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:31.448809 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:31.448809 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:31.448809 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:31.448809 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:31.448809 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:31.448809 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:31.448809 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:31.448809 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:31.448809 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:31.448809 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:31.449899 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:38:31.449899 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:38:31.449899 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:38:31.449899 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:38:31.449899 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:38:31.449899 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:38:31.449899 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:38:31.449899 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:31.450412 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-9e25af22-16e6-45d6-9845-44f4ab77d584 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:38:31.450412 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:31.450412 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:31.450412 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:31.450412 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:31.450412 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:31.450412 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:31.450412 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:31.450412 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:31.450412 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:31.450412 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:31.450412 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:31.450412 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:38:31.450412 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:38:31.450412 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:38:31.451229 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:38:31.451229 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:31.451229 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:31.451229 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:31.451229 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:31.451229 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:31.451229 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:31.451229 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:31.451229 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:31.451229 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:31.451229 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:31.451229 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:31.451229 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:31.451229 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:31.451229 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:31.451229 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:31.451229 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:31.452077 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:38:31.452077 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:38:31.452077 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:38:31.452077 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:38:31.452077 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:38:31.452077 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:38:31.452077 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:38:31.452077 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:31.452077 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 267/536] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Sep 24 19:38:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:31.456457 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e25af22-16e6-45d6-9845-44f4ab77d584 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:31.458406 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 270/537] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Sep 24 19:38:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 414 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:31.463990 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b32d60-deff-4982-a3be-8bb70be05796 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:31.528358 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:31.528862 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:31.616709 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e25af22-16e6-45d6-9845-44f4ab77d584 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:31.685803 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb80f85-a04f-49d7-9b81-b4ba3b53ed89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:31.686439 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb80f85-a04f-49d7-9b81-b4ba3b53ed89 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:31.686717 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb80f85-a04f-49d7-9b81-b4ba3b53ed89 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:31.686990 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb80f85-a04f-49d7-9b81-b4ba3b53ed89 None admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:31.687717 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb80f85-a04f-49d7-9b81-b4ba3b53ed89 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:31.688023 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb80f85-a04f-49d7-9b81-b4ba3b53ed89 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:31.689556 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb80f85-a04f-49d7-9b81-b4ba3b53ed89 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:31.694606 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b32d60-deff-4982-a3be-8bb70be05796 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:31.732844 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 268/538] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Sep 24 19:38:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:31.737672 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb80f85-a04f-49d7-9b81-b4ba3b53ed89 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:31.763890 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b684ac5c-b7f4-435c-bf72-0b3003c4c75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:31.764518 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b684ac5c-b7f4-435c-bf72-0b3003c4c75f None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:31.764961 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b684ac5c-b7f4-435c-bf72-0b3003c4c75f None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:31.765380 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b684ac5c-b7f4-435c-bf72-0b3003c4c75f None admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:31.766124 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b684ac5c-b7f4-435c-bf72-0b3003c4c75f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:31.766432 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b684ac5c-b7f4-435c-bf72-0b3003c4c75f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:31.768198 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b684ac5c-b7f4-435c-bf72-0b3003c4c75f None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:31.792512 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 271/539] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Sep 24 19:38:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:38:31.798594 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b684ac5c-b7f4-435c-bf72-0b3003c4c75f None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:31.888980 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb80f85-a04f-49d7-9b81-b4ba3b53ed89 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:31.902224 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:31.908804 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:31.919968 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b684ac5c-b7f4-435c-bf72-0b3003c4c75f None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:31.927909 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f582ff15-1892-4f3a-a6d8-59d43a32f516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:31.928590 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582ff15-1892-4f3a-a6d8-59d43a32f516 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:31.928936 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582ff15-1892-4f3a-a6d8-59d43a32f516 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:31.929239 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582ff15-1892-4f3a-a6d8-59d43a32f516 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:31.929983 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f582ff15-1892-4f3a-a6d8-59d43a32f516 None admin] RBAC: Adding query filter params (role.id=e9acf72f841f4030a76e8f9c41c95d7f, scope.project.id=5c2da88af5714e619238772bde676a42, user.id=fed7dee25fd54255ad24cd6ad880fa3f) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:31.930290 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f582ff15-1892-4f3a-a6d8-59d43a32f516 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:31.931732 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f582ff15-1892-4f3a-a6d8-59d43a32f516 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:31.937990 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 269/540] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Sep 24 19:38:31 2022] GET /identity/v3/role_assignments?user.id=fed7dee25fd54255ad24cd6ad880fa3f&scope.project.id=5c2da88af5714e619238772bde676a42&role.id=e9acf72f841f4030a76e8f9c41c95d7f => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:38:31.939341 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a0fa1-1cd2-4714-8ccf-71462c1e0049 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:31.939630 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a0fa1-1cd2-4714-8ccf-71462c1e0049 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:31.939905 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a0fa1-1cd2-4714-8ccf-71462c1e0049 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:31.949537 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 270/541] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:38:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:38:31.949537 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f55dd-78b7-4124-ac42-356251691ba4 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:31.949537 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f55dd-78b7-4124-ac42-356251691ba4 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:31.949537 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f55dd-78b7-4124-ac42-356251691ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:31.972421 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-fd8f55dd-78b7-4124-ac42-356251691ba4 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:38:31.978580 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-fd8f55dd-78b7-4124-ac42-356251691ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:38:31.999067 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd99e184-baab-46e7-8223-1dc5487d9c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:31.999967 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd99e184-baab-46e7-8223-1dc5487d9c1d None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:32.000421 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd99e184-baab-46e7-8223-1dc5487d9c1d None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:32.000847 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd99e184-baab-46e7-8223-1dc5487d9c1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:32.002441 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd99e184-baab-46e7-8223-1dc5487d9c1d None admin] RBAC: Adding query filter params (role.id=e9acf72f841f4030a76e8f9c41c95d7f, scope.project.id=5c2da88af5714e619238772bde676a42, user.id=e9057442a6cd4b45acdd588d432d8318) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:32.003222 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd99e184-baab-46e7-8223-1dc5487d9c1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:32.006161 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd99e184-baab-46e7-8223-1dc5487d9c1d None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:32.024452 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 272/542] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Sep 24 19:38:31 2022] GET /identity/v3/role_assignments?user.id=e9057442a6cd4b45acdd588d432d8318&scope.project.id=5c2da88af5714e619238772bde676a42&role.id=e9acf72f841f4030a76e8f9c41c95d7f => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:32.078862 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 271/543] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:38:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:38:32.261559 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb1179-45bf-41d5-b0c2-4d0bfe25c663 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:32.261999 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb1179-45bf-41d5-b0c2-4d0bfe25c663 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:32.262423 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb1179-45bf-41d5-b0c2-4d0bfe25c663 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:32.264357 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 273/544] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:38:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:38:32.271252 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e70ddc-984d-4532-8f62-f615e8ef263d None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:32.271513 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e70ddc-984d-4532-8f62-f615e8ef263d None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:32.271868 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e70ddc-984d-4532-8f62-f615e8ef263d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:32.294920 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-95e70ddc-984d-4532-8f62-f615e8ef263d None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:38:32.296125 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-95e70ddc-984d-4532-8f62-f615e8ef263d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:38:32.397883 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 272/545] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:38:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 19:38:32.473482 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abb1179-45bf-41d5-b0c2-4d0bfe25c663 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:32.638218 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abb1179-45bf-41d5-b0c2-4d0bfe25c663 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:32.690292 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf70f98-b3a1-4299-9313-09a395f89f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:32.690949 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf70f98-b3a1-4299-9313-09a395f89f24 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:32.691236 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf70f98-b3a1-4299-9313-09a395f89f24 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:32.692131 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf70f98-b3a1-4299-9313-09a395f89f24 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:32.714612 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf70f98-b3a1-4299-9313-09a395f89f24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:38:32.719643 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-0bf70f98-b3a1-4299-9313-09a395f89f24 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:38:32.719643 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:32.719643 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:32.719643 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:32.719643 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:32.719643 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:32.719643 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:32.719643 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:32.719643 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:32.719643 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:32.719643 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:32.719643 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:32.719643 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:38:32.719643 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:38:32.719643 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:38:32.719643 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:38:32.720526 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:38:32.720526 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:38:32.720526 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:38:32.720526 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:38:32.720526 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:32.720526 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:32.720526 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:32.720526 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:32.720526 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:32.720526 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:32.720526 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:32.720526 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:32.720526 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:32.720526 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:32.720526 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:32.720526 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:32.721321 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:32.721321 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:32.721321 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:32.721321 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:32.721321 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:38:32.721321 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:38:32.721321 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:38:32.721321 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:38:32.721321 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:38:32.721321 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:38:32.721321 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:38:32.721321 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:32.721321 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 274/546] 10.222.0.60 () {56 vars in 1102 bytes} [Sat Sep 24 19:38:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:32.729277 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e70ddc-984d-4532-8f62-f615e8ef263d None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:32.729451 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf70f98-b3a1-4299-9313-09a395f89f24 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:32.744478 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:32.841877 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:32.866390 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf70f98-b3a1-4299-9313-09a395f89f24 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:32.912817 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60655d85-6116-4110-9575-0ed9de291e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:32.912817 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60655d85-6116-4110-9575-0ed9de291e48 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:32.913532 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60655d85-6116-4110-9575-0ed9de291e48 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:32.913532 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60655d85-6116-4110-9575-0ed9de291e48 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:32.938608 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60655d85-6116-4110-9575-0ed9de291e48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:38:32.945136 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-60655d85-6116-4110-9575-0ed9de291e48 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:38:32.945136 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:32.945136 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:32.945136 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:32.945136 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:32.945136 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:32.945136 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:32.945136 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:32.945136 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:32.945136 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:32.945136 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:32.945136 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:32.945136 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:38:32.945136 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:38:32.945136 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:38:32.945136 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:38:32.946170 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:38:32.946170 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:38:32.946170 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:38:32.946170 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:38:32.946170 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:32.946170 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:32.946170 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:32.946170 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:32.946170 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:32.946170 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:32.946170 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:32.946170 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:32.946170 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:32.946170 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:32.946170 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:32.946170 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:32.947471 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:32.947471 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:32.947471 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:32.947471 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:32.947471 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:38:32.947471 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:38:32.947471 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:38:32.947471 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:38:32.947471 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:38:32.947471 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:38:32.947471 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:38:32.947471 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:32.947471 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 275/547] 10.222.0.60 () {56 vars in 1102 bytes} [Sat Sep 24 19:38:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:32.953648 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60655d85-6116-4110-9575-0ed9de291e48 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:32.955091 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e70ddc-984d-4532-8f62-f615e8ef263d None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:33.009259 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d8376-bf13-44a6-b9e3-af7111bd11b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:33.009901 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d8376-bf13-44a6-b9e3-af7111bd11b0 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:33.010179 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d8376-bf13-44a6-b9e3-af7111bd11b0 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:33.010451 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d8376-bf13-44a6-b9e3-af7111bd11b0 None admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:33.011120 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189d8376-bf13-44a6-b9e3-af7111bd11b0 None admin] RBAC: Adding query filter params (name=service) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:33.011420 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189d8376-bf13-44a6-b9e3-af7111bd11b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:33.012787 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189d8376-bf13-44a6-b9e3-af7111bd11b0 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:33.030947 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 273/548] 10.222.0.60 () {56 vars in 1103 bytes} [Sat Sep 24 19:38:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:33.036576 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d8376-bf13-44a6-b9e3-af7111bd11b0 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:33.122790 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:33.150327 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d8376-bf13-44a6-b9e3-af7111bd11b0 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:33.170080 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:33.189237 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec18289-6c88-4647-975b-482822daa248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:33.196107 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec18289-6c88-4647-975b-482822daa248 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:33.196107 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec18289-6c88-4647-975b-482822daa248 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:33.196107 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec18289-6c88-4647-975b-482822daa248 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:33.203484 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec18289-6c88-4647-975b-482822daa248 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:33.205053 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec18289-6c88-4647-975b-482822daa248 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:33.224382 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-5ec18289-6c88-4647-975b-482822daa248 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:33.224382 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:33.224382 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:33.224382 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:33.224382 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:33.224382 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:33.224382 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:33.224382 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:33.224382 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:33.224382 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:33.224382 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:33.224382 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:33.224382 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:38:33.224382 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:38:33.224382 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:38:33.224382 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:38:33.225370 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:33.225370 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:33.225370 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:33.225370 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:33.225370 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:33.225370 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:33.225370 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:33.225370 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:33.225370 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:33.225370 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:33.225370 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:33.225370 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:33.225370 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:33.225370 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:33.225370 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:33.225370 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:33.225370 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:38:33.226358 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:38:33.226358 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:33.226358 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:33.226358 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 274/549] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:38:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:38:33.232014 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec18289-6c88-4647-975b-482822daa248 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:33.267534 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60655d85-6116-4110-9575-0ed9de291e48 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:33.349305 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec18289-6c88-4647-975b-482822daa248 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:33.388052 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6200d10b-377e-490e-8b5a-c671c4df3739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:33.388785 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6200d10b-377e-490e-8b5a-c671c4df3739 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:33.389067 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6200d10b-377e-490e-8b5a-c671c4df3739 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:33.389346 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6200d10b-377e-490e-8b5a-c671c4df3739 None admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:33.390173 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6200d10b-377e-490e-8b5a-c671c4df3739 None admin] RBAC: Adding query filter params (name=service) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:33.390448 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a39b3cb-3bbb-418e-afd5-8cb453a11017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:33.390674 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6200d10b-377e-490e-8b5a-c671c4df3739 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:33.391076 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39b3cb-3bbb-418e-afd5-8cb453a11017 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:33.391355 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39b3cb-3bbb-418e-afd5-8cb453a11017 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:33.391627 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39b3cb-3bbb-418e-afd5-8cb453a11017 None admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:33.391877 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6200d10b-377e-490e-8b5a-c671c4df3739 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:33.392392 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a39b3cb-3bbb-418e-afd5-8cb453a11017 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:33.392699 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a39b3cb-3bbb-418e-afd5-8cb453a11017 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:33.394128 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a39b3cb-3bbb-418e-afd5-8cb453a11017 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:33.404932 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 276/550] 10.222.0.60 () {56 vars in 1103 bytes} [Sat Sep 24 19:38:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 452 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:33.412933 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 275/551] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:38:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:33.413595 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6200d10b-377e-490e-8b5a-c671c4df3739 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:33.418501 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a39b3cb-3bbb-418e-afd5-8cb453a11017 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:33.435537 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:33.526991 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a39b3cb-3bbb-418e-afd5-8cb453a11017 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:33.563800 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87e041-79e9-4425-9cbe-6e98a301aee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:33.564901 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87e041-79e9-4425-9cbe-6e98a301aee7 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:33.565407 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87e041-79e9-4425-9cbe-6e98a301aee7 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:33.565938 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87e041-79e9-4425-9cbe-6e98a301aee7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:33.578572 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd87e041-79e9-4425-9cbe-6e98a301aee7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:33.580046 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd87e041-79e9-4425-9cbe-6e98a301aee7 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:33.593319 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-cd87e041-79e9-4425-9cbe-6e98a301aee7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 24 19:38:33.593319 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:33.593319 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:33.593319 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:33.593319 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:33.593319 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:33.593319 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:33.593319 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:33.593319 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:33.593319 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:33.593319 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:33.593319 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:33.593319 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:38:33.593319 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:38:33.593319 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:38:33.593319 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:38:33.594343 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:33.594343 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:33.594343 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:38:33.594343 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:38:33.594343 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:38:33.594343 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:38:33.594343 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:33.594343 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:33.594343 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:33.594343 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:33.594343 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:33.594343 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:33.594343 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:33.594343 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:33.594343 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:33.594343 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:33.594343 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:33.594343 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:33.595669 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:33.595669 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:33.595669 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:38:33.595669 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:38:33.595669 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:38:33.595669 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:38:33.595669 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:38:33.595669 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:38:33.595669 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 24 19:38:33.595669 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:33.595669 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 276/552] 10.222.0.60 () {56 vars in 1093 bytes} [Sat Sep 24 19:38:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:38:33.600723 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87e041-79e9-4425-9cbe-6e98a301aee7 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:33.650381 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6200d10b-377e-490e-8b5a-c671c4df3739 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:33.691132 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:33.699662 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc876d-5522-4549-9425-5b9747776b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:33.704069 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc876d-5522-4549-9425-5b9747776b7c None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:33.704069 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc876d-5522-4549-9425-5b9747776b7c None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:33.704069 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc876d-5522-4549-9425-5b9747776b7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:33.714139 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc876d-5522-4549-9425-5b9747776b7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:33.716079 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc876d-5522-4549-9425-5b9747776b7c None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:33.733650 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-e9fc876d-5522-4549-9425-5b9747776b7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:33.733650 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:33.733650 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:33.733650 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:33.733650 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:33.733650 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:33.733650 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:33.733650 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:33.733650 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:33.733650 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:33.733650 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:33.733650 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:33.733650 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:38:33.733650 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:38:33.733650 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:38:33.733650 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:38:33.734649 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:33.734649 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:33.734649 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:33.734649 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:33.734649 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:33.734649 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:33.734649 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:33.734649 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:33.734649 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:33.734649 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:33.734649 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:33.734649 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:33.734649 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:33.734649 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:33.734649 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:33.734649 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:33.734649 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:38:33.735502 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:38:33.735502 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:33.735502 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:33.737831 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 277/553] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:38:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:33.742747 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:33.746568 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc876d-5522-4549-9425-5b9747776b7c None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:33.796647 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87e041-79e9-4425-9cbe-6e98a301aee7 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:33.880924 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21257e34-4071-405d-9ad0-9b675841262a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:33.881830 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21257e34-4071-405d-9ad0-9b675841262a None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:33.882109 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21257e34-4071-405d-9ad0-9b675841262a None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:33.882380 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21257e34-4071-405d-9ad0-9b675841262a None admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:33.883123 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21257e34-4071-405d-9ad0-9b675841262a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:33.883428 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21257e34-4071-405d-9ad0-9b675841262a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:33.884881 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21257e34-4071-405d-9ad0-9b675841262a None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:33.923993 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 277/554] 10.222.0.60 () {56 vars in 1133 bytes} [Sat Sep 24 19:38:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:38:33.933894 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21257e34-4071-405d-9ad0-9b675841262a None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:33.951715 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc876d-5522-4549-9425-5b9747776b7c None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:34.008401 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b136708-01e9-416e-bc0f-25c1fb8ec65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:34.009199 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b136708-01e9-416e-bc0f-25c1fb8ec65e None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:34.009487 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b136708-01e9-416e-bc0f-25c1fb8ec65e None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:34.009785 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b136708-01e9-416e-bc0f-25c1fb8ec65e None admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:34.010447 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b136708-01e9-416e-bc0f-25c1fb8ec65e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:34.010754 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b136708-01e9-416e-bc0f-25c1fb8ec65e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:34.013108 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b136708-01e9-416e-bc0f-25c1fb8ec65e None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:34.029625 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 278/555] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:38:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:34.032348 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d315b21-d7b6-4354-acab-1fab21cbf8e2 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:34.033086 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d315b21-d7b6-4354-acab-1fab21cbf8e2 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:34.034697 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d315b21-d7b6-4354-acab-1fab21cbf8e2 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:34.038723 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 279/556] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:38:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:38:34.039718 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d315b21-d7b6-4354-acab-1fab21cbf8e2 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:34.108824 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:34.113812 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21257e34-4071-405d-9ad0-9b675841262a None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:34.152305 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:34.158541 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e19bb1-8323-4c9a-83d9-30ff29383de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:34.159651 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e19bb1-8323-4c9a-83d9-30ff29383de0 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:34.160207 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e19bb1-8323-4c9a-83d9-30ff29383de0 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:34.160661 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e19bb1-8323-4c9a-83d9-30ff29383de0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:34.176798 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e19bb1-8323-4c9a-83d9-30ff29383de0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:34.179179 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e19bb1-8323-4c9a-83d9-30ff29383de0 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:34.181351 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d315b21-d7b6-4354-acab-1fab21cbf8e2 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:34.198702 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-71e19bb1-8323-4c9a-83d9-30ff29383de0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:34.198702 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:34.198702 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:34.198702 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:34.198702 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:34.198702 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:34.198702 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:34.198702 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:34.198702 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:34.198702 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:34.198702 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:34.198702 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:34.198702 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:38:34.198702 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:38:34.198702 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:38:34.198702 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:38:34.200156 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:34.200156 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:34.200156 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:34.200156 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:34.200156 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:34.200156 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:34.200156 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:34.200156 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:34.200156 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:34.200156 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:34.200156 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:34.200156 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:34.200156 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:34.200156 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:34.200156 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:34.200156 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:34.200156 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:38:34.201017 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:38:34.201017 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:34.201017 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:34.208771 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 278/557] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:38:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:34.210779 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547807db-c3e5-491f-97c9-1e009e201600 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:34.211276 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547807db-c3e5-491f-97c9-1e009e201600 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:34.211837 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547807db-c3e5-491f-97c9-1e009e201600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:34.224937 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e37fe4-8e75-4e1c-b7f2-4bb7127d1237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:34.225628 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e37fe4-8e75-4e1c-b7f2-4bb7127d1237 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:34.225915 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e37fe4-8e75-4e1c-b7f2-4bb7127d1237 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:34.226193 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e37fe4-8e75-4e1c-b7f2-4bb7127d1237 None admin] PATH_INFO: `/v3/users/swift` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:34.234476 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-547807db-c3e5-491f-97c9-1e009e201600 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:38:34.234962 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e37fe4-8e75-4e1c-b7f2-4bb7127d1237 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:34.236263 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-547807db-c3e5-491f-97c9-1e009e201600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:38:34.236467 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e37fe4-8e75-4e1c-b7f2-4bb7127d1237 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:34.251805 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-80e37fe4-8e75-4e1c-b7f2-4bb7127d1237 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 24 19:38:34.251805 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:34.251805 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:34.251805 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:34.251805 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:34.251805 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:34.251805 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:34.251805 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:34.251805 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:34.251805 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:34.251805 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:34.251805 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:34.251805 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:38:34.251805 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:38:34.251805 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:38:34.251805 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:38:34.258913 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:34.258913 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:34.258913 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:38:34.258913 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:38:34.258913 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:38:34.258913 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:38:34.258913 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:34.258913 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:34.258913 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:34.258913 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:34.258913 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:34.258913 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:34.258913 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:34.258913 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:34.258913 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:34.258913 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:34.258913 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:34.258913 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:34.259968 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:34.259968 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:34.259968 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:38:34.259968 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:38:34.259968 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:38:34.259968 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:38:34.259968 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:38:34.259968 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:38:34.259968 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 24 19:38:34.259968 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:34.259968 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 280/558] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Sep 24 19:38:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:34.259968 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e37fe4-8e75-4e1c-b7f2-4bb7127d1237 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:34.331044 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 279/559] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:38:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:38:34.332650 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547807db-c3e5-491f-97c9-1e009e201600 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:34.404274 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e37fe4-8e75-4e1c-b7f2-4bb7127d1237 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:34.409409 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:34.482946 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920bc95a-dadb-46e2-897b-f59bd5214f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:34.484410 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920bc95a-dadb-46e2-897b-f59bd5214f35 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:34.485474 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920bc95a-dadb-46e2-897b-f59bd5214f35 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:34.486060 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920bc95a-dadb-46e2-897b-f59bd5214f35 None admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:34.487895 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920bc95a-dadb-46e2-897b-f59bd5214f35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:34.489592 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920bc95a-dadb-46e2-897b-f59bd5214f35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:34.491100 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920bc95a-dadb-46e2-897b-f59bd5214f35 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:34.500763 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547807db-c3e5-491f-97c9-1e009e201600 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:34.507481 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 281/560] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:38:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:34.508970 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38572c5d-6a04-4cbf-9ffa-40c6de3f951f None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:34.509443 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38572c5d-6a04-4cbf-9ffa-40c6de3f951f None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:34.509896 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38572c5d-6a04-4cbf-9ffa-40c6de3f951f None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:34.515528 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 282/561] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:38:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:38:34.516766 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38572c5d-6a04-4cbf-9ffa-40c6de3f951f None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:34.525614 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:34.552357 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cad52a-c688-461c-846e-9fb41ba85ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:34.553217 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cad52a-c688-461c-846e-9fb41ba85ef9 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:34.553663 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cad52a-c688-461c-846e-9fb41ba85ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:34.554239 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cad52a-c688-461c-846e-9fb41ba85ef9 None admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:34.555559 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cad52a-c688-461c-846e-9fb41ba85ef9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:34.556322 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cad52a-c688-461c-846e-9fb41ba85ef9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:34.558377 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cad52a-c688-461c-846e-9fb41ba85ef9 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:34.585653 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 280/562] 10.222.0.60 () {56 vars in 1135 bytes} [Sat Sep 24 19:38:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:34.587235 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b233982-a1d4-4b06-a4f4-1e6664ed38ec None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:34.587617 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b233982-a1d4-4b06-a4f4-1e6664ed38ec None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:34.587980 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b233982-a1d4-4b06-a4f4-1e6664ed38ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:34.610587 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-2b233982-a1d4-4b06-a4f4-1e6664ed38ec None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:38:34.611917 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-2b233982-a1d4-4b06-a4f4-1e6664ed38ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:38:34.651186 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38572c5d-6a04-4cbf-9ffa-40c6de3f951f None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:34.697024 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b53a10-df83-4306-84cf-c5f8b96f7423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:34.697823 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b53a10-df83-4306-84cf-c5f8b96f7423 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:34.698009 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b53a10-df83-4306-84cf-c5f8b96f7423 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:34.698258 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b53a10-df83-4306-84cf-c5f8b96f7423 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:34.704170 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 281/563] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:38:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:38:34.709782 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b233982-a1d4-4b06-a4f4-1e6664ed38ec None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:34.709939 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b53a10-df83-4306-84cf-c5f8b96f7423 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:34.709939 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b53a10-df83-4306-84cf-c5f8b96f7423 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:34.722574 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-f8b53a10-df83-4306-84cf-c5f8b96f7423 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:38:34.722574 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:34.722574 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:34.722574 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:34.722574 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:34.722574 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:34.722574 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:34.722574 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:34.722574 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:34.722574 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:34.722574 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:34.722574 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:34.722574 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:38:34.722574 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:38:34.722574 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:38:34.724230 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:38:34.724230 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:34.724230 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:34.724230 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:34.724230 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:34.724230 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:34.724230 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:34.724230 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:34.724230 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:34.724230 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:34.724230 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:34.724230 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:34.724230 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:34.724230 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:34.724230 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:34.724230 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:34.724230 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:34.725103 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:38:34.725103 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:38:34.725103 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:38:34.725103 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:38:34.725103 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:38:34.725103 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:38:34.725103 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:38:34.725103 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:34.725103 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 283/564] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Sep 24 19:38:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:34.725616 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b53a10-df83-4306-84cf-c5f8b96f7423 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:34.782004 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:34.845964 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b53a10-df83-4306-84cf-c5f8b96f7423 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:34.852667 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b233982-a1d4-4b06-a4f4-1e6664ed38ec None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:34.854888 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:34.886976 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63fa848-e7d8-452a-bf3f-95d59b53b1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:34.887883 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63fa848-e7d8-452a-bf3f-95d59b53b1f8 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:34.888164 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63fa848-e7d8-452a-bf3f-95d59b53b1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:34.888434 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63fa848-e7d8-452a-bf3f-95d59b53b1f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:34.897554 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5336a73-4c6d-4a30-9f94-aea7a144ba42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:34.898177 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5336a73-4c6d-4a30-9f94-aea7a144ba42 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:34.898463 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5336a73-4c6d-4a30-9f94-aea7a144ba42 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:34.898734 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5336a73-4c6d-4a30-9f94-aea7a144ba42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:34.903292 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63fa848-e7d8-452a-bf3f-95d59b53b1f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:38:34.908640 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-e63fa848-e7d8-452a-bf3f-95d59b53b1f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:38:34.908640 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:34.908640 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:34.908640 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:34.908640 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:34.908640 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:34.908640 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:34.908640 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:34.908640 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:34.908640 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:34.908640 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:34.908640 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:34.908640 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:38:34.908640 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:38:34.908640 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:38:34.908640 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:38:34.909642 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:38:34.909642 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:38:34.909642 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:38:34.909642 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:38:34.909642 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:34.909642 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:34.909642 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:34.909642 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:34.909642 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:34.909642 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:34.909642 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:34.909642 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:34.909642 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:34.909642 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:34.909642 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:34.909642 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:34.910483 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:34.910483 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:34.910483 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:34.910483 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:34.910483 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:38:34.910483 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:38:34.910483 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:38:34.910483 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:38:34.910483 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:38:34.910483 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:38:34.910483 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:38:34.910483 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:34.910483 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 284/565] 10.222.0.60 () {56 vars in 1102 bytes} [Sat Sep 24 19:38:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:34.911332 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63fa848-e7d8-452a-bf3f-95d59b53b1f8 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:34.984440 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5336a73-4c6d-4a30-9f94-aea7a144ba42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:34.985981 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5336a73-4c6d-4a30-9f94-aea7a144ba42 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:35.007319 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:35.026903 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63fa848-e7d8-452a-bf3f-95d59b53b1f8 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:35.061292 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf73e29-3a5d-4a84-86a3-fa5c26bf162f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:35.061937 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf73e29-3a5d-4a84-86a3-fa5c26bf162f None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:35.062219 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf73e29-3a5d-4a84-86a3-fa5c26bf162f None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:35.062499 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf73e29-3a5d-4a84-86a3-fa5c26bf162f None admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:35.063202 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf73e29-3a5d-4a84-86a3-fa5c26bf162f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:35.063508 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf73e29-3a5d-4a84-86a3-fa5c26bf162f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:35.064960 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf73e29-3a5d-4a84-86a3-fa5c26bf162f None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:35.077332 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 285/566] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Sep 24 19:38:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:35.078633 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918e2e6-1058-442b-820a-d16f3a97ee2c None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:35.078918 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918e2e6-1058-442b-820a-d16f3a97ee2c None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:35.079194 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918e2e6-1058-442b-820a-d16f3a97ee2c None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:35.080557 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 286/567] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:38:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:38:35.081094 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8918e2e6-1058-442b-820a-d16f3a97ee2c None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:35.103016 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 282/568] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Sep 24 19:38:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:38:35.103872 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5336a73-4c6d-4a30-9f94-aea7a144ba42 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:35.106363 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:35.190908 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8918e2e6-1058-442b-820a-d16f3a97ee2c None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:35.211010 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5336a73-4c6d-4a30-9f94-aea7a144ba42 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:35.227490 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8274d016-b690-4672-bb07-20e196ad85b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:35.228102 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274d016-b690-4672-bb07-20e196ad85b8 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:35.228383 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274d016-b690-4672-bb07-20e196ad85b8 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:35.228658 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274d016-b690-4672-bb07-20e196ad85b8 None admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:35.229329 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8274d016-b690-4672-bb07-20e196ad85b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:35.229668 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8274d016-b690-4672-bb07-20e196ad85b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:35.231056 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8274d016-b690-4672-bb07-20e196ad85b8 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:35.239879 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 287/569] 10.222.0.60 () {56 vars in 1103 bytes} [Sat Sep 24 19:38:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:35.240697 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8274d016-b690-4672-bb07-20e196ad85b8 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:35.244648 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:35.248932 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f62f2c9-3683-43b9-8b97-9dbce63f61cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:35.249474 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62f2c9-3683-43b9-8b97-9dbce63f61cd None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:35.249783 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62f2c9-3683-43b9-8b97-9dbce63f61cd None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:35.250055 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62f2c9-3683-43b9-8b97-9dbce63f61cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:35.267463 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f62f2c9-3683-43b9-8b97-9dbce63f61cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:38:35.272807 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-0f62f2c9-3683-43b9-8b97-9dbce63f61cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:38:35.272807 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:35.272807 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:35.272807 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:35.272807 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:35.272807 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:35.272807 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:35.272807 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:35.272807 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:35.272807 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:35.272807 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:35.272807 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:35.272807 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:38:35.272807 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:38:35.272807 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:38:35.272807 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:38:35.274018 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:38:35.274018 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:38:35.274018 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:38:35.274018 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:38:35.274018 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:35.274018 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:35.274018 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:35.274018 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:35.274018 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:35.274018 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:35.274018 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:35.274018 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:35.274018 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:35.274018 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:35.274018 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:35.274018 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:35.274859 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:35.274859 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:35.274859 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:35.274859 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:35.274859 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:38:35.274859 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:38:35.274859 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:38:35.274859 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:38:35.274859 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:38:35.274859 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:38:35.274859 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:38:35.274859 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:35.274859 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 283/570] 10.222.0.60 () {56 vars in 1102 bytes} [Sat Sep 24 19:38:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:35.275950 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0ea1b-782d-4947-a05d-611d4855517e None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:35.276214 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0ea1b-782d-4947-a05d-611d4855517e None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:35.276549 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0ea1b-782d-4947-a05d-611d4855517e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:35.295552 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-22d0ea1b-782d-4947-a05d-611d4855517e None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:38:35.296761 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-22d0ea1b-782d-4947-a05d-611d4855517e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:38:35.345798 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8274d016-b690-4672-bb07-20e196ad85b8 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:35.364351 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:35.374436 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 284/571] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:38:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:38:35.375288 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d0ea1b-782d-4947-a05d-611d4855517e None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:35.397730 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a1d49-757a-4765-8a27-e39b0eb77cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:35.398403 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a1d49-757a-4765-8a27-e39b0eb77cde None admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:35.398680 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a1d49-757a-4765-8a27-e39b0eb77cde None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:35.398954 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a1d49-757a-4765-8a27-e39b0eb77cde None admin] PATH_INFO: `/v3/projects/5c2da88af5714e619238772bde676a42/users/f3b5047a59bc4547be643ffa78808a6d/roles/e9acf72f841f4030a76e8f9c41c95d7f` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:35.417107 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945a1d49-757a-4765-8a27-e39b0eb77cde None admin] RBAC: Authorizing `identity:create_grant(project_id=5c2da88af5714e619238772bde676a42, user_id=f3b5047a59bc4547be643ffa78808a6d, role_id=e9acf72f841f4030a76e8f9c41c95d7f)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:35.418590 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945a1d49-757a-4765-8a27-e39b0eb77cde None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:35.496431 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d0ea1b-782d-4947-a05d-611d4855517e None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:35.505285 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 288/572] 10.222.0.60 () {58 vars in 1439 bytes} [Sat Sep 24 19:38:35 2022] PUT /identity/v3/projects/5c2da88af5714e619238772bde676a42/users/f3b5047a59bc4547be643ffa78808a6d/roles/e9acf72f841f4030a76e8f9c41c95d7f => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:38:35.507209 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a1d49-757a-4765-8a27-e39b0eb77cde None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:35.543681 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b749a5b-27ae-4b1a-86cf-985ee0f84c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:35.544399 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b749a5b-27ae-4b1a-86cf-985ee0f84c13 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:35.544678 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b749a5b-27ae-4b1a-86cf-985ee0f84c13 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:35.544946 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b749a5b-27ae-4b1a-86cf-985ee0f84c13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:35.560810 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b749a5b-27ae-4b1a-86cf-985ee0f84c13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:35.562315 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b749a5b-27ae-4b1a-86cf-985ee0f84c13 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:35.584552 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-4b749a5b-27ae-4b1a-86cf-985ee0f84c13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:35.584552 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:35.584552 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:35.584552 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:35.584552 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:35.584552 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:35.584552 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:35.584552 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:35.584552 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:35.584552 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:35.584552 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:35.584552 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:35.584552 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:38:35.584552 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:38:35.584552 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:38:35.584552 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:38:35.585681 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:35.585681 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:35.585681 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:35.585681 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:35.585681 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:35.585681 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:35.585681 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:35.585681 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:35.585681 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:35.585681 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:35.585681 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:35.585681 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:35.585681 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:35.585681 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:35.585681 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:35.585681 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:35.585681 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:38:35.588152 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:38:35.588152 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:35.588152 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:35.588152 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 285/573] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:38:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:35.588152 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b749a5b-27ae-4b1a-86cf-985ee0f84c13 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:35.640969 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:35.651553 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:35.730867 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a1d49-757a-4765-8a27-e39b0eb77cde None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:35.735004 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b749a5b-27ae-4b1a-86cf-985ee0f84c13 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:35.774684 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96306918-740d-4c31-ad23-04ecbcacc110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:35.775330 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96306918-740d-4c31-ad23-04ecbcacc110 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:35.775608 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96306918-740d-4c31-ad23-04ecbcacc110 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:35.776172 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96306918-740d-4c31-ad23-04ecbcacc110 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:35.782170 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3481a0e-7b25-4508-a861-dfcaa3bf6bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:35.782790 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3481a0e-7b25-4508-a861-dfcaa3bf6bd1 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:35.783065 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3481a0e-7b25-4508-a861-dfcaa3bf6bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:35.783334 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3481a0e-7b25-4508-a861-dfcaa3bf6bd1 None admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:35.784635 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3481a0e-7b25-4508-a861-dfcaa3bf6bd1 None admin] RBAC: Adding query filter params (name=service) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:35.787806 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3481a0e-7b25-4508-a861-dfcaa3bf6bd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:35.787806 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3481a0e-7b25-4508-a861-dfcaa3bf6bd1 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:35.790106 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96306918-740d-4c31-ad23-04ecbcacc110 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:35.790714 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96306918-740d-4c31-ad23-04ecbcacc110 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:35.801550 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 286/574] 10.222.0.60 () {56 vars in 1103 bytes} [Sat Sep 24 19:38:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:35.802053 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3481a0e-7b25-4508-a861-dfcaa3bf6bd1 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:35.809844 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-96306918-740d-4c31-ad23-04ecbcacc110 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:35.809844 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:35.809844 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:35.809844 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:35.809844 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:35.809844 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:35.809844 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:35.809844 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:35.809844 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:35.809844 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:35.809844 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:35.809844 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:35.809844 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:38:35.809844 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:38:35.809844 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:38:35.809844 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:38:35.810837 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:35.810837 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:35.810837 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:35.810837 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:35.810837 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:35.810837 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:35.810837 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:35.810837 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:35.810837 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:35.810837 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:35.810837 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:35.810837 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:35.810837 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:35.810837 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:35.810837 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:35.810837 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:35.810837 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:38:35.812404 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:38:35.812404 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:35.812404 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:35.812404 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 289/575] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:38:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:35.812404 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96306918-740d-4c31-ad23-04ecbcacc110 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:35.934673 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96306918-740d-4c31-ad23-04ecbcacc110 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:35.942930 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:35.954603 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3481a0e-7b25-4508-a861-dfcaa3bf6bd1 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:35.963130 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:35.978154 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa49727-4799-4288-855d-c5878629de2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:35.979155 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa49727-4799-4288-855d-c5878629de2f None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:35.979620 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa49727-4799-4288-855d-c5878629de2f None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:35.980062 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa49727-4799-4288-855d-c5878629de2f None admin] PATH_INFO: `/v3/roles/service` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:35.993039 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa49727-4799-4288-855d-c5878629de2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:38:35.998326 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-0fa49727-4799-4288-855d-c5878629de2f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:38:35.998326 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:35.998326 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:35.998326 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:35.998326 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:35.998326 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:35.998326 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:35.998326 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:35.998326 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:35.998326 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:35.998326 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:35.998326 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:35.998326 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:38:35.998326 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:38:35.998326 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:38:35.998326 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:38:35.999284 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:38:35.999284 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:38:35.999284 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:38:35.999284 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:38:35.999284 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:35.999284 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:35.999284 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:35.999284 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:35.999284 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:35.999284 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:35.999284 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:35.999284 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:35.999284 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:35.999284 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:35.999284 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:35.999284 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:36.000196 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:36.000196 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:36.000196 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:36.000196 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:36.000196 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:38:36.000196 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:38:36.000196 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:38:36.000196 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:38:36.000196 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:38:36.000196 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:38:36.000196 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:38:36.000196 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:36.007870 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 290/576] 10.222.0.60 () {56 vars in 1102 bytes} [Sat Sep 24 19:38:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:36.007870 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa49727-4799-4288-855d-c5878629de2f None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:36.013094 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f35d2db-4c66-453c-b386-6af5b2bcc010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:36.018395 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35d2db-4c66-453c-b386-6af5b2bcc010 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:36.018395 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35d2db-4c66-453c-b386-6af5b2bcc010 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:36.018395 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35d2db-4c66-453c-b386-6af5b2bcc010 None admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:36.018395 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f35d2db-4c66-453c-b386-6af5b2bcc010 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:36.018395 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f35d2db-4c66-453c-b386-6af5b2bcc010 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:36.020697 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f35d2db-4c66-453c-b386-6af5b2bcc010 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:36.045423 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 287/577] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:38:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:36.045423 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f35d2db-4c66-453c-b386-6af5b2bcc010 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:36.140210 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa49727-4799-4288-855d-c5878629de2f None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:36.184053 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc10df3-b54b-461c-9607-409a67c0ece0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:36.184578 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f35d2db-4c66-453c-b386-6af5b2bcc010 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:36.184741 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc10df3-b54b-461c-9607-409a67c0ece0 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:36.184950 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc10df3-b54b-461c-9607-409a67c0ece0 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:36.185226 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc10df3-b54b-461c-9607-409a67c0ece0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:36.198497 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc10df3-b54b-461c-9607-409a67c0ece0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:36.199983 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc10df3-b54b-461c-9607-409a67c0ece0 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:36.217444 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-3dc10df3-b54b-461c-9607-409a67c0ece0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:36.217444 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:36.217444 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:36.217444 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:36.217444 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:36.217444 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:36.217444 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:36.217444 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:36.217444 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:36.217444 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:36.217444 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:36.217444 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:36.217444 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:38:36.217444 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:38:36.217444 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:38:36.217444 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:38:36.218473 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:36.218473 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:36.218473 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:36.218473 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:36.218473 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:36.218473 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:36.218473 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:36.218473 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:36.218473 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:36.218473 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:36.218473 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:36.218473 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:36.218473 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:36.218473 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:36.218473 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:36.218473 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:36.218473 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:38:36.219340 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:38:36.219340 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:36.219340 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:36.225441 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 291/578] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:38:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:36.226843 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc10df3-b54b-461c-9607-409a67c0ece0 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:36.242055 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086c5490-7ec8-4d0b-81b1-2f0b70ff2069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:36.243279 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c5490-7ec8-4d0b-81b1-2f0b70ff2069 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:36.243745 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c5490-7ec8-4d0b-81b1-2f0b70ff2069 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:36.244436 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c5490-7ec8-4d0b-81b1-2f0b70ff2069 None admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:36.245729 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086c5490-7ec8-4d0b-81b1-2f0b70ff2069 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:36.246490 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086c5490-7ec8-4d0b-81b1-2f0b70ff2069 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:36.248465 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:36.248722 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086c5490-7ec8-4d0b-81b1-2f0b70ff2069 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:36.267422 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 288/579] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:38:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:36.269784 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086c5490-7ec8-4d0b-81b1-2f0b70ff2069 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:36.323841 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:36.353175 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc10df3-b54b-461c-9607-409a67c0ece0 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:36.395021 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89abca6b-d1a0-402f-9530-3555a9f7961f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:36.395831 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89abca6b-d1a0-402f-9530-3555a9f7961f None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:36.396114 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89abca6b-d1a0-402f-9530-3555a9f7961f None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:36.396391 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89abca6b-d1a0-402f-9530-3555a9f7961f None admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:36.397057 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89abca6b-d1a0-402f-9530-3555a9f7961f None admin] RBAC: Adding query filter params (name=service) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:36.397362 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89abca6b-d1a0-402f-9530-3555a9f7961f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:36.399052 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89abca6b-d1a0-402f-9530-3555a9f7961f None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:36.404440 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086c5490-7ec8-4d0b-81b1-2f0b70ff2069 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:36.414459 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 292/580] 10.222.0.60 () {56 vars in 1103 bytes} [Sat Sep 24 19:38:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:36.414459 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89abca6b-d1a0-402f-9530-3555a9f7961f None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:36.445015 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a81983-9a1a-4c42-b665-5daf4e8207bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:36.445591 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a81983-9a1a-4c42-b665-5daf4e8207bc None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:36.445865 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a81983-9a1a-4c42-b665-5daf4e8207bc None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:36.446134 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a81983-9a1a-4c42-b665-5daf4e8207bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:36.453397 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a81983-9a1a-4c42-b665-5daf4e8207bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:36.454881 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a81983-9a1a-4c42-b665-5daf4e8207bc None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:36.467925 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-c9a81983-9a1a-4c42-b665-5daf4e8207bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:38:36.467925 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:36.467925 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:36.467925 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:36.467925 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:36.467925 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:36.467925 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:36.467925 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:36.467925 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:36.467925 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:36.467925 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:36.467925 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:36.467925 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:38:36.467925 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:38:36.467925 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:38:36.469064 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:38:36.469064 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:36.469064 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:36.469064 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:36.469064 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:36.469064 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:36.469064 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:36.469064 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:36.469064 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:36.469064 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:36.469064 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:36.469064 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:36.469064 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:36.469064 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:36.469064 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:36.469064 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:36.469064 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:36.470294 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:38:36.470294 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:38:36.470294 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:38:36.470294 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:38:36.470294 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:38:36.470294 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:38:36.470294 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:38:36.470294 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:36.472064 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 289/581] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Sep 24 19:38:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:36.473179 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a81983-9a1a-4c42-b665-5daf4e8207bc None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:36.510091 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:36.533337 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89abca6b-d1a0-402f-9530-3555a9f7961f None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:36.579408 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323395ba-eeac-458d-82b0-018ec1cfc4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:36.580034 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323395ba-eeac-458d-82b0-018ec1cfc4d5 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:36.580309 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323395ba-eeac-458d-82b0-018ec1cfc4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:36.580578 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323395ba-eeac-458d-82b0-018ec1cfc4d5 None admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:36.581224 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323395ba-eeac-458d-82b0-018ec1cfc4d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:36.581545 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323395ba-eeac-458d-82b0-018ec1cfc4d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:36.583502 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323395ba-eeac-458d-82b0-018ec1cfc4d5 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:36.586203 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:36.601164 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 293/582] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:38:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:36.601164 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323395ba-eeac-458d-82b0-018ec1cfc4d5 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:36.607658 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a81983-9a1a-4c42-b665-5daf4e8207bc None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:36.648240 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73afb4d8-4d32-438c-8454-32df2533b098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:36.648874 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afb4d8-4d32-438c-8454-32df2533b098 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:36.649149 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afb4d8-4d32-438c-8454-32df2533b098 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:36.649414 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afb4d8-4d32-438c-8454-32df2533b098 None admin] PATH_INFO: `/v3/users/glance` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:36.657137 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73afb4d8-4d32-438c-8454-32df2533b098 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:36.658616 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73afb4d8-4d32-438c-8454-32df2533b098 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:36.678968 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-73afb4d8-4d32-438c-8454-32df2533b098 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 24 19:38:36.678968 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:36.678968 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:36.678968 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:36.678968 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:36.678968 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:36.678968 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:36.678968 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:36.678968 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:36.678968 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:36.678968 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:36.678968 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:36.678968 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:38:36.678968 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:38:36.678968 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:38:36.678968 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:38:36.679942 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:36.679942 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:36.679942 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:38:36.679942 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:38:36.679942 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:38:36.679942 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:38:36.679942 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:36.679942 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:36.679942 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:36.679942 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:36.679942 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:36.679942 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:36.679942 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:36.679942 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:36.679942 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:36.679942 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:36.679942 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:36.679942 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:36.680888 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:36.680888 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:36.680888 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:38:36.680888 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:38:36.680888 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:38:36.680888 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:38:36.680888 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:38:36.680888 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:38:36.680888 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 24 19:38:36.680888 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:36.680888 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 290/583] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Sep 24 19:38:36 2022] GET /identity/v3/users/glance => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:36.681472 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73afb4d8-4d32-438c-8454-32df2533b098 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:36.737675 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323395ba-eeac-458d-82b0-018ec1cfc4d5 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:36.777704 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bd5880-2352-4e0d-818b-a90ebe531890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:36.778344 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bd5880-2352-4e0d-818b-a90ebe531890 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:36.778625 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bd5880-2352-4e0d-818b-a90ebe531890 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:36.778898 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bd5880-2352-4e0d-818b-a90ebe531890 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:36.791443 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:36.794095 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bd5880-2352-4e0d-818b-a90ebe531890 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:36.795682 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bd5880-2352-4e0d-818b-a90ebe531890 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:36.804246 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73afb4d8-4d32-438c-8454-32df2533b098 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:36.811652 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-d0bd5880-2352-4e0d-818b-a90ebe531890 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:36.811652 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:36.811652 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:36.811652 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:36.811652 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:36.811652 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:36.811652 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:36.811652 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:36.811652 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:36.811652 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:36.811652 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:36.811652 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:36.811652 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:38:36.811652 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:38:36.811652 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:38:36.811652 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:38:36.812802 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:36.812802 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:36.812802 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:36.812802 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:36.812802 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:36.812802 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:36.812802 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:36.812802 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:36.812802 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:36.812802 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:36.812802 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:36.812802 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:36.812802 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:36.812802 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:36.812802 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:36.812802 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:36.812802 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:38:36.813723 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:38:36.813723 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:36.813723 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:36.813723 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 294/584] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:38:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:36.814075 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bd5880-2352-4e0d-818b-a90ebe531890 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:36.851473 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8ab0a-df89-4364-aa76-bcf41c959559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:36.852093 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8ab0a-df89-4364-aa76-bcf41c959559 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:36.852374 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8ab0a-df89-4364-aa76-bcf41c959559 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:36.852647 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8ab0a-df89-4364-aa76-bcf41c959559 None admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:36.853348 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d8ab0a-df89-4364-aa76-bcf41c959559 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:36.853687 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d8ab0a-df89-4364-aa76-bcf41c959559 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:36.855126 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d8ab0a-df89-4364-aa76-bcf41c959559 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:36.869169 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 291/585] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Sep 24 19:38:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:36.870047 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8ab0a-df89-4364-aa76-bcf41c959559 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:36.879738 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:36.939852 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bd5880-2352-4e0d-818b-a90ebe531890 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:36.981028 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04cd13c-2b63-4ab3-b80f-ae4249398454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:36.981747 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04cd13c-2b63-4ab3-b80f-ae4249398454 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:36.982012 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04cd13c-2b63-4ab3-b80f-ae4249398454 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:36.982285 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04cd13c-2b63-4ab3-b80f-ae4249398454 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:36.990330 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8ab0a-df89-4364-aa76-bcf41c959559 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:36.991287 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04cd13c-2b63-4ab3-b80f-ae4249398454 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:36.992725 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04cd13c-2b63-4ab3-b80f-ae4249398454 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:37.005188 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-d04cd13c-2b63-4ab3-b80f-ae4249398454 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 24 19:38:37.005188 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:37.005188 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:37.005188 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:37.005188 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:37.005188 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:37.005188 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:37.005188 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:37.005188 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:37.005188 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:37.005188 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:37.005188 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:37.005188 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:38:37.005188 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:38:37.005188 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:38:37.005188 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:38:37.006493 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:37.006493 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:37.006493 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:38:37.006493 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:38:37.006493 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:38:37.006493 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:38:37.006493 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:37.006493 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:37.006493 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:37.006493 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:37.006493 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:37.006493 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:37.006493 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:37.006493 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:37.006493 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:37.006493 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:37.006493 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:37.006493 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:37.007414 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:37.007414 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:37.007414 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:38:37.007414 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:38:37.007414 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:38:37.007414 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:38:37.007414 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:38:37.007414 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:38:37.007414 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 24 19:38:37.007414 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:37.007414 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 295/586] 10.222.0.60 () {56 vars in 1102 bytes} [Sat Sep 24 19:38:36 2022] GET /identity/v3/users/neutron => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:37.007414 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04cd13c-2b63-4ab3-b80f-ae4249398454 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:37.038330 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46397c5c-7795-4c9c-a7cd-947db0f372bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:37.038949 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46397c5c-7795-4c9c-a7cd-947db0f372bf None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:37.039223 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46397c5c-7795-4c9c-a7cd-947db0f372bf None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:37.039501 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46397c5c-7795-4c9c-a7cd-947db0f372bf None admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:37.040215 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46397c5c-7795-4c9c-a7cd-947db0f372bf None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:37.040515 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46397c5c-7795-4c9c-a7cd-947db0f372bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:37.042718 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46397c5c-7795-4c9c-a7cd-947db0f372bf None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:37.063888 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 292/587] 10.222.0.60 () {56 vars in 1137 bytes} [Sat Sep 24 19:38:36 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:37.068197 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46397c5c-7795-4c9c-a7cd-947db0f372bf None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:37.082327 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:37.145849 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:37.148866 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04cd13c-2b63-4ab3-b80f-ae4249398454 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:37.190492 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a80d2c9-0fd2-4901-8c62-0a24ef1d25ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:37.191144 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80d2c9-0fd2-4901-8c62-0a24ef1d25ee None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:37.191426 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80d2c9-0fd2-4901-8c62-0a24ef1d25ee None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:37.191849 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80d2c9-0fd2-4901-8c62-0a24ef1d25ee None admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:37.192505 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a80d2c9-0fd2-4901-8c62-0a24ef1d25ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:37.192805 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a80d2c9-0fd2-4901-8c62-0a24ef1d25ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:37.194011 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46397c5c-7795-4c9c-a7cd-947db0f372bf None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:37.194204 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a80d2c9-0fd2-4901-8c62-0a24ef1d25ee None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:37.213983 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 296/588] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:38:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:37.213983 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a80d2c9-0fd2-4901-8c62-0a24ef1d25ee None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:37.237416 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008bda0d-ac8c-499e-b657-ec755220ea60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:37.239373 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008bda0d-ac8c-499e-b657-ec755220ea60 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:37.239724 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008bda0d-ac8c-499e-b657-ec755220ea60 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:37.240008 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008bda0d-ac8c-499e-b657-ec755220ea60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:37.240795 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008bda0d-ac8c-499e-b657-ec755220ea60 None admin] RBAC: Adding query filter params (role.id=e9acf72f841f4030a76e8f9c41c95d7f, scope.project.id=5c2da88af5714e619238772bde676a42, user.id=ebd94cd16acc45e6ac2997204297fb75) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:37.241054 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008bda0d-ac8c-499e-b657-ec755220ea60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:37.242548 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008bda0d-ac8c-499e-b657-ec755220ea60 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:37.261538 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 293/589] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Sep 24 19:38:37 2022] GET /identity/v3/role_assignments?user.id=ebd94cd16acc45e6ac2997204297fb75&scope.project.id=5c2da88af5714e619238772bde676a42&role.id=e9acf72f841f4030a76e8f9c41c95d7f => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:37.261538 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008bda0d-ac8c-499e-b657-ec755220ea60 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:37.366027 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a80d2c9-0fd2-4901-8c62-0a24ef1d25ee None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:37.383647 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008bda0d-ac8c-499e-b657-ec755220ea60 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:37.387166 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:37.419365 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:37.421585 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa8f74-acfc-4964-9788-7ef95d0c859a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:37.422406 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa8f74-acfc-4964-9788-7ef95d0c859a None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:37.423078 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa8f74-acfc-4964-9788-7ef95d0c859a None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:37.423520 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa8f74-acfc-4964-9788-7ef95d0c859a None admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:37.425185 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aa8f74-acfc-4964-9788-7ef95d0c859a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:37.425706 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aa8f74-acfc-4964-9788-7ef95d0c859a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:37.428078 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aa8f74-acfc-4964-9788-7ef95d0c859a None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:37.429243 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ccbb12-5561-4a06-844f-66b3c84bc0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:37.430080 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ccbb12-5561-4a06-844f-66b3c84bc0ce None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:37.430471 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ccbb12-5561-4a06-844f-66b3c84bc0ce None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:37.430836 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ccbb12-5561-4a06-844f-66b3c84bc0ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:37.446233 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ccbb12-5561-4a06-844f-66b3c84bc0ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:37.447879 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ccbb12-5561-4a06-844f-66b3c84bc0ce None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:37.455186 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 297/590] 10.222.0.60 () {56 vars in 1139 bytes} [Sat Sep 24 19:38:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:37.456304 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa8f74-acfc-4964-9788-7ef95d0c859a None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:37.472098 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-b7ccbb12-5561-4a06-844f-66b3c84bc0ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:37.472098 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:37.472098 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:37.472098 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:37.472098 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:37.472098 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:37.472098 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:37.472098 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:37.472098 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:37.472098 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:37.472098 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:37.472098 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:37.472098 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:38:37.472098 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:38:37.472098 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:38:37.472098 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:38:37.474278 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:37.474278 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:37.474278 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:37.474278 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:37.474278 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:37.474278 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:37.474278 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:37.474278 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:37.474278 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:37.474278 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:37.474278 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:37.474278 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:37.474278 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:37.474278 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:37.474278 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:37.474278 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:37.474278 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:38:37.475160 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:38:37.475160 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:37.475160 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:37.477978 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 294/591] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:38:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:37.478556 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ccbb12-5561-4a06-844f-66b3c84bc0ce None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:37.603004 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa8f74-acfc-4964-9788-7ef95d0c859a None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:37.621352 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ccbb12-5561-4a06-844f-66b3c84bc0ce None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:37.651522 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527a23e-602e-4515-b476-2777e94e28c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:37.652235 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527a23e-602e-4515-b476-2777e94e28c0 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:37.652560 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527a23e-602e-4515-b476-2777e94e28c0 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:37.652833 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527a23e-602e-4515-b476-2777e94e28c0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:37.669705 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b527a23e-602e-4515-b476-2777e94e28c0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:37.671182 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b527a23e-602e-4515-b476-2777e94e28c0 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:37.674355 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c93f4-e83f-45a9-8803-73e382ab2eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:37.675335 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c93f4-e83f-45a9-8803-73e382ab2eb5 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:37.677325 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c93f4-e83f-45a9-8803-73e382ab2eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:37.677837 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c93f4-e83f-45a9-8803-73e382ab2eb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:37.692517 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-b527a23e-602e-4515-b476-2777e94e28c0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 24 19:38:37.692517 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:37.692517 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:37.692517 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:37.692517 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:37.692517 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:37.692517 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:37.692517 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:37.692517 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:37.692517 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:37.692517 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:37.692517 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:37.692517 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:38:37.692517 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:38:37.692517 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:38:37.692517 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:38:37.693640 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:37.693640 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:37.693640 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:38:37.693640 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:38:37.693640 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:38:37.693640 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:38:37.693640 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:37.693640 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:37.693640 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:37.693640 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:37.693640 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:37.693640 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:37.693640 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:37.693640 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:37.693640 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:37.693640 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:37.693640 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:37.693640 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:37.694603 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:37.694603 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:37.694603 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:38:37.694603 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:38:37.694603 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:38:37.694603 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:38:37.694603 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:38:37.694603 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:38:37.694603 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 24 19:38:37.694603 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:37.694603 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 298/592] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Sep 24 19:38:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:37.695208 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527a23e-602e-4515-b476-2777e94e28c0 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:37.696491 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c93f4-e83f-45a9-8803-73e382ab2eb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:37.699779 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c93f4-e83f-45a9-8803-73e382ab2eb5 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:37.722143 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-7b1c93f4-e83f-45a9-8803-73e382ab2eb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:37.722143 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:37.722143 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:37.722143 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:37.722143 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:37.722143 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:37.722143 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:37.722143 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:37.722143 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:37.722143 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:37.722143 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:37.722143 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:37.722143 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:38:37.722143 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:38:37.722143 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:38:37.722143 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:38:37.724449 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:37.724449 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:37.724449 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:37.724449 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:37.724449 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:37.724449 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:37.724449 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:37.724449 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:37.724449 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:37.724449 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:37.724449 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:37.724449 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:37.724449 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:37.724449 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:37.724449 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:37.724449 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:37.724449 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:38:37.725342 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:38:37.725342 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:37.725342 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:37.731838 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 295/593] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:38:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:37.731838 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c93f4-e83f-45a9-8803-73e382ab2eb5 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:37.745671 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:37.773815 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:37.836286 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527a23e-602e-4515-b476-2777e94e28c0 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:37.858419 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c93f4-e83f-45a9-8803-73e382ab2eb5 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:37.882637 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b4b8a-a4d4-4593-af74-427def71f4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:37.883266 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b4b8a-a4d4-4593-af74-427def71f4f1 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:37.883546 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b4b8a-a4d4-4593-af74-427def71f4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:37.883822 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b4b8a-a4d4-4593-af74-427def71f4f1 None admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:37.884479 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8b4b8a-a4d4-4593-af74-427def71f4f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:37.884790 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8b4b8a-a4d4-4593-af74-427def71f4f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:37.886191 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8b4b8a-a4d4-4593-af74-427def71f4f1 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:37.896759 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb6aaac-ad4d-4e76-8945-8673adbfeffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:37.897363 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6aaac-ad4d-4e76-8945-8673adbfeffa None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:37.897668 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6aaac-ad4d-4e76-8945-8673adbfeffa None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:37.897935 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6aaac-ad4d-4e76-8945-8673adbfeffa None admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:37.898651 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb6aaac-ad4d-4e76-8945-8673adbfeffa None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:37.898952 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb6aaac-ad4d-4e76-8945-8673adbfeffa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:37.903503 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 299/594] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:38:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:37.903503 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b4b8a-a4d4-4593-af74-427def71f4f1 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:37.903726 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb6aaac-ad4d-4e76-8945-8673adbfeffa None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:37.923180 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 296/595] 10.222.0.60 () {56 vars in 1137 bytes} [Sat Sep 24 19:38:37 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:37.929899 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357865f-f509-435d-a00f-08ba6b60671f None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:37.930190 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357865f-f509-435d-a00f-08ba6b60671f None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:37.930458 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357865f-f509-435d-a00f-08ba6b60671f None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:37.932685 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 297/596] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:38:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:38:37.933368 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4357865f-f509-435d-a00f-08ba6b60671f None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:38.006788 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:38.017432 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b4b8a-a4d4-4593-af74-427def71f4f1 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:38.042532 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:38.055114 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4357865f-f509-435d-a00f-08ba6b60671f None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:38.055409 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150b86e-90e8-40b5-9e12-21beeac1f044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:38.055799 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150b86e-90e8-40b5-9e12-21beeac1f044 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:38.056562 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150b86e-90e8-40b5-9e12-21beeac1f044 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:38.057240 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150b86e-90e8-40b5-9e12-21beeac1f044 None admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:38.058168 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c150b86e-90e8-40b5-9e12-21beeac1f044 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:38.058475 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c150b86e-90e8-40b5-9e12-21beeac1f044 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:38.059907 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c150b86e-90e8-40b5-9e12-21beeac1f044 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:38.077981 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 300/597] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:38:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:38.077981 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150b86e-90e8-40b5-9e12-21beeac1f044 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:38.100012 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a05f4b-69ea-4b24-9afa-16b3b7e91988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:38.100743 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a05f4b-69ea-4b24-9afa-16b3b7e91988 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:38.101100 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a05f4b-69ea-4b24-9afa-16b3b7e91988 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:38.101440 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a05f4b-69ea-4b24-9afa-16b3b7e91988 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:38.108816 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a05f4b-69ea-4b24-9afa-16b3b7e91988 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:38.110236 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a05f4b-69ea-4b24-9afa-16b3b7e91988 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:38.123337 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-04a05f4b-69ea-4b24-9afa-16b3b7e91988 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:38:38.123337 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:38.123337 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:38.123337 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:38.123337 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:38.123337 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:38.123337 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:38.123337 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:38.123337 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:38.123337 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:38.123337 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:38.123337 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:38.123337 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:38:38.123337 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:38:38.123337 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:38:38.124317 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:38:38.124317 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:38.124317 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:38.124317 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:38.124317 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:38.124317 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:38.124317 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:38.124317 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:38.124317 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:38.124317 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:38.124317 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:38.124317 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:38.124317 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:38.124317 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:38.124317 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:38.124317 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:38.124317 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:38.125234 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:38:38.125234 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:38:38.125234 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:38:38.125234 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:38:38.125234 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:38:38.125234 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:38:38.125234 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:38:38.125234 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:38.125234 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 298/598] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Sep 24 19:38:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:38.126314 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ea017-b670-4ec8-8018-402ce30e6597 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:38.126314 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ea017-b670-4ec8-8018-402ce30e6597 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:38.126551 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ea017-b670-4ec8-8018-402ce30e6597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:38.145060 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-fd5ea017-b670-4ec8-8018-402ce30e6597 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:38:38.146318 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-fd5ea017-b670-4ec8-8018-402ce30e6597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:38:38.191944 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150b86e-90e8-40b5-9e12-21beeac1f044 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:38.227694 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 299/599] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:38:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:38:38.234593 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ea017-b670-4ec8-8018-402ce30e6597 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:38.237101 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d6a15-8946-4650-a860-159b3e715ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:38.237778 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d6a15-8946-4650-a860-159b3e715ef8 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:38.238116 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d6a15-8946-4650-a860-159b3e715ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:38.238387 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d6a15-8946-4650-a860-159b3e715ef8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:38.255437 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51d6a15-8946-4650-a860-159b3e715ef8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:38.257809 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51d6a15-8946-4650-a860-159b3e715ef8 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:38.280202 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-c51d6a15-8946-4650-a860-159b3e715ef8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:38.280202 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:38.280202 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:38.280202 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:38.280202 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:38.280202 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:38.280202 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:38.280202 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:38.280202 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:38.280202 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:38.280202 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:38.280202 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:38.280202 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:38:38.280202 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:38:38.280202 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:38:38.280202 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:38:38.281219 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:38.281219 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:38.281219 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:38.281219 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:38.281219 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:38.281219 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:38.281219 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:38.281219 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:38.281219 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:38.281219 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:38.281219 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:38.281219 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:38.281219 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:38.281219 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:38.281219 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:38.281219 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:38.281219 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:38:38.282222 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:38:38.282222 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:38.282222 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:38.284120 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 301/600] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:38:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:38.286055 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d6a15-8946-4650-a860-159b3e715ef8 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:38.289249 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:38.340899 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:38.363324 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ea017-b670-4ec8-8018-402ce30e6597 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:38.400934 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2941ed4a-aae0-4e78-8413-03a9b3760cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:38.401616 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941ed4a-aae0-4e78-8413-03a9b3760cb5 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:38.401897 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941ed4a-aae0-4e78-8413-03a9b3760cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:38.402165 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941ed4a-aae0-4e78-8413-03a9b3760cb5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:38.405268 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d6a15-8946-4650-a860-159b3e715ef8 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:38.411213 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2941ed4a-aae0-4e78-8413-03a9b3760cb5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:38.411975 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2941ed4a-aae0-4e78-8413-03a9b3760cb5 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:38.425373 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-2941ed4a-aae0-4e78-8413-03a9b3760cb5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:38:38.425373 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:38.425373 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:38.425373 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:38.425373 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:38.425373 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:38.425373 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:38.425373 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:38.425373 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:38.425373 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:38.425373 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:38.425373 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:38.425373 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:38:38.425373 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:38:38.425373 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:38:38.427427 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:38:38.427427 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:38.427427 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:38.427427 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:38.427427 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:38.427427 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:38.427427 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:38.427427 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:38.427427 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:38.427427 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:38.427427 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:38.427427 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:38.427427 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:38.427427 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:38.427427 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:38.427427 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:38.427427 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:38.428323 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:38:38.428323 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:38:38.428323 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:38:38.428323 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:38:38.428323 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:38:38.428323 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:38:38.428323 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:38:38.428323 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:38.431955 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 300/601] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Sep 24 19:38:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:38.432965 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2941ed4a-aae0-4e78-8413-03a9b3760cb5 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:38.456025 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e49c8f-2748-43a9-abd6-33b5c86242f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:38.457365 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e49c8f-2748-43a9-abd6-33b5c86242f2 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:38.457977 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e49c8f-2748-43a9-abd6-33b5c86242f2 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:38.458454 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e49c8f-2748-43a9-abd6-33b5c86242f2 None admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:38.459534 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e49c8f-2748-43a9-abd6-33b5c86242f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:38.460076 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e49c8f-2748-43a9-abd6-33b5c86242f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:38.461877 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e49c8f-2748-43a9-abd6-33b5c86242f2 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:38.479017 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 302/602] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Sep 24 19:38:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:38.480236 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e49c8f-2748-43a9-abd6-33b5c86242f2 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:38.548554 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2941ed4a-aae0-4e78-8413-03a9b3760cb5 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:38.561965 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:38.591493 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f874ee43-5f58-4cae-b3d7-0824dbaaac70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:38.592104 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874ee43-5f58-4cae-b3d7-0824dbaaac70 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:38.592380 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874ee43-5f58-4cae-b3d7-0824dbaaac70 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:38.592649 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874ee43-5f58-4cae-b3d7-0824dbaaac70 None admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:38.593292 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f874ee43-5f58-4cae-b3d7-0824dbaaac70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:38.593619 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f874ee43-5f58-4cae-b3d7-0824dbaaac70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:38.595024 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f874ee43-5f58-4cae-b3d7-0824dbaaac70 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:38.605304 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:38.614473 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 301/603] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:38:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:38.614473 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f874ee43-5f58-4cae-b3d7-0824dbaaac70 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:38.614747 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e49c8f-2748-43a9-abd6-33b5c86242f2 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:38.651220 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f0d5d-7cdb-4ede-9933-86ab3bb239be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:38.651842 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f0d5d-7cdb-4ede-9933-86ab3bb239be None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:38.652120 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f0d5d-7cdb-4ede-9933-86ab3bb239be None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:38.652411 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f0d5d-7cdb-4ede-9933-86ab3bb239be None admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:38.653094 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f0d5d-7cdb-4ede-9933-86ab3bb239be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:38.653401 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f0d5d-7cdb-4ede-9933-86ab3bb239be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:38.654884 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f0d5d-7cdb-4ede-9933-86ab3bb239be None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:38.671115 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 303/604] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Sep 24 19:38:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:38.678242 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f0d5d-7cdb-4ede-9933-86ab3bb239be None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:38.741911 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f874ee43-5f58-4cae-b3d7-0824dbaaac70 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:38.782850 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c25ff4d-ec14-4065-a420-57ed30b7c7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:38.783523 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25ff4d-ec14-4065-a420-57ed30b7c7f9 None admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:38.783798 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25ff4d-ec14-4065-a420-57ed30b7c7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:38.784133 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25ff4d-ec14-4065-a420-57ed30b7c7f9 None admin] PATH_INFO: `/v3/projects/5c2da88af5714e619238772bde676a42/users/aaf6ec7f5b4f490aa22a8e3bea91da39/roles/e9acf72f841f4030a76e8f9c41c95d7f` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:38.790273 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f0d5d-7cdb-4ede-9933-86ab3bb239be None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:38.799901 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c25ff4d-ec14-4065-a420-57ed30b7c7f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=5c2da88af5714e619238772bde676a42, user_id=aaf6ec7f5b4f490aa22a8e3bea91da39, role_id=e9acf72f841f4030a76e8f9c41c95d7f)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:38.801805 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c25ff4d-ec14-4065-a420-57ed30b7c7f9 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:38.816871 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:38.829400 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f1081a-c46f-4d94-bd38-512d7fa01393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:38.830072 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1081a-c46f-4d94-bd38-512d7fa01393 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:38.830335 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1081a-c46f-4d94-bd38-512d7fa01393 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:38.830603 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1081a-c46f-4d94-bd38-512d7fa01393 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:38.842638 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f1081a-c46f-4d94-bd38-512d7fa01393 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:38:38.847401 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-b3f1081a-c46f-4d94-bd38-512d7fa01393 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:38:38.847401 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:38.847401 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:38.847401 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:38.847401 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:38.847401 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:38.847401 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:38.847401 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:38.847401 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:38.847401 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:38.847401 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:38.847401 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:38.847401 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:38:38.847401 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:38:38.847401 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:38:38.847401 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:38:38.848587 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:38:38.848587 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:38:38.848587 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:38:38.848587 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:38:38.848587 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:38.848587 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:38.848587 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:38.848587 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:38.848587 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:38.848587 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:38.848587 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:38.848587 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:38.848587 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:38.848587 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:38.848587 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:38.848587 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:38.849452 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:38.849452 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:38.849452 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:38.849452 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:38.849452 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:38:38.849452 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:38:38.849452 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:38:38.849452 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:38:38.849452 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:38:38.849452 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:38:38.849452 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:38:38.849452 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:38.849452 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 304/605] 10.222.0.60 () {56 vars in 1102 bytes} [Sat Sep 24 19:38:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:38.849452 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f1081a-c46f-4d94-bd38-512d7fa01393 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:38.903791 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 302/606] 10.222.0.60 () {58 vars in 1439 bytes} [Sat Sep 24 19:38:38 2022] PUT /identity/v3/projects/5c2da88af5714e619238772bde676a42/users/aaf6ec7f5b4f490aa22a8e3bea91da39/roles/e9acf72f841f4030a76e8f9c41c95d7f => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:38:38.914542 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c25ff4d-ec14-4065-a420-57ed30b7c7f9 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:38.977480 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f1081a-c46f-4d94-bd38-512d7fa01393 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:39.002014 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:39.030115 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555776be-8343-48aa-9f39-857b62305796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:39.030893 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555776be-8343-48aa-9f39-857b62305796 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:39.031237 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555776be-8343-48aa-9f39-857b62305796 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:39.031577 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555776be-8343-48aa-9f39-857b62305796 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:39.041301 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555776be-8343-48aa-9f39-857b62305796 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:39.042968 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555776be-8343-48aa-9f39-857b62305796 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:39.061361 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-555776be-8343-48aa-9f39-857b62305796 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:38:39.061361 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:39.061361 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:39.061361 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:39.061361 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:39.061361 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:39.061361 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:39.061361 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:39.061361 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:39.061361 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:39.061361 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:39.061361 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:39.061361 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:38:39.061361 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:38:39.061361 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:38:39.062537 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:38:39.062537 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:39.062537 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:39.062537 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:39.062537 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:39.062537 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:39.062537 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:39.062537 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:39.062537 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:39.062537 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:39.062537 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:39.062537 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:39.062537 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:39.062537 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:39.062537 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:39.062537 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:39.062537 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:39.063680 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:38:39.063680 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:38:39.063680 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:38:39.063680 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:38:39.063680 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:38:39.063680 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:38:39.063680 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:38:39.063680 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:39.065964 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 305/607] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Sep 24 19:38:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:39.065964 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555776be-8343-48aa-9f39-857b62305796 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:39.084195 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c25ff4d-ec14-4065-a420-57ed30b7c7f9 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:39.127493 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:39.137326 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c35931-5157-4846-ab6b-984520806335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:39.138053 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c35931-5157-4846-ab6b-984520806335 None admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:39.138395 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c35931-5157-4846-ab6b-984520806335 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:39.138695 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c35931-5157-4846-ab6b-984520806335 None admin] PATH_INFO: `/v3/projects/5c2da88af5714e619238772bde676a42/users/fed7dee25fd54255ad24cd6ad880fa3f/roles/e9acf72f841f4030a76e8f9c41c95d7f` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:39.156341 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c35931-5157-4846-ab6b-984520806335 None admin] RBAC: Authorizing `identity:create_grant(project_id=5c2da88af5714e619238772bde676a42, user_id=fed7dee25fd54255ad24cd6ad880fa3f, role_id=e9acf72f841f4030a76e8f9c41c95d7f)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:39.157809 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c35931-5157-4846-ab6b-984520806335 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:39.202704 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555776be-8343-48aa-9f39-857b62305796 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:39.249755 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c855036-853d-4093-8525-c6551ff46d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:39.250433 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c855036-853d-4093-8525-c6551ff46d6f None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:39.250712 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c855036-853d-4093-8525-c6551ff46d6f None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:39.250985 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c855036-853d-4093-8525-c6551ff46d6f None admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:39.251669 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c855036-853d-4093-8525-c6551ff46d6f None admin] RBAC: Adding query filter params (name=service) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:39.252026 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c855036-853d-4093-8525-c6551ff46d6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:39.254897 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c855036-853d-4093-8525-c6551ff46d6f None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:39.265074 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 303/608] 10.222.0.60 () {58 vars in 1439 bytes} [Sat Sep 24 19:38:38 2022] PUT /identity/v3/projects/5c2da88af5714e619238772bde676a42/users/fed7dee25fd54255ad24cd6ad880fa3f/roles/e9acf72f841f4030a76e8f9c41c95d7f => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:38:39.266139 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c35931-5157-4846-ab6b-984520806335 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:39.274764 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 306/609] 10.222.0.60 () {56 vars in 1103 bytes} [Sat Sep 24 19:38:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:39.281960 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c855036-853d-4093-8525-c6551ff46d6f None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:39.402630 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:39.406329 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c35931-5157-4846-ab6b-984520806335 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:39.451041 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4be32a-7de8-4701-8714-d33ec370937e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:39.451761 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4be32a-7de8-4701-8714-d33ec370937e None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:39.452959 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4be32a-7de8-4701-8714-d33ec370937e None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:39.453345 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4be32a-7de8-4701-8714-d33ec370937e None admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:39.454223 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4be32a-7de8-4701-8714-d33ec370937e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:39.454644 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4be32a-7de8-4701-8714-d33ec370937e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:39.456278 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4be32a-7de8-4701-8714-d33ec370937e None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:39.478034 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 304/610] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Sep 24 19:38:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:39.480206 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4be32a-7de8-4701-8714-d33ec370937e None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:39.575403 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c855036-853d-4093-8525-c6551ff46d6f None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:39.581066 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:39.626885 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4be32a-7de8-4701-8714-d33ec370937e None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:39.632917 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd04767-2c2b-4c2c-84c8-51a6c787d505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:39.633731 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd04767-2c2b-4c2c-84c8-51a6c787d505 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:39.634112 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd04767-2c2b-4c2c-84c8-51a6c787d505 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:39.634489 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd04767-2c2b-4c2c-84c8-51a6c787d505 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:39.650669 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd04767-2c2b-4c2c-84c8-51a6c787d505 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:39.652803 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd04767-2c2b-4c2c-84c8-51a6c787d505 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:39.674239 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b0caa3-65b1-4a53-8d73-f7425f7c2ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:39.675203 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0caa3-65b1-4a53-8d73-f7425f7c2ee2 None admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:39.676168 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0caa3-65b1-4a53-8d73-f7425f7c2ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:39.676585 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0caa3-65b1-4a53-8d73-f7425f7c2ee2 None admin] PATH_INFO: `/v3/projects/5c2da88af5714e619238772bde676a42/users/e9057442a6cd4b45acdd588d432d8318/roles/e9acf72f841f4030a76e8f9c41c95d7f` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:39.677481 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-0fd04767-2c2b-4c2c-84c8-51a6c787d505 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:39.677481 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:39.677481 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:39.677481 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:39.677481 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:39.677481 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:39.677481 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:39.677481 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:39.677481 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:39.677481 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:39.677481 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:39.677481 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:39.677481 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:38:39.677481 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:38:39.677481 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:38:39.677481 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:38:39.678611 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:39.678611 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:39.678611 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:39.678611 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:39.678611 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:39.678611 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:39.678611 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:39.678611 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:39.678611 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:39.678611 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:39.678611 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:39.678611 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:39.678611 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:39.678611 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:39.678611 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:39.678611 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:39.678611 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:38:39.680184 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:38:39.680184 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:39.680184 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:39.680184 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 307/611] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:38:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 397 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:39.680184 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34afc9f-ab1a-48f0-8597-6ab9b46c2932 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:39.680480 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34afc9f-ab1a-48f0-8597-6ab9b46c2932 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:39.680691 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34afc9f-ab1a-48f0-8597-6ab9b46c2932 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:39.686941 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 308/612] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:38:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:38:39.688774 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34afc9f-ab1a-48f0-8597-6ab9b46c2932 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:39.705944 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b0caa3-65b1-4a53-8d73-f7425f7c2ee2 None admin] RBAC: Authorizing `identity:create_grant(project_id=5c2da88af5714e619238772bde676a42, user_id=e9057442a6cd4b45acdd588d432d8318, role_id=e9acf72f841f4030a76e8f9c41c95d7f)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:39.707857 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b0caa3-65b1-4a53-8d73-f7425f7c2ee2 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:39.801692 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 305/613] 10.222.0.60 () {58 vars in 1439 bytes} [Sat Sep 24 19:38:39 2022] PUT /identity/v3/projects/5c2da88af5714e619238772bde676a42/users/e9057442a6cd4b45acdd588d432d8318/roles/e9acf72f841f4030a76e8f9c41c95d7f => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 19:38:39.805436 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be97ccce-4896-45eb-b0fa-3dd8447ad7f5 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:39.807689 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be97ccce-4896-45eb-b0fa-3dd8447ad7f5 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:39.808166 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be97ccce-4896-45eb-b0fa-3dd8447ad7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:39.846723 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34afc9f-ab1a-48f0-8597-6ab9b46c2932 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:39.851682 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-be97ccce-4896-45eb-b0fa-3dd8447ad7f5 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:38:39.857707 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-be97ccce-4896-45eb-b0fa-3dd8447ad7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:38:39.863996 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:39.926549 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b612bd-7d9a-42aa-86ca-3b04cf10530e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:39.927193 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b612bd-7d9a-42aa-86ca-3b04cf10530e None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:39.927475 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b612bd-7d9a-42aa-86ca-3b04cf10530e None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:39.927749 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b612bd-7d9a-42aa-86ca-3b04cf10530e None admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:39.928435 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b612bd-7d9a-42aa-86ca-3b04cf10530e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:39.928744 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b612bd-7d9a-42aa-86ca-3b04cf10530e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:39.930222 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b612bd-7d9a-42aa-86ca-3b04cf10530e None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:39.963107 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 309/614] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:38:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:39.966482 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b612bd-7d9a-42aa-86ca-3b04cf10530e None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:40.003279 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:40.016261 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 306/615] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:38:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:38:40.135321 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b612bd-7d9a-42aa-86ca-3b04cf10530e None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:40.174699 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7468be-9078-4dec-9551-0d541738b922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:40.176043 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7468be-9078-4dec-9551-0d541738b922 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:40.176983 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7468be-9078-4dec-9551-0d541738b922 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:40.177274 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7468be-9078-4dec-9551-0d541738b922 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:40.189998 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7468be-9078-4dec-9551-0d541738b922 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:40.192206 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7468be-9078-4dec-9551-0d541738b922 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:40.206801 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-7d7468be-9078-4dec-9551-0d541738b922 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 24 19:38:40.206801 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:40.206801 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:40.206801 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:40.206801 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:40.206801 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:40.206801 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:40.206801 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:40.206801 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:40.206801 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:40.206801 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:40.206801 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:40.206801 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:38:40.206801 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:38:40.206801 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:38:40.206801 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:38:40.207985 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:40.207985 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:40.207985 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:38:40.207985 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:38:40.207985 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:38:40.207985 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:38:40.207985 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:40.207985 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:40.207985 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:40.207985 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:40.207985 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:40.207985 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:40.207985 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:40.207985 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:40.207985 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:40.207985 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:40.207985 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:40.207985 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:40.209118 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:40.209118 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:40.209118 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:38:40.209118 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:38:40.209118 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:38:40.209118 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:38:40.209118 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:38:40.209118 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:38:40.209118 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 24 19:38:40.209118 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:40.209118 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 310/616] 10.222.0.60 () {56 vars in 1093 bytes} [Sat Sep 24 19:38:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:40.216359 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be97ccce-4896-45eb-b0fa-3dd8447ad7f5 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:40.357973 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be97ccce-4896-45eb-b0fa-3dd8447ad7f5 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:40.406247 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f21fa-2629-4e9e-82e6-2bd2831d2404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:40.406882 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f21fa-2629-4e9e-82e6-2bd2831d2404 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:40.407166 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f21fa-2629-4e9e-82e6-2bd2831d2404 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:40.407435 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f21fa-2629-4e9e-82e6-2bd2831d2404 None admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:40.408258 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455f21fa-2629-4e9e-82e6-2bd2831d2404 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:40.408559 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455f21fa-2629-4e9e-82e6-2bd2831d2404 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:40.410345 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455f21fa-2629-4e9e-82e6-2bd2831d2404 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:40.420237 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:40.430014 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 307/617] 10.222.0.60 () {56 vars in 1133 bytes} [Sat Sep 24 19:38:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:40.435537 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7468be-9078-4dec-9551-0d541738b922 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:40.448635 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f21fa-2629-4e9e-82e6-2bd2831d2404 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:40.560604 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f21fa-2629-4e9e-82e6-2bd2831d2404 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:40.608889 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd613b-2de4-4c26-bf19-d0fced180012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:40.610348 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd613b-2de4-4c26-bf19-d0fced180012 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:40.610779 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd613b-2de4-4c26-bf19-d0fced180012 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:40.611217 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd613b-2de4-4c26-bf19-d0fced180012 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:40.624670 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd613b-2de4-4c26-bf19-d0fced180012 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:38:40.632083 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-35cd613b-2de4-4c26-bf19-d0fced180012 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:38:40.632083 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:40.632083 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:40.632083 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:40.632083 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:40.632083 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:40.632083 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:40.632083 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:40.632083 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:40.632083 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:40.632083 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:40.632083 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:40.632083 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:38:40.632083 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:38:40.632083 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:38:40.632083 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:38:40.633378 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:38:40.633378 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:38:40.633378 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:38:40.633378 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:38:40.633378 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:40.633378 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:40.633378 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:40.633378 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:40.633378 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:40.633378 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:40.633378 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:40.633378 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:40.633378 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:40.633378 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:40.633378 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:40.633378 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:40.634434 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:40.634434 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:40.634434 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:40.634434 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:40.634434 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:38:40.634434 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:38:40.634434 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:38:40.634434 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:38:40.634434 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:38:40.634434 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:38:40.634434 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:38:40.634434 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:40.636980 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 308/618] 10.222.0.60 () {56 vars in 1102 bytes} [Sat Sep 24 19:38:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:40.643671 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd613b-2de4-4c26-bf19-d0fced180012 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:40.691741 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:40.719560 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:40.768694 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd613b-2de4-4c26-bf19-d0fced180012 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:40.792952 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7468be-9078-4dec-9551-0d541738b922 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:40.815930 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9992a6c9-24d9-4641-bbf9-ae1d73387502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:40.818962 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992a6c9-24d9-4641-bbf9-ae1d73387502 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:40.819454 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992a6c9-24d9-4641-bbf9-ae1d73387502 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:40.820255 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992a6c9-24d9-4641-bbf9-ae1d73387502 None admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:40.821164 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9992a6c9-24d9-4641-bbf9-ae1d73387502 None admin] RBAC: Adding query filter params (name=service) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:40.821724 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9992a6c9-24d9-4641-bbf9-ae1d73387502 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:40.823388 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9992a6c9-24d9-4641-bbf9-ae1d73387502 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:40.837761 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 309/619] 10.222.0.60 () {56 vars in 1103 bytes} [Sat Sep 24 19:38:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:40.840074 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9992a6c9-24d9-4641-bbf9-ae1d73387502 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:40.941891 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54651e72-174b-4f1e-9f61-b04e5603aff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:40.942533 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54651e72-174b-4f1e-9f61-b04e5603aff3 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:40.942817 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54651e72-174b-4f1e-9f61-b04e5603aff3 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:40.943092 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54651e72-174b-4f1e-9f61-b04e5603aff3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:40.965162 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9992a6c9-24d9-4641-bbf9-ae1d73387502 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:40.999832 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:41.010791 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b5f3fd-c83d-42e8-b0db-80cc2ddde36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:41.011879 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5f3fd-c83d-42e8-b0db-80cc2ddde36a None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:41.012325 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5f3fd-c83d-42e8-b0db-80cc2ddde36a None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:41.012789 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5f3fd-c83d-42e8-b0db-80cc2ddde36a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:41.038460 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b5f3fd-c83d-42e8-b0db-80cc2ddde36a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:41.042538 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b5f3fd-c83d-42e8-b0db-80cc2ddde36a None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:41.072966 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-17b5f3fd-c83d-42e8-b0db-80cc2ddde36a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:41.072966 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:41.072966 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:41.072966 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:41.072966 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:41.072966 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:41.072966 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:41.072966 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:41.072966 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:41.072966 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:41.072966 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:41.072966 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:41.072966 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:38:41.072966 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:38:41.072966 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:38:41.072966 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:38:41.074024 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:41.074024 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:41.074024 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:41.074024 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:41.074024 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:41.074024 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:41.074024 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:41.074024 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:41.074024 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:41.074024 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:41.074024 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:41.074024 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:41.074024 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:41.074024 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:41.074024 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:41.074024 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:41.074024 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:38:41.074911 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:38:41.074911 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:41.074911 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:41.081370 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 310/620] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:38:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:41.092879 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b5f3fd-c83d-42e8-b0db-80cc2ddde36a None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:41.112643 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54651e72-174b-4f1e-9f61-b04e5603aff3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:41.115811 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54651e72-174b-4f1e-9f61-b04e5603aff3 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:41.254965 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:41.271355 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 311/621] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Sep 24 19:38:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 836 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:38:41.278892 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54651e72-174b-4f1e-9f61-b04e5603aff3 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:41.348759 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b5f3fd-c83d-42e8-b0db-80cc2ddde36a None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:41.414690 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c159868a-3899-49b2-858e-0aa6d3f13d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:41.415308 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159868a-3899-49b2-858e-0aa6d3f13d3c None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:41.415581 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159868a-3899-49b2-858e-0aa6d3f13d3c None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:41.415849 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159868a-3899-49b2-858e-0aa6d3f13d3c None admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:41.416496 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c159868a-3899-49b2-858e-0aa6d3f13d3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:41.416793 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c159868a-3899-49b2-858e-0aa6d3f13d3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:41.418198 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c159868a-3899-49b2-858e-0aa6d3f13d3c None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:41.418818 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54651e72-174b-4f1e-9f61-b04e5603aff3 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:41.432808 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 311/622] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:38:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:41.434227 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5803d-4a98-4cca-aad4-372187de2cbf None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:41.434509 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5803d-4a98-4cca-aad4-372187de2cbf None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:41.434775 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5803d-4a98-4cca-aad4-372187de2cbf None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:41.440320 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 312/623] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:38:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:38:41.441291 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5803d-4a98-4cca-aad4-372187de2cbf None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:41.455726 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d842f905-468f-4a2d-b25d-020b0571ded0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:41.456983 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842f905-468f-4a2d-b25d-020b0571ded0 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:41.458855 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842f905-468f-4a2d-b25d-020b0571ded0 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:41.458855 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842f905-468f-4a2d-b25d-020b0571ded0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:41.470402 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d842f905-468f-4a2d-b25d-020b0571ded0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:41.471975 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d842f905-468f-4a2d-b25d-020b0571ded0 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:41.475378 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:41.489923 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-d842f905-468f-4a2d-b25d-020b0571ded0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:41.489923 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:41.489923 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:41.489923 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:41.489923 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:41.489923 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:41.489923 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:41.489923 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:41.489923 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:41.489923 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:41.489923 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:41.489923 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:41.489923 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:38:41.489923 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:38:41.489923 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:38:41.489923 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:38:41.491927 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:41.491927 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:41.491927 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:41.491927 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:41.491927 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:41.491927 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:41.491927 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:41.491927 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:41.491927 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:41.491927 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:41.491927 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:41.491927 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:41.491927 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:41.491927 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:41.491927 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:41.491927 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:41.491927 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:38:41.494243 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:38:41.494243 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:41.494243 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:41.494243 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 312/624] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:38:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:41.494243 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfa0c4-7e28-4596-b0a8-ea54014266be None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:41.494243 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfa0c4-7e28-4596-b0a8-ea54014266be None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:41.494243 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfa0c4-7e28-4596-b0a8-ea54014266be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:41.514277 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-6ccfa0c4-7e28-4596-b0a8-ea54014266be None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:38:41.515544 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-6ccfa0c4-7e28-4596-b0a8-ea54014266be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:38:41.543779 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:41.556251 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5803d-4a98-4cca-aad4-372187de2cbf None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:41.593542 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4086bad3-690f-4db5-8e9c-ebc3c8e27011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:41.594184 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086bad3-690f-4db5-8e9c-ebc3c8e27011 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:41.594463 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086bad3-690f-4db5-8e9c-ebc3c8e27011 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:41.594726 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086bad3-690f-4db5-8e9c-ebc3c8e27011 None admin] PATH_INFO: `/v3/users/swift` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:41.596642 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 313/625] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:38:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:38:41.598301 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccfa0c4-7e28-4596-b0a8-ea54014266be None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:41.611998 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4086bad3-690f-4db5-8e9c-ebc3c8e27011 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:41.613523 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4086bad3-690f-4db5-8e9c-ebc3c8e27011 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:41.638156 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-4086bad3-690f-4db5-8e9c-ebc3c8e27011 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 24 19:38:41.638156 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:41.638156 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:41.638156 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:41.638156 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:41.638156 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:41.638156 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:41.638156 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:41.638156 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:41.638156 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:41.638156 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:41.638156 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:41.638156 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:38:41.638156 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:38:41.638156 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:38:41.638156 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:38:41.639287 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:41.639287 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:41.639287 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:38:41.639287 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:38:41.639287 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:38:41.639287 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:38:41.639287 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:41.639287 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:41.639287 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:41.639287 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:41.639287 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:41.639287 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:41.639287 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:41.639287 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:41.639287 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:41.639287 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:41.639287 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:41.639287 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:41.640284 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:41.640284 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:41.640284 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:38:41.640284 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:38:41.640284 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:38:41.640284 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:38:41.640284 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:38:41.640284 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:38:41.640284 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 24 19:38:41.640284 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:41.640284 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 313/626] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Sep 24 19:38:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:41.647404 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4086bad3-690f-4db5-8e9c-ebc3c8e27011 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:41.714025 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccfa0c4-7e28-4596-b0a8-ea54014266be None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:41.753086 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac6e44-b414-4527-b638-9d492a6d7b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:41.753777 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac6e44-b414-4527-b638-9d492a6d7b36 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:41.754059 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac6e44-b414-4527-b638-9d492a6d7b36 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:41.754371 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac6e44-b414-4527-b638-9d492a6d7b36 None admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:41.754982 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ac6e44-b414-4527-b638-9d492a6d7b36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:41.755289 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ac6e44-b414-4527-b638-9d492a6d7b36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:41.756908 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ac6e44-b414-4527-b638-9d492a6d7b36 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:41.770772 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 314/627] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:38:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:41.779322 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac6e44-b414-4527-b638-9d492a6d7b36 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:41.801190 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:41.854247 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:41.863780 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4086bad3-690f-4db5-8e9c-ebc3c8e27011 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:41.898013 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac6e44-b414-4527-b638-9d492a6d7b36 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:41.912529 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f84557-fa6a-4315-a169-9212fb12621f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:41.912529 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f84557-fa6a-4315-a169-9212fb12621f None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:41.912529 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f84557-fa6a-4315-a169-9212fb12621f None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:41.912529 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f84557-fa6a-4315-a169-9212fb12621f None admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:41.912972 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f84557-fa6a-4315-a169-9212fb12621f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:41.912972 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f84557-fa6a-4315-a169-9212fb12621f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:41.914093 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f84557-fa6a-4315-a169-9212fb12621f None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:41.943568 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 314/628] 10.222.0.60 () {56 vars in 1135 bytes} [Sat Sep 24 19:38:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:38:41.951227 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f84557-fa6a-4315-a169-9212fb12621f None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:41.964041 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a05aca2-6338-4e63-812c-f18edf4c97dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:41.964681 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a05aca2-6338-4e63-812c-f18edf4c97dc None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:41.964956 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a05aca2-6338-4e63-812c-f18edf4c97dc None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:41.965232 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a05aca2-6338-4e63-812c-f18edf4c97dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:41.972715 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a05aca2-6338-4e63-812c-f18edf4c97dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:41.974454 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a05aca2-6338-4e63-812c-f18edf4c97dc None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:41.999917 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-8a05aca2-6338-4e63-812c-f18edf4c97dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:38:41.999917 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:41.999917 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:41.999917 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:41.999917 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:41.999917 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:41.999917 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:41.999917 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:41.999917 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:41.999917 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:41.999917 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:41.999917 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:41.999917 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:38:41.999917 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:38:41.999917 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:38:42.000907 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:38:42.000907 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:42.000907 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:42.000907 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:42.000907 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:42.000907 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:42.000907 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:42.000907 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:42.000907 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:42.000907 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:42.000907 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:42.000907 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:42.000907 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:42.000907 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:42.000907 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:42.000907 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:42.000907 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:42.001815 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:38:42.001815 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:38:42.001815 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:38:42.001815 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:38:42.001815 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:38:42.001815 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:38:42.001815 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:38:42.001815 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:42.001815 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 315/629] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Sep 24 19:38:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:42.008012 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a05aca2-6338-4e63-812c-f18edf4c97dc None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:42.088295 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f84557-fa6a-4315-a169-9212fb12621f None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:42.105840 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:42.130110 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ce230-a878-44a3-a09b-88b16a6e1b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:42.131316 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ce230-a878-44a3-a09b-88b16a6e1b55 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:42.131741 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ce230-a878-44a3-a09b-88b16a6e1b55 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:42.132022 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ce230-a878-44a3-a09b-88b16a6e1b55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:42.133967 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a05aca2-6338-4e63-812c-f18edf4c97dc None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:42.143137 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94ce230-a878-44a3-a09b-88b16a6e1b55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:42.144695 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94ce230-a878-44a3-a09b-88b16a6e1b55 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:42.160448 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-e94ce230-a878-44a3-a09b-88b16a6e1b55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:42.160448 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:42.160448 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:42.160448 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:42.160448 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:42.160448 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:42.160448 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:42.160448 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:42.160448 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:42.160448 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:42.160448 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:42.160448 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:42.160448 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:38:42.160448 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:38:42.160448 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:38:42.160448 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:38:42.161447 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:42.161447 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:42.161447 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:42.161447 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:42.161447 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:42.161447 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:42.161447 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:42.161447 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:42.161447 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:42.161447 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:42.161447 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:42.161447 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:42.161447 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:42.161447 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:42.161447 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:42.161447 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:42.161447 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:38:42.162534 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:38:42.162534 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:42.162534 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:42.162534 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 315/630] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:38:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:42.163383 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ce230-a878-44a3-a09b-88b16a6e1b55 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:42.169425 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:42.176971 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97261454-4575-474c-bea7-33ea50f1e00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:42.177637 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97261454-4575-474c-bea7-33ea50f1e00b None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:42.177914 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97261454-4575-474c-bea7-33ea50f1e00b None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:42.178185 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97261454-4575-474c-bea7-33ea50f1e00b None admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:42.178892 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97261454-4575-474c-bea7-33ea50f1e00b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:42.179200 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97261454-4575-474c-bea7-33ea50f1e00b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:42.183568 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97261454-4575-474c-bea7-33ea50f1e00b None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:42.194525 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 316/631] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Sep 24 19:38:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:38:42.196055 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272ee1e-b327-4a7b-989c-5a6cd7523e44 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:42.196485 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272ee1e-b327-4a7b-989c-5a6cd7523e44 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:42.196803 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272ee1e-b327-4a7b-989c-5a6cd7523e44 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:42.201009 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 317/632] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:38:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:38:42.201009 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272ee1e-b327-4a7b-989c-5a6cd7523e44 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:42.299095 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ce230-a878-44a3-a09b-88b16a6e1b55 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:42.326076 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272ee1e-b327-4a7b-989c-5a6cd7523e44 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:42.344622 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6556455-8d7a-44c8-822f-c00f7374aa72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:42.345377 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6556455-8d7a-44c8-822f-c00f7374aa72 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:42.345691 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6556455-8d7a-44c8-822f-c00f7374aa72 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:42.346117 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6556455-8d7a-44c8-822f-c00f7374aa72 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:42.362066 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6556455-8d7a-44c8-822f-c00f7374aa72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:38:42.365694 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce8c4a-6d13-45db-aa8e-a7ba688a2bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:42.366305 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce8c4a-6d13-45db-aa8e-a7ba688a2bcb None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:42.366600 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce8c4a-6d13-45db-aa8e-a7ba688a2bcb None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:42.366842 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce8c4a-6d13-45db-aa8e-a7ba688a2bcb None admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:42.367478 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ce8c4a-6d13-45db-aa8e-a7ba688a2bcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:42.367774 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ce8c4a-6d13-45db-aa8e-a7ba688a2bcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:42.368307 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-b6556455-8d7a-44c8-822f-c00f7374aa72 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:38:42.368307 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:42.368307 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:42.368307 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:42.368307 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:42.368307 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:42.368307 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:42.368307 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:42.368307 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:42.368307 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:42.368307 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:42.368307 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:42.368307 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:38:42.368307 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:38:42.368307 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:38:42.368307 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:38:42.369185 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:38:42.369185 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:38:42.369185 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:38:42.369185 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:38:42.369185 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:42.369185 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:42.369185 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:42.369185 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:42.369185 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:42.369185 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:42.369185 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:42.369185 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:42.369185 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:42.369185 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:42.369185 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:42.369185 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:42.370713 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:42.370713 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:42.370713 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:42.370713 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:42.370713 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:38:42.370713 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:38:42.370713 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:38:42.370713 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:38:42.370713 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:38:42.370713 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:38:42.370713 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:38:42.370713 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:42.371381 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ce8c4a-6d13-45db-aa8e-a7ba688a2bcb None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:42.371461 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 316/633] 10.222.0.60 () {56 vars in 1102 bytes} [Sat Sep 24 19:38:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:42.371461 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6556455-8d7a-44c8-822f-c00f7374aa72 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:42.376500 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:42.383275 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 318/634] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:38:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:42.384330 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9676d-ba25-4cd7-af01-1b4bcfef06ae None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:42.384614 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9676d-ba25-4cd7-af01-1b4bcfef06ae None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:42.384887 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9676d-ba25-4cd7-af01-1b4bcfef06ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:42.404601 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-eca9676d-ba25-4cd7-af01-1b4bcfef06ae None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:38:42.405376 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-eca9676d-ba25-4cd7-af01-1b4bcfef06ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:38:42.450967 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:42.490277 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 319/635] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:38:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:38:42.491401 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9676d-ba25-4cd7-af01-1b4bcfef06ae None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:42.509835 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6556455-8d7a-44c8-822f-c00f7374aa72 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:42.548753 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee06a60-e166-4ed1-9fcf-264594c34aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:42.549785 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee06a60-e166-4ed1-9fcf-264594c34aae None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:42.550941 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee06a60-e166-4ed1-9fcf-264594c34aae None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:42.551554 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee06a60-e166-4ed1-9fcf-264594c34aae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:42.552490 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee06a60-e166-4ed1-9fcf-264594c34aae None admin] RBAC: Adding query filter params (role.id=e9acf72f841f4030a76e8f9c41c95d7f, scope.project.id=5c2da88af5714e619238772bde676a42, user.id=f3b5047a59bc4547be643ffa78808a6d) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:42.553028 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee06a60-e166-4ed1-9fcf-264594c34aae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:42.554712 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee06a60-e166-4ed1-9fcf-264594c34aae None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:42.561601 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 317/636] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Sep 24 19:38:42 2022] GET /identity/v3/role_assignments?user.id=f3b5047a59bc4547be643ffa78808a6d&scope.project.id=5c2da88af5714e619238772bde676a42&role.id=e9acf72f841f4030a76e8f9c41c95d7f => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:42.562634 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee06a60-e166-4ed1-9fcf-264594c34aae None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:42.636957 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9676d-ba25-4cd7-af01-1b4bcfef06ae None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:42.670932 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:42.687871 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119794cf-1bb2-45d4-87bd-cc6140e85c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:42.687871 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119794cf-1bb2-45d4-87bd-cc6140e85c45 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:42.687871 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119794cf-1bb2-45d4-87bd-cc6140e85c45 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:42.687871 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119794cf-1bb2-45d4-87bd-cc6140e85c45 None admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:42.688265 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119794cf-1bb2-45d4-87bd-cc6140e85c45 None admin] RBAC: Adding query filter params (name=service) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:42.688265 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119794cf-1bb2-45d4-87bd-cc6140e85c45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:42.689804 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119794cf-1bb2-45d4-87bd-cc6140e85c45 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:42.699686 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 320/637] 10.222.0.60 () {56 vars in 1103 bytes} [Sat Sep 24 19:38:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:42.701413 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bad6ab-bf72-477f-8bf2-115fb734b5c6 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:42.701938 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bad6ab-bf72-477f-8bf2-115fb734b5c6 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:42.702488 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bad6ab-bf72-477f-8bf2-115fb734b5c6 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:42.704419 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 321/638] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:38:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:38:42.705447 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bad6ab-bf72-477f-8bf2-115fb734b5c6 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:42.712861 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee06a60-e166-4ed1-9fcf-264594c34aae None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:42.755812 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:42.768616 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff404cd-b396-4031-b6b2-e479da7f6b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:42.769574 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff404cd-b396-4031-b6b2-e479da7f6b32 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:42.769997 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff404cd-b396-4031-b6b2-e479da7f6b32 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:42.770277 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff404cd-b396-4031-b6b2-e479da7f6b32 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:42.780644 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff404cd-b396-4031-b6b2-e479da7f6b32 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:42.782954 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff404cd-b396-4031-b6b2-e479da7f6b32 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:42.801726 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-7ff404cd-b396-4031-b6b2-e479da7f6b32 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:38:42.801726 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:42.801726 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:42.801726 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:42.801726 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:42.801726 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:42.801726 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:42.801726 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:42.801726 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:42.801726 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:42.801726 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:42.801726 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:42.801726 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:38:42.801726 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:38:42.801726 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:38:42.802888 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:38:42.802888 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:42.802888 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:42.802888 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:42.802888 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:42.802888 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:42.802888 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:42.802888 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:42.802888 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:42.802888 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:42.802888 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:42.802888 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:42.802888 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:42.802888 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:42.802888 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:42.802888 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:42.802888 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:42.804057 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:38:42.804057 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:38:42.804057 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:38:42.804057 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:38:42.804057 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:38:42.804057 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:38:42.804057 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:38:42.804057 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:42.810823 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 318/639] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Sep 24 19:38:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:42.812586 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ed576-5a44-4b6f-afc0-758883b562fa None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:42.812881 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ed576-5a44-4b6f-afc0-758883b562fa None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:42.813159 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ed576-5a44-4b6f-afc0-758883b562fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:42.835317 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-957ed576-5a44-4b6f-afc0-758883b562fa None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:38:42.836518 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-957ed576-5a44-4b6f-afc0-758883b562fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:38:42.846148 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bad6ab-bf72-477f-8bf2-115fb734b5c6 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:42.886104 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4b985-aac5-492a-b485-c05d8471c0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:42.886738 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4b985-aac5-492a-b485-c05d8471c0cc None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:42.887067 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4b985-aac5-492a-b485-c05d8471c0cc None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:42.887329 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4b985-aac5-492a-b485-c05d8471c0cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:42.902113 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe4b985-aac5-492a-b485-c05d8471c0cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:42.904234 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe4b985-aac5-492a-b485-c05d8471c0cc None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:42.921434 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 319/640] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:38:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:38:42.922135 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ed576-5a44-4b6f-afc0-758883b562fa None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:42.923431 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-7fe4b985-aac5-492a-b485-c05d8471c0cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:42.923431 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:42.923431 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:42.923431 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:42.923431 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:42.923431 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:42.923431 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:42.923431 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:42.923431 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:42.923431 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:42.923431 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:42.923431 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:42.923431 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:38:42.923431 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:38:42.923431 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:38:42.923431 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:38:42.924325 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:42.924325 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:42.924325 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:42.924325 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:42.924325 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:42.924325 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:42.924325 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:42.924325 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:42.924325 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:42.924325 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:42.924325 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:42.924325 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:42.924325 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:42.924325 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:42.924325 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:42.924325 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:42.924325 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:38:42.925872 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:38:42.925872 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:42.925872 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:42.926786 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 322/641] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:38:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:42.927466 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4b985-aac5-492a-b485-c05d8471c0cc None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:42.992989 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:43.055829 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ed576-5a44-4b6f-afc0-758883b562fa None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:43.070824 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4b985-aac5-492a-b485-c05d8471c0cc None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:43.075795 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:43.098818 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590062d-bb7b-4bca-b779-f5e15ecbbfff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:43.099442 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590062d-bb7b-4bca-b779-f5e15ecbbfff None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:43.099775 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590062d-bb7b-4bca-b779-f5e15ecbbfff None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:43.100047 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590062d-bb7b-4bca-b779-f5e15ecbbfff None admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:43.100861 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8590062d-bb7b-4bca-b779-f5e15ecbbfff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:43.101940 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8590062d-bb7b-4bca-b779-f5e15ecbbfff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:43.105556 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8590062d-bb7b-4bca-b779-f5e15ecbbfff None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:43.119861 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed335b-cc6d-49d4-bd2f-e5e32b864e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:43.120791 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed335b-cc6d-49d4-bd2f-e5e32b864e96 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:43.121212 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed335b-cc6d-49d4-bd2f-e5e32b864e96 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:43.126214 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed335b-cc6d-49d4-bd2f-e5e32b864e96 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:43.126386 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 320/642] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Sep 24 19:38:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:43.126386 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590062d-bb7b-4bca-b779-f5e15ecbbfff None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:43.141371 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ed335b-cc6d-49d4-bd2f-e5e32b864e96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:38:43.148648 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-36ed335b-cc6d-49d4-bd2f-e5e32b864e96 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:38:43.148648 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:43.148648 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:43.148648 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:43.148648 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:43.148648 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:43.148648 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:43.148648 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:43.148648 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:43.148648 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:43.148648 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:43.148648 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:43.148648 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:38:43.148648 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:38:43.148648 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:38:43.148648 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:38:43.149895 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:38:43.149895 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:38:43.149895 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:38:43.149895 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:38:43.149895 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:43.149895 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:43.149895 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:43.149895 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:43.149895 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:43.149895 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:43.149895 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:43.149895 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:43.149895 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:43.149895 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:43.149895 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:43.149895 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:43.150923 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:43.150923 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:43.150923 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:43.150923 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:43.150923 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:38:43.150923 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:38:43.150923 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:38:43.150923 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:38:43.150923 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:38:43.150923 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:38:43.150923 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:38:43.150923 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:43.153902 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 323/643] 10.222.0.60 () {56 vars in 1102 bytes} [Sat Sep 24 19:38:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:43.154955 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed335b-cc6d-49d4-bd2f-e5e32b864e96 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:43.242313 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590062d-bb7b-4bca-b779-f5e15ecbbfff None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:43.276760 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed335b-cc6d-49d4-bd2f-e5e32b864e96 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:43.278491 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:43.280345 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29311b96-4720-4171-9559-6ffb686a07c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:43.280962 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29311b96-4720-4171-9559-6ffb686a07c5 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:43.281239 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29311b96-4720-4171-9559-6ffb686a07c5 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:43.281543 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29311b96-4720-4171-9559-6ffb686a07c5 None admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:43.282190 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29311b96-4720-4171-9559-6ffb686a07c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:43.282492 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29311b96-4720-4171-9559-6ffb686a07c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:43.283853 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29311b96-4720-4171-9559-6ffb686a07c5 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:43.296923 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 321/644] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:38:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:43.302727 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29311b96-4720-4171-9559-6ffb686a07c5 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:43.318016 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b7b310-7d26-4f7a-9d92-7f73b8478e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:43.319186 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7b310-7d26-4f7a-9d92-7f73b8478e73 None admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:43.319958 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7b310-7d26-4f7a-9d92-7f73b8478e73 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:43.320237 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7b310-7d26-4f7a-9d92-7f73b8478e73 None admin] PATH_INFO: `/v3/projects/5c2da88af5714e619238772bde676a42/users/ebd94cd16acc45e6ac2997204297fb75/roles/e9acf72f841f4030a76e8f9c41c95d7f` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:43.336523 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b7b310-7d26-4f7a-9d92-7f73b8478e73 None admin] RBAC: Authorizing `identity:create_grant(project_id=5c2da88af5714e619238772bde676a42, user_id=ebd94cd16acc45e6ac2997204297fb75, role_id=e9acf72f841f4030a76e8f9c41c95d7f)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:43.338028 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b7b310-7d26-4f7a-9d92-7f73b8478e73 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:43.345093 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:43.417704 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29311b96-4720-4171-9559-6ffb686a07c5 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:43.452215 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 324/645] 10.222.0.60 () {58 vars in 1439 bytes} [Sat Sep 24 19:38:43 2022] PUT /identity/v3/projects/5c2da88af5714e619238772bde676a42/users/ebd94cd16acc45e6ac2997204297fb75/roles/e9acf72f841f4030a76e8f9c41c95d7f => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:38:43.453403 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b7b310-7d26-4f7a-9d92-7f73b8478e73 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:43.462580 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06d3c1e-3512-4ea9-af23-1d1c2d6beec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:43.463899 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d3c1e-3512-4ea9-af23-1d1c2d6beec0 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:43.464346 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d3c1e-3512-4ea9-af23-1d1c2d6beec0 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:43.467065 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d3c1e-3512-4ea9-af23-1d1c2d6beec0 None admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:43.467065 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06d3c1e-3512-4ea9-af23-1d1c2d6beec0 None admin] RBAC: Adding query filter params (name=service) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:43.467065 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06d3c1e-3512-4ea9-af23-1d1c2d6beec0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:43.470160 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06d3c1e-3512-4ea9-af23-1d1c2d6beec0 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:43.486691 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 322/646] 10.222.0.60 () {56 vars in 1103 bytes} [Sat Sep 24 19:38:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:43.489044 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06d3c1e-3512-4ea9-af23-1d1c2d6beec0 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:43.619169 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b7b310-7d26-4f7a-9d92-7f73b8478e73 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:43.625153 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:43.631673 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06d3c1e-3512-4ea9-af23-1d1c2d6beec0 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:43.666797 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3271580-71e7-4fb2-bd99-8905234ef499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:43.667456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3271580-71e7-4fb2-bd99-8905234ef499 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:43.667944 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3271580-71e7-4fb2-bd99-8905234ef499 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:43.668172 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3271580-71e7-4fb2-bd99-8905234ef499 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:43.687168 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd863a-cdb3-41a8-b978-a254730ec195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:43.687820 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd863a-cdb3-41a8-b978-a254730ec195 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:43.688103 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd863a-cdb3-41a8-b978-a254730ec195 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:43.688374 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd863a-cdb3-41a8-b978-a254730ec195 None admin] PATH_INFO: `/v3/users/glance` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:43.690119 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3271580-71e7-4fb2-bd99-8905234ef499 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:38:43.696491 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-c3271580-71e7-4fb2-bd99-8905234ef499 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:38:43.696491 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:43.696491 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:43.696491 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:43.696491 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:43.696491 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:43.696491 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:43.696491 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:43.696491 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:43.696491 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:43.696491 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:43.696491 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:43.696491 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:38:43.696491 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:38:43.696491 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:38:43.696491 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:38:43.697897 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:38:43.697897 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:38:43.697897 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:38:43.697897 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:38:43.697897 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:43.697897 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:43.697897 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:43.697897 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:43.697897 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:43.697897 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:43.697897 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:43.697897 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:43.697897 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:43.697897 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:43.697897 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:43.697897 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:43.698812 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:43.698812 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:43.698812 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:43.698812 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:43.698812 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:38:43.698812 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:38:43.698812 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:38:43.698812 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:38:43.698812 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:38:43.698812 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:38:43.698812 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:38:43.698812 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:43.698812 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 325/647] 10.222.0.60 () {56 vars in 1102 bytes} [Sat Sep 24 19:38:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:43.699541 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecd863a-cdb3-41a8-b978-a254730ec195 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:43.699624 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3271580-71e7-4fb2-bd99-8905234ef499 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:43.704805 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecd863a-cdb3-41a8-b978-a254730ec195 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:43.716961 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-fecd863a-cdb3-41a8-b978-a254730ec195 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 24 19:38:43.716961 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:43.716961 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:43.716961 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:43.716961 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:43.716961 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:43.716961 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:43.716961 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:43.716961 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:43.716961 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:43.716961 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:43.716961 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:43.716961 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:38:43.716961 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:38:43.716961 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:38:43.716961 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:38:43.717998 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:43.717998 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:43.717998 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:38:43.717998 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:38:43.717998 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:38:43.717998 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:38:43.717998 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:43.717998 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:43.717998 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:43.717998 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:43.717998 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:43.717998 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:43.717998 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:43.717998 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:43.717998 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:43.717998 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:43.717998 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:43.717998 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:43.719387 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:43.719387 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:43.719387 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:38:43.719387 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:38:43.719387 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:38:43.719387 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:38:43.719387 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:38:43.719387 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:38:43.719387 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 24 19:38:43.719387 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:43.723059 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 323/648] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Sep 24 19:38:43 2022] GET /identity/v3/users/glance => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:43.723059 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd863a-cdb3-41a8-b978-a254730ec195 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:43.727063 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:43.828218 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3271580-71e7-4fb2-bd99-8905234ef499 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:43.869222 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd863a-cdb3-41a8-b978-a254730ec195 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:43.870295 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff94734-346a-4e74-876b-db5aa469e23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:43.870953 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff94734-346a-4e74-876b-db5aa469e23b None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:43.871236 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff94734-346a-4e74-876b-db5aa469e23b None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:43.871514 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff94734-346a-4e74-876b-db5aa469e23b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:43.888220 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff94734-346a-4e74-876b-db5aa469e23b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:43.891120 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff94734-346a-4e74-876b-db5aa469e23b None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:43.911703 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-4ff94734-346a-4e74-876b-db5aa469e23b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:43.911703 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:43.911703 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:43.911703 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:43.911703 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:43.911703 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:43.911703 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:43.911703 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:43.911703 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:43.911703 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:43.911703 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:43.911703 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:43.911703 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:38:43.911703 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:38:43.911703 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:38:43.911703 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:38:43.913427 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:43.913427 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:43.913427 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:43.913427 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:43.913427 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:43.913427 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:43.913427 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:43.913427 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:43.913427 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:43.913427 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:43.913427 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:43.913427 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:43.913427 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:43.913427 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:43.913427 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:43.913427 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:43.913427 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:38:43.915004 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:38:43.915004 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:43.915004 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:43.917910 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 326/649] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:38:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:43.918991 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff94734-346a-4e74-876b-db5aa469e23b None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:43.928408 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8213020-ec51-4db3-b709-aa9784090c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:43.929749 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8213020-ec51-4db3-b709-aa9784090c36 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:43.930207 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8213020-ec51-4db3-b709-aa9784090c36 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:43.930667 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8213020-ec51-4db3-b709-aa9784090c36 None admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:43.932145 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8213020-ec51-4db3-b709-aa9784090c36 None admin] RBAC: Adding query filter params (name=service) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:43.932646 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8213020-ec51-4db3-b709-aa9784090c36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:43.934878 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8213020-ec51-4db3-b709-aa9784090c36 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:43.952533 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 324/650] 10.222.0.60 () {56 vars in 1103 bytes} [Sat Sep 24 19:38:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:43.952533 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8213020-ec51-4db3-b709-aa9784090c36 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:43.984884 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:44.002221 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:44.046169 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff94734-346a-4e74-876b-db5aa469e23b None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:44.095435 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9aa793-90a4-415a-8659-2233c5cc5c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:44.096397 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9aa793-90a4-415a-8659-2233c5cc5c31 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:44.096855 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9aa793-90a4-415a-8659-2233c5cc5c31 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:44.097727 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8213020-ec51-4db3-b709-aa9784090c36 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:44.098081 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9aa793-90a4-415a-8659-2233c5cc5c31 None admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:44.099157 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9aa793-90a4-415a-8659-2233c5cc5c31 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:44.099646 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9aa793-90a4-415a-8659-2233c5cc5c31 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:44.102602 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9aa793-90a4-415a-8659-2233c5cc5c31 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:44.132413 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 327/651] 10.222.0.60 () {56 vars in 1137 bytes} [Sat Sep 24 19:38:43 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:44.132413 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9aa793-90a4-415a-8659-2233c5cc5c31 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:44.149836 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ecac8b-7922-4a02-9607-547feba7cbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:44.151340 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ecac8b-7922-4a02-9607-547feba7cbc0 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:44.152089 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ecac8b-7922-4a02-9607-547feba7cbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:44.152561 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ecac8b-7922-4a02-9607-547feba7cbc0 None admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:44.153710 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ecac8b-7922-4a02-9607-547feba7cbc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:44.154662 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ecac8b-7922-4a02-9607-547feba7cbc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:44.156294 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ecac8b-7922-4a02-9607-547feba7cbc0 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:44.173520 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 325/652] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:38:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:44.179650 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ecac8b-7922-4a02-9607-547feba7cbc0 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:44.267053 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9aa793-90a4-415a-8659-2233c5cc5c31 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:44.276498 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:44.299722 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ecac8b-7922-4a02-9607-547feba7cbc0 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:44.301102 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:44.317278 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de62423b-afb3-4eca-8374-473a76b8098b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:44.318852 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de62423b-afb3-4eca-8374-473a76b8098b None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:44.319372 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de62423b-afb3-4eca-8374-473a76b8098b None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:44.319848 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de62423b-afb3-4eca-8374-473a76b8098b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:44.336529 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de62423b-afb3-4eca-8374-473a76b8098b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:44.339317 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de62423b-afb3-4eca-8374-473a76b8098b None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:44.348774 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d56c3-3f62-4280-b03d-dbefbc1fc846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:44.349572 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d56c3-3f62-4280-b03d-dbefbc1fc846 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:44.349953 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d56c3-3f62-4280-b03d-dbefbc1fc846 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:44.350322 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d56c3-3f62-4280-b03d-dbefbc1fc846 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:44.362441 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-de62423b-afb3-4eca-8374-473a76b8098b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:44.362441 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:44.362441 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:44.362441 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:44.362441 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:44.362441 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:44.362441 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:44.362441 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:44.362441 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:44.362441 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:44.362441 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:44.362441 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:44.362441 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:38:44.362441 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:38:44.362441 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:38:44.362441 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:38:44.363846 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:44.363846 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:44.363846 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:44.363846 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:44.363846 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:44.363846 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:44.363846 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:44.363846 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:44.363846 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:44.363846 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:44.363846 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:44.363846 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:44.363846 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:44.363846 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:44.363846 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:44.363846 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:44.363846 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:38:44.364939 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:38:44.364939 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:44.364939 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:44.372065 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 328/653] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:38:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:44.372065 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de62423b-afb3-4eca-8374-473a76b8098b None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:44.455425 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d56c3-3f62-4280-b03d-dbefbc1fc846 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:44.457807 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d56c3-3f62-4280-b03d-dbefbc1fc846 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:44.488880 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de62423b-afb3-4eca-8374-473a76b8098b None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:44.532107 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b89482-4a6d-47a3-8892-75fcda16d226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:44.532749 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b89482-4a6d-47a3-8892-75fcda16d226 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:44.533033 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b89482-4a6d-47a3-8892-75fcda16d226 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:44.533307 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b89482-4a6d-47a3-8892-75fcda16d226 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:44.543422 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b89482-4a6d-47a3-8892-75fcda16d226 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:44.544970 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b89482-4a6d-47a3-8892-75fcda16d226 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:44.557357 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-e5b89482-4a6d-47a3-8892-75fcda16d226 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 24 19:38:44.557357 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:44.557357 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:44.557357 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:44.557357 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:44.557357 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:44.557357 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:44.557357 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:44.557357 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:44.557357 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:44.557357 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:44.557357 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:44.557357 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:38:44.557357 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:38:44.557357 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:38:44.557357 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:38:44.558403 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:44.558403 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:44.558403 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:38:44.558403 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:38:44.558403 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:38:44.558403 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:38:44.558403 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:44.558403 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:44.558403 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:44.558403 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:44.558403 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:44.558403 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:44.558403 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:44.558403 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:44.558403 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:44.558403 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:44.558403 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:44.558403 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:44.559326 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:44.559326 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:44.559326 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:38:44.559326 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:38:44.559326 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:38:44.559326 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:38:44.559326 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:38:44.559326 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:38:44.559326 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 24 19:38:44.559326 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:44.563344 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 329/654] 10.222.0.60 () {56 vars in 1102 bytes} [Sat Sep 24 19:38:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:44.564260 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b89482-4a6d-47a3-8892-75fcda16d226 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:44.584651 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:44.605251 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:44.620708 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 326/655] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Sep 24 19:38:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:38:44.621928 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d56c3-3f62-4280-b03d-dbefbc1fc846 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:44.703943 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b89482-4a6d-47a3-8892-75fcda16d226 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:44.755449 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c27a0f-9aa4-47e9-8bf1-eac0396d04b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:44.757039 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c27a0f-9aa4-47e9-8bf1-eac0396d04b0 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:44.757476 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c27a0f-9aa4-47e9-8bf1-eac0396d04b0 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:44.757917 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c27a0f-9aa4-47e9-8bf1-eac0396d04b0 None admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:44.759047 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c27a0f-9aa4-47e9-8bf1-eac0396d04b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:44.759508 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c27a0f-9aa4-47e9-8bf1-eac0396d04b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:44.762069 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c27a0f-9aa4-47e9-8bf1-eac0396d04b0 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:44.763964 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d56c3-3f62-4280-b03d-dbefbc1fc846 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:44.782598 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 330/656] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:38:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:44.782598 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c27a0f-9aa4-47e9-8bf1-eac0396d04b0 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:44.819567 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282fe162-dde5-4482-9bbc-ab619f3422db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:44.820820 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282fe162-dde5-4482-9bbc-ab619f3422db None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:44.821581 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282fe162-dde5-4482-9bbc-ab619f3422db None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:44.822487 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282fe162-dde5-4482-9bbc-ab619f3422db None admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:44.823741 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282fe162-dde5-4482-9bbc-ab619f3422db None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:44.824284 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282fe162-dde5-4482-9bbc-ab619f3422db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:44.827203 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282fe162-dde5-4482-9bbc-ab619f3422db None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:44.857056 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 327/657] 10.222.0.60 () {56 vars in 1139 bytes} [Sat Sep 24 19:38:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:44.858155 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282fe162-dde5-4482-9bbc-ab619f3422db None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:44.912689 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:44.913729 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:44.922539 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c27a0f-9aa4-47e9-8bf1-eac0396d04b0 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:44.970260 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a044055-e6c8-47df-8c2c-e7fccb044ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:44.971409 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a044055-e6c8-47df-8c2c-e7fccb044ee7 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:44.971699 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a044055-e6c8-47df-8c2c-e7fccb044ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:44.972043 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a044055-e6c8-47df-8c2c-e7fccb044ee7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:44.989053 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a044055-e6c8-47df-8c2c-e7fccb044ee7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:44.990690 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a044055-e6c8-47df-8c2c-e7fccb044ee7 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:44.992402 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282fe162-dde5-4482-9bbc-ab619f3422db None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:45.008931 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-0a044055-e6c8-47df-8c2c-e7fccb044ee7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:45.008931 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:45.008931 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:45.008931 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:45.008931 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:45.008931 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:45.008931 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:45.008931 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:45.008931 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:45.008931 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:45.008931 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:45.008931 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:45.008931 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:38:45.008931 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:38:45.008931 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:38:45.008931 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:38:45.009953 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:45.009953 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:45.009953 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:45.009953 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:45.009953 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:45.009953 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:45.009953 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:45.009953 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:45.009953 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:45.009953 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:45.009953 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:45.009953 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:45.009953 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:45.009953 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:45.009953 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:45.009953 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:45.009953 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:38:45.011235 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:38:45.011235 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:45.011235 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:45.011235 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 331/658] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:38:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:45.011235 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a044055-e6c8-47df-8c2c-e7fccb044ee7 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:45.042556 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e5d00-ba79-46b6-b484-0ae17e7b277e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:45.043195 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e5d00-ba79-46b6-b484-0ae17e7b277e None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:45.043467 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e5d00-ba79-46b6-b484-0ae17e7b277e None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:45.043737 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e5d00-ba79-46b6-b484-0ae17e7b277e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:45.051739 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e5d00-ba79-46b6-b484-0ae17e7b277e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:45.055129 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e5d00-ba79-46b6-b484-0ae17e7b277e None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:45.068332 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-389e5d00-ba79-46b6-b484-0ae17e7b277e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 24 19:38:45.068332 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:45.068332 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:45.068332 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:45.068332 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:45.068332 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:45.068332 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:45.068332 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:45.068332 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:45.068332 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:45.068332 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:45.068332 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:45.068332 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:38:45.068332 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:38:45.068332 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:38:45.068332 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:38:45.069334 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:45.069334 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:45.069334 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:38:45.069334 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:38:45.069334 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:38:45.069334 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:38:45.069334 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:45.069334 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:45.069334 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:45.069334 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:45.069334 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:45.069334 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:45.069334 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:45.069334 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:45.069334 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:45.069334 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:45.069334 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:45.069334 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:45.070911 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:45.070911 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:45.070911 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:38:45.070911 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:38:45.070911 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:38:45.070911 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:38:45.070911 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:38:45.070911 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:38:45.070911 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 24 19:38:45.070911 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:45.070911 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 328/659] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Sep 24 19:38:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:45.075399 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1934871-9321-4807-a231-ab8dab804a72 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:45.075685 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1934871-9321-4807-a231-ab8dab804a72 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:45.075961 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1934871-9321-4807-a231-ab8dab804a72 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:45.077272 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 329/660] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:38:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:38:45.078003 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1934871-9321-4807-a231-ab8dab804a72 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:45.141267 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a044055-e6c8-47df-8c2c-e7fccb044ee7 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:45.180668 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c4c70-a183-4d45-91d5-70b91b225f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:45.181322 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c4c70-a183-4d45-91d5-70b91b225f88 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:45.181655 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c4c70-a183-4d45-91d5-70b91b225f88 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:45.181931 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c4c70-a183-4d45-91d5-70b91b225f88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:45.193838 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:45.199545 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1934871-9321-4807-a231-ab8dab804a72 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:45.201253 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:45.241362 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd5407-d0f7-4438-bc0c-bb945b31ca67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:45.242404 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd5407-d0f7-4438-bc0c-bb945b31ca67 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:45.242884 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd5407-d0f7-4438-bc0c-bb945b31ca67 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:45.243219 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd5407-d0f7-4438-bc0c-bb945b31ca67 None admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:45.244118 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dd5407-d0f7-4438-bc0c-bb945b31ca67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:45.244497 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dd5407-d0f7-4438-bc0c-bb945b31ca67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:45.246038 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dd5407-d0f7-4438-bc0c-bb945b31ca67 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:45.264108 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 330/661] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:38:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:45.264108 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd5407-d0f7-4438-bc0c-bb945b31ca67 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:45.270204 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c4c70-a183-4d45-91d5-70b91b225f88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:45.272466 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c4c70-a183-4d45-91d5-70b91b225f88 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:45.374316 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd5407-d0f7-4438-bc0c-bb945b31ca67 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:45.393747 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 332/662] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Sep 24 19:38:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:38:45.395664 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001655a9-fbab-4540-8722-228e37fea6e4 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:45.396078 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001655a9-fbab-4540-8722-228e37fea6e4 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:45.396477 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001655a9-fbab-4540-8722-228e37fea6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:45.415686 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-001655a9-fbab-4540-8722-228e37fea6e4 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:38:45.416885 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-001655a9-fbab-4540-8722-228e37fea6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:38:45.421606 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a3d93-97d2-4a2b-867f-2b75347cf755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:45.422232 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a3d93-97d2-4a2b-867f-2b75347cf755 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:45.422507 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a3d93-97d2-4a2b-867f-2b75347cf755 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:45.422774 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a3d93-97d2-4a2b-867f-2b75347cf755 None admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:45.423503 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685a3d93-97d2-4a2b-867f-2b75347cf755 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:45.423807 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685a3d93-97d2-4a2b-867f-2b75347cf755 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:45.426468 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685a3d93-97d2-4a2b-867f-2b75347cf755 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:45.449472 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 331/663] 10.222.0.60 () {56 vars in 1137 bytes} [Sat Sep 24 19:38:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:45.454604 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a3d93-97d2-4a2b-867f-2b75347cf755 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:45.470749 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:45.479619 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:45.497937 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 333/664] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:38:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:38:45.507038 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001655a9-fbab-4540-8722-228e37fea6e4 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:45.589481 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a3d93-97d2-4a2b-867f-2b75347cf755 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:45.610553 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001655a9-fbab-4540-8722-228e37fea6e4 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:45.633880 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c371182-896f-4409-8aef-7cc751c2e674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:45.634663 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c371182-896f-4409-8aef-7cc751c2e674 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:45.634946 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c371182-896f-4409-8aef-7cc751c2e674 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:45.635221 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c371182-896f-4409-8aef-7cc751c2e674 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:45.643505 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c371182-896f-4409-8aef-7cc751c2e674 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:45.645854 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c371182-896f-4409-8aef-7cc751c2e674 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:45.651491 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386eaaa3-9bd8-409d-b644-235d1fd053cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:45.652331 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386eaaa3-9bd8-409d-b644-235d1fd053cd None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:45.652708 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386eaaa3-9bd8-409d-b644-235d1fd053cd None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:45.653080 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386eaaa3-9bd8-409d-b644-235d1fd053cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:45.665470 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386eaaa3-9bd8-409d-b644-235d1fd053cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:45.666685 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-2c371182-896f-4409-8aef-7cc751c2e674 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:38:45.666685 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:45.666685 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:45.666685 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:45.666685 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:45.666685 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:45.666685 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:45.666685 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:45.666685 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:45.666685 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:45.666685 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:45.666685 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:45.666685 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:38:45.666685 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:38:45.666685 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:38:45.667744 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:38:45.667744 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:45.667744 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:45.667744 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:45.667744 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:45.667744 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:45.667744 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:45.667744 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:45.667744 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:45.667744 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:45.667744 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:45.667744 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:45.667744 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:45.667744 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:45.667744 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:45.667744 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:45.667744 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:45.669019 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:38:45.669019 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:38:45.669019 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:38:45.669019 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:38:45.669019 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:38:45.669019 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:38:45.669019 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:38:45.669019 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:45.669019 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 332/665] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Sep 24 19:38:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:45.669657 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386eaaa3-9bd8-409d-b644-235d1fd053cd None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:45.669741 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c371182-896f-4409-8aef-7cc751c2e674 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:45.686858 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-386eaaa3-9bd8-409d-b644-235d1fd053cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:45.686858 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:45.686858 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:45.686858 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:45.686858 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:45.686858 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:45.686858 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:45.686858 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:45.686858 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:45.686858 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:45.686858 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:45.686858 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:45.686858 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:38:45.686858 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:38:45.686858 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:38:45.686858 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:38:45.688052 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:45.688052 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:45.688052 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:45.688052 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:45.688052 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:45.688052 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:45.688052 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:45.688052 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:45.688052 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:45.688052 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:45.688052 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:45.688052 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:45.688052 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:45.688052 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:45.688052 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:45.688052 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:45.688052 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:38:45.689166 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:38:45.689166 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:45.689166 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:45.694930 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 334/666] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:38:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:45.694930 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386eaaa3-9bd8-409d-b644-235d1fd053cd None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:45.724698 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:45.786232 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:45.807438 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386eaaa3-9bd8-409d-b644-235d1fd053cd None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:45.811276 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c371182-896f-4409-8aef-7cc751c2e674 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:45.842250 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ccdc0b-8a66-42bc-ba0b-e80aabd34e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:45.842780 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ccdc0b-8a66-42bc-ba0b-e80aabd34e26 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:45.843057 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ccdc0b-8a66-42bc-ba0b-e80aabd34e26 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:45.843325 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ccdc0b-8a66-42bc-ba0b-e80aabd34e26 None admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:45.844017 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ccdc0b-8a66-42bc-ba0b-e80aabd34e26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:45.844326 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ccdc0b-8a66-42bc-ba0b-e80aabd34e26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:45.845778 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ccdc0b-8a66-42bc-ba0b-e80aabd34e26 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:45.858261 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 335/667] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Sep 24 19:38:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:45.858730 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad34ae8c-6aec-4211-a718-9dc7176733da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:45.859148 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ccdc0b-8a66-42bc-ba0b-e80aabd34e26 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:45.859353 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad34ae8c-6aec-4211-a718-9dc7176733da None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:45.859632 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad34ae8c-6aec-4211-a718-9dc7176733da None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:45.859894 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad34ae8c-6aec-4211-a718-9dc7176733da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:45.933396 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad34ae8c-6aec-4211-a718-9dc7176733da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:45.934925 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad34ae8c-6aec-4211-a718-9dc7176733da None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:45.952535 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:45.969751 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ccdc0b-8a66-42bc-ba0b-e80aabd34e26 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:46.004953 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507293d1-e466-4a31-8cd5-1f61725a319b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:46.005599 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507293d1-e466-4a31-8cd5-1f61725a319b None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:46.006133 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507293d1-e466-4a31-8cd5-1f61725a319b None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:46.006402 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507293d1-e466-4a31-8cd5-1f61725a319b None admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:46.007040 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507293d1-e466-4a31-8cd5-1f61725a319b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:46.007339 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507293d1-e466-4a31-8cd5-1f61725a319b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:46.008743 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507293d1-e466-4a31-8cd5-1f61725a319b None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:46.015036 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:46.021373 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 336/668] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:38:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:46.022876 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a95d2-afb0-447e-a5bd-b35c1db0a54f None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:46.030882 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a95d2-afb0-447e-a5bd-b35c1db0a54f None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:46.030882 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a95d2-afb0-447e-a5bd-b35c1db0a54f None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:46.030882 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 337/669] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:38:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:38:46.030882 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a95d2-afb0-447e-a5bd-b35c1db0a54f None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:46.048036 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 333/670] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Sep 24 19:38:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:38:46.048241 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad34ae8c-6aec-4211-a718-9dc7176733da None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:46.152452 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a95d2-afb0-447e-a5bd-b35c1db0a54f None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:46.161640 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad34ae8c-6aec-4211-a718-9dc7176733da None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:46.188245 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b717194a-3b70-4db1-ba4f-e72e6f9a3844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:46.188878 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b717194a-3b70-4db1-ba4f-e72e6f9a3844 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:46.189142 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b717194a-3b70-4db1-ba4f-e72e6f9a3844 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:46.189404 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b717194a-3b70-4db1-ba4f-e72e6f9a3844 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:46.199643 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c6527-b3e5-41d6-91e6-d7dcba5ab187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:46.200244 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c6527-b3e5-41d6-91e6-d7dcba5ab187 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:46.200523 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c6527-b3e5-41d6-91e6-d7dcba5ab187 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:46.200790 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c6527-b3e5-41d6-91e6-d7dcba5ab187 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:46.201535 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307c6527-b3e5-41d6-91e6-d7dcba5ab187 None admin] RBAC: Adding query filter params (role.id=e9acf72f841f4030a76e8f9c41c95d7f, scope.project.id=5c2da88af5714e619238772bde676a42, user.id=aaf6ec7f5b4f490aa22a8e3bea91da39) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:46.201845 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307c6527-b3e5-41d6-91e6-d7dcba5ab187 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:46.201958 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b717194a-3b70-4db1-ba4f-e72e6f9a3844 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:38:46.203265 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307c6527-b3e5-41d6-91e6-d7dcba5ab187 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:46.207498 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-b717194a-3b70-4db1-ba4f-e72e6f9a3844 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:38:46.207498 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:46.207498 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:46.207498 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:46.207498 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:46.207498 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:46.207498 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:46.207498 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:46.207498 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:46.207498 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:46.207498 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:46.207498 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:46.207498 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:38:46.207498 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:38:46.207498 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:38:46.207498 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:38:46.208505 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:38:46.208505 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:38:46.208505 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:38:46.208505 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:38:46.208505 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:46.208505 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:46.208505 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:46.208505 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:46.208505 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:46.208505 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:46.208505 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:46.208505 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:46.208505 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:46.208505 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:46.208505 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:46.208505 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:46.209363 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:46.209363 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:46.209363 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:46.209363 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:46.209363 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:38:46.209363 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:38:46.209363 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:38:46.209363 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:38:46.209363 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:38:46.209363 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:38:46.209363 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:38:46.209363 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:46.209363 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 338/671] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Sep 24 19:38:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:46.225567 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b717194a-3b70-4db1-ba4f-e72e6f9a3844 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:46.225702 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 334/672] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Sep 24 19:38:46 2022] GET /identity/v3/role_assignments?user.id=aaf6ec7f5b4f490aa22a8e3bea91da39&scope.project.id=5c2da88af5714e619238772bde676a42&role.id=e9acf72f841f4030a76e8f9c41c95d7f => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:46.225702 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa081e0-f025-4b16-a301-942180783827 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:46.225702 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa081e0-f025-4b16-a301-942180783827 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:46.225702 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa081e0-f025-4b16-a301-942180783827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:46.229742 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:46.231837 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-0aa081e0-f025-4b16-a301-942180783827 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:38:46.233080 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-0aa081e0-f025-4b16-a301-942180783827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:38:46.277522 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:46.317759 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 335/673] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:38:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:38:46.318662 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa081e0-f025-4b16-a301-942180783827 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:46.343714 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b717194a-3b70-4db1-ba4f-e72e6f9a3844 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:46.388108 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0739b444-e173-4ac9-ba25-9a3785f68a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:46.389095 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739b444-e173-4ac9-ba25-9a3785f68a8c None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:46.389577 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739b444-e173-4ac9-ba25-9a3785f68a8c None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:46.390702 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739b444-e173-4ac9-ba25-9a3785f68a8c None admin] PATH_INFO: `/v3/projects/service` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:46.398815 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0739b444-e173-4ac9-ba25-9a3785f68a8c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:46.400659 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0739b444-e173-4ac9-ba25-9a3785f68a8c None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:46.413448 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-0739b444-e173-4ac9-ba25-9a3785f68a8c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:38:46.413448 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:46.413448 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:46.413448 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:46.413448 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:46.413448 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:46.413448 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:46.413448 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:46.413448 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:46.413448 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:46.413448 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:46.413448 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:46.413448 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:38:46.413448 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:38:46.413448 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:38:46.415206 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:38:46.415206 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:46.415206 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:46.415206 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:46.415206 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:46.415206 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:46.415206 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:46.415206 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:46.415206 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:46.415206 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:46.415206 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:46.415206 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:46.415206 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:46.415206 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:46.415206 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:46.415206 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:46.415206 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:46.416887 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:38:46.416887 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:38:46.416887 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:38:46.416887 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:38:46.416887 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:38:46.416887 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:38:46.416887 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:38:46.416887 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:46.417447 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 339/674] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Sep 24 19:38:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:46.418397 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0739b444-e173-4ac9-ba25-9a3785f68a8c None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:46.453444 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa081e0-f025-4b16-a301-942180783827 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:46.507888 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2959a-2189-4d55-8c93-3fb2ee72bae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:46.508526 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2959a-2189-4d55-8c93-3fb2ee72bae5 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:46.508821 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2959a-2189-4d55-8c93-3fb2ee72bae5 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:46.509093 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2959a-2189-4d55-8c93-3fb2ee72bae5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:46.525795 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee2959a-2189-4d55-8c93-3fb2ee72bae5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:46.527365 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:46.527815 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee2959a-2189-4d55-8c93-3fb2ee72bae5 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:46.546931 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-9ee2959a-2189-4d55-8c93-3fb2ee72bae5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:46.546931 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:46.546931 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:46.546931 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:46.546931 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:46.546931 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:46.546931 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:46.546931 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:46.546931 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:46.546931 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:46.546931 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:46.546931 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:46.546931 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:38:46.546931 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:38:46.546931 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:38:46.546931 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:38:46.547976 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:46.547976 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:46.547976 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:46.547976 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:46.547976 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:46.547976 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:46.547976 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:46.547976 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:46.547976 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:46.547976 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:46.547976 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:46.547976 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:46.547976 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:46.547976 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:46.547976 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:46.547976 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:46.547976 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:38:46.549330 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:38:46.549330 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:46.549330 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:46.549330 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 336/675] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:38:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:46.549330 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2959a-2189-4d55-8c93-3fb2ee72bae5 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:46.566532 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0739b444-e173-4ac9-ba25-9a3785f68a8c None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:46.586097 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:46.616428 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b9cba8-65a8-4332-9545-e56d4cf5c47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:46.617232 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9cba8-65a8-4332-9545-e56d4cf5c47a None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:46.617535 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9cba8-65a8-4332-9545-e56d4cf5c47a None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:46.618201 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9cba8-65a8-4332-9545-e56d4cf5c47a None admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:46.618945 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b9cba8-65a8-4332-9545-e56d4cf5c47a None admin] RBAC: Adding query filter params (name=admin) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:46.619223 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b9cba8-65a8-4332-9545-e56d4cf5c47a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:46.620788 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b9cba8-65a8-4332-9545-e56d4cf5c47a None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:46.631462 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 340/676] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Sep 24 19:38:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:46.632317 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b9cba8-65a8-4332-9545-e56d4cf5c47a None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:46.699331 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2959a-2189-4d55-8c93-3fb2ee72bae5 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:46.744142 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08311dc3-0631-4e54-a410-8d4114d93407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:46.744829 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08311dc3-0631-4e54-a410-8d4114d93407 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:46.745108 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08311dc3-0631-4e54-a410-8d4114d93407 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:46.745513 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08311dc3-0631-4e54-a410-8d4114d93407 None admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:46.746258 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08311dc3-0631-4e54-a410-8d4114d93407 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:46.746592 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08311dc3-0631-4e54-a410-8d4114d93407 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:46.748226 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08311dc3-0631-4e54-a410-8d4114d93407 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:46.751248 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b9cba8-65a8-4332-9545-e56d4cf5c47a None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:46.766534 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 337/677] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Sep 24 19:38:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:46.766534 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08311dc3-0631-4e54-a410-8d4114d93407 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:46.791212 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:46.797406 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d6800-69be-4e57-a369-23926ea789b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:46.798058 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d6800-69be-4e57-a369-23926ea789b9 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:46.798350 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d6800-69be-4e57-a369-23926ea789b9 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:46.798652 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d6800-69be-4e57-a369-23926ea789b9 None admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:46.799332 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d6800-69be-4e57-a369-23926ea789b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:46.799636 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d6800-69be-4e57-a369-23926ea789b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:46.802518 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d6800-69be-4e57-a369-23926ea789b9 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:46.817556 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 341/678] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:38:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:46.817556 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d6800-69be-4e57-a369-23926ea789b9 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:46.866095 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:46.887467 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08311dc3-0631-4e54-a410-8d4114d93407 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:46.928690 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab374c5-6a60-455f-8409-042806e1ff23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:46.929388 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab374c5-6a60-455f-8409-042806e1ff23 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:46.929648 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab374c5-6a60-455f-8409-042806e1ff23 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:46.929920 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab374c5-6a60-455f-8409-042806e1ff23 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:46.943130 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab374c5-6a60-455f-8409-042806e1ff23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:38:46.943938 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d6800-69be-4e57-a369-23926ea789b9 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:46.948186 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-2ab374c5-6a60-455f-8409-042806e1ff23 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:38:46.948186 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:46.948186 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:46.948186 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:46.948186 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:46.948186 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:46.948186 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:46.948186 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:46.948186 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:46.948186 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:46.948186 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:46.948186 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:46.948186 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:38:46.948186 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:38:46.948186 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:38:46.948186 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:38:46.954634 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:38:46.954634 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:38:46.954634 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:38:46.954634 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:38:46.954634 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:46.954634 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:46.954634 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:46.954634 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:46.954634 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:46.954634 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:46.954634 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:46.954634 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:46.954634 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:46.954634 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:46.954634 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:46.954634 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:46.955585 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:46.955585 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:46.955585 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:46.955585 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:46.955585 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:38:46.955585 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:38:46.955585 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:38:46.955585 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:38:46.955585 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:38:46.955585 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:38:46.955585 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:38:46.955585 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:46.955585 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 338/679] 10.222.0.60 () {56 vars in 1102 bytes} [Sat Sep 24 19:38:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:46.955585 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab374c5-6a60-455f-8409-042806e1ff23 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:46.983456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be177334-5f19-4d65-89fb-25a2443269d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:46.993183 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be177334-5f19-4d65-89fb-25a2443269d7 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:46.993183 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be177334-5f19-4d65-89fb-25a2443269d7 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:46.993183 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be177334-5f19-4d65-89fb-25a2443269d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:46.996804 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be177334-5f19-4d65-89fb-25a2443269d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:46.998354 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be177334-5f19-4d65-89fb-25a2443269d7 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:47.016837 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-be177334-5f19-4d65-89fb-25a2443269d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:47.016837 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:47.016837 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:47.016837 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:47.016837 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:47.016837 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:47.016837 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:47.016837 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:47.016837 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:47.016837 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:47.016837 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:47.016837 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:47.016837 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:38:47.016837 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:38:47.016837 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:38:47.016837 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:38:47.018269 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:47.018269 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:47.018269 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:47.018269 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:47.018269 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:47.018269 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:47.018269 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:47.018269 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:47.018269 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:47.018269 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:47.018269 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:47.018269 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:47.018269 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:47.018269 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:47.018269 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:47.018269 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:47.018269 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:38:47.020053 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:38:47.020053 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:47.020053 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:47.020053 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 342/680] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:38:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:47.020053 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be177334-5f19-4d65-89fb-25a2443269d7 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:47.069530 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:47.085893 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab374c5-6a60-455f-8409-042806e1ff23 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:47.127133 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07164432-f4ab-45cf-a224-8fed5500b7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:47.127744 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07164432-f4ab-45cf-a224-8fed5500b7bc None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:47.128095 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07164432-f4ab-45cf-a224-8fed5500b7bc None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:47.129080 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07164432-f4ab-45cf-a224-8fed5500b7bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:47.133456 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07164432-f4ab-45cf-a224-8fed5500b7bc None admin] RBAC: Adding query filter params (role.id=e9acf72f841f4030a76e8f9c41c95d7f, scope.project.id=5c2da88af5714e619238772bde676a42, user.id=fed7dee25fd54255ad24cd6ad880fa3f) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:47.133456 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07164432-f4ab-45cf-a224-8fed5500b7bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:47.133456 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07164432-f4ab-45cf-a224-8fed5500b7bc None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:47.138207 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be177334-5f19-4d65-89fb-25a2443269d7 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:47.145884 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 339/681] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Sep 24 19:38:46 2022] GET /identity/v3/role_assignments?user.id=fed7dee25fd54255ad24cd6ad880fa3f&scope.project.id=5c2da88af5714e619238772bde676a42&role.id=e9acf72f841f4030a76e8f9c41c95d7f => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:47.145884 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07164432-f4ab-45cf-a224-8fed5500b7bc None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:47.160180 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:47.195572 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837e8cfe-dffb-475f-92e7-9ad91ece28b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:47.196669 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e8cfe-dffb-475f-92e7-9ad91ece28b6 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:47.197155 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e8cfe-dffb-475f-92e7-9ad91ece28b6 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:47.197728 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e8cfe-dffb-475f-92e7-9ad91ece28b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:47.206159 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837e8cfe-dffb-475f-92e7-9ad91ece28b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:47.207955 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837e8cfe-dffb-475f-92e7-9ad91ece28b6 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:47.222414 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-837e8cfe-dffb-475f-92e7-9ad91ece28b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:38:47.222414 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:47.222414 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:47.222414 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:47.222414 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:47.222414 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:47.222414 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:47.222414 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:47.222414 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:47.222414 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:47.222414 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:47.222414 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:47.222414 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:38:47.222414 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:38:47.222414 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:38:47.223649 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:38:47.223649 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:47.223649 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:47.223649 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:47.223649 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:47.223649 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:47.223649 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:47.223649 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:47.223649 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:47.223649 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:47.223649 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:47.223649 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:47.223649 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:47.223649 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:47.223649 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:47.223649 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:47.223649 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:47.224740 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:38:47.224740 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:38:47.224740 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:38:47.224740 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:38:47.224740 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:38:47.224740 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:38:47.224740 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:38:47.224740 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:47.227287 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 343/682] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Sep 24 19:38:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:47.228297 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837e8cfe-dffb-475f-92e7-9ad91ece28b6 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:47.309194 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07164432-f4ab-45cf-a224-8fed5500b7bc None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:47.348494 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325531e0-8927-4f26-a510-c1cb4c114735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:47.349243 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325531e0-8927-4f26-a510-c1cb4c114735 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:47.349642 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325531e0-8927-4f26-a510-c1cb4c114735 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:47.349988 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325531e0-8927-4f26-a510-c1cb4c114735 None admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:47.350736 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325531e0-8927-4f26-a510-c1cb4c114735 None admin] RBAC: Adding query filter params (name=service) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:47.351105 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325531e0-8927-4f26-a510-c1cb4c114735 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:47.352579 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325531e0-8927-4f26-a510-c1cb4c114735 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:47.361965 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 340/683] 10.222.0.60 () {56 vars in 1103 bytes} [Sat Sep 24 19:38:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:47.363522 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325531e0-8927-4f26-a510-c1cb4c114735 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:47.376858 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837e8cfe-dffb-475f-92e7-9ad91ece28b6 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:47.378985 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:47.429635 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8fd149-3405-40ce-acf4-884b32f50219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:47.430308 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8fd149-3405-40ce-acf4-884b32f50219 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:47.430528 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8fd149-3405-40ce-acf4-884b32f50219 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:47.430806 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8fd149-3405-40ce-acf4-884b32f50219 None admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:47.431557 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8fd149-3405-40ce-acf4-884b32f50219 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:47.431893 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8fd149-3405-40ce-acf4-884b32f50219 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:47.433278 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8fd149-3405-40ce-acf4-884b32f50219 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:47.453443 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 344/684] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:38:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:47.454172 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:47.455113 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8fd149-3405-40ce-acf4-884b32f50219 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:47.501120 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325531e0-8927-4f26-a510-c1cb4c114735 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:47.544744 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f623ce-7634-484a-896e-5051b0ae3d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:47.545367 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f623ce-7634-484a-896e-5051b0ae3d10 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:47.545681 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f623ce-7634-484a-896e-5051b0ae3d10 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:47.545953 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f623ce-7634-484a-896e-5051b0ae3d10 None admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:47.546648 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f623ce-7634-484a-896e-5051b0ae3d10 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:47.546951 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f623ce-7634-484a-896e-5051b0ae3d10 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:47.549148 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f623ce-7634-484a-896e-5051b0ae3d10 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:47.565548 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 341/685] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Sep 24 19:38:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:47.569962 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f623ce-7634-484a-896e-5051b0ae3d10 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:47.618092 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8fd149-3405-40ce-acf4-884b32f50219 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:47.678214 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab98d4-c858-4209-bae8-16e90af76247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:47.678959 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab98d4-c858-4209-bae8-16e90af76247 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:47.679198 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab98d4-c858-4209-bae8-16e90af76247 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:47.679476 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab98d4-c858-4209-bae8-16e90af76247 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:47.694344 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dab98d4-c858-4209-bae8-16e90af76247 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:47.695996 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dab98d4-c858-4209-bae8-16e90af76247 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:47.699826 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f623ce-7634-484a-896e-5051b0ae3d10 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:47.711280 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-4dab98d4-c858-4209-bae8-16e90af76247 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:47.711280 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:47.711280 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:47.711280 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:47.711280 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:47.711280 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:47.711280 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:47.711280 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:47.711280 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:47.711280 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:47.711280 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:47.711280 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:47.711280 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:38:47.711280 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:38:47.711280 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:38:47.711280 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:38:47.712277 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:47.712277 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:47.712277 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:47.712277 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:47.712277 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:47.712277 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:47.712277 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:47.712277 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:47.712277 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:47.712277 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:47.712277 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:47.712277 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:47.712277 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:47.712277 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:47.712277 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:47.712277 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:47.712277 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:38:47.713191 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:38:47.713191 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:47.713191 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:47.713191 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 345/686] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:38:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:47.713436 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab98d4-c858-4209-bae8-16e90af76247 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:47.732673 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:47.744879 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:47.753739 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a081d2-4ec0-4882-aac4-f7cdb6f3cb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:47.754531 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a081d2-4ec0-4882-aac4-f7cdb6f3cb83 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:47.754676 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a081d2-4ec0-4882-aac4-f7cdb6f3cb83 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:47.754902 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a081d2-4ec0-4882-aac4-f7cdb6f3cb83 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:47.768280 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a081d2-4ec0-4882-aac4-f7cdb6f3cb83 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:47.768469 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a081d2-4ec0-4882-aac4-f7cdb6f3cb83 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:47.781825 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-c3a081d2-4ec0-4882-aac4-f7cdb6f3cb83 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 24 19:38:47.781825 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:47.781825 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:47.781825 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:47.781825 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:47.781825 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:47.781825 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:47.781825 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:47.781825 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:47.781825 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:47.781825 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:47.781825 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:47.781825 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:38:47.781825 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:38:47.781825 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:38:47.781825 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:38:47.783030 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:47.783030 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:47.783030 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:38:47.783030 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:38:47.783030 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:38:47.783030 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:38:47.783030 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:47.783030 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:47.783030 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:47.783030 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:47.783030 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:47.783030 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:47.783030 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:47.783030 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:47.783030 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:47.783030 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:47.783030 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:47.783030 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:47.783999 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:47.783999 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:47.783999 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:38:47.783999 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:38:47.783999 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:38:47.783999 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:38:47.783999 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:38:47.783999 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:38:47.783999 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 24 19:38:47.783999 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:47.783999 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 342/687] 10.222.0.60 () {56 vars in 1093 bytes} [Sat Sep 24 19:38:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:47.786417 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a081d2-4ec0-4882-aac4-f7cdb6f3cb83 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:47.836365 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab98d4-c858-4209-bae8-16e90af76247 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:47.872951 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56f7db-7af7-4eab-8001-67e71b7e3603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:47.873619 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56f7db-7af7-4eab-8001-67e71b7e3603 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:47.873901 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56f7db-7af7-4eab-8001-67e71b7e3603 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:47.874172 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56f7db-7af7-4eab-8001-67e71b7e3603 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:47.874904 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd56f7db-7af7-4eab-8001-67e71b7e3603 None admin] RBAC: Adding query filter params (role.id=e9acf72f841f4030a76e8f9c41c95d7f, scope.project.id=5c2da88af5714e619238772bde676a42, user.id=e9057442a6cd4b45acdd588d432d8318) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:47.875214 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd56f7db-7af7-4eab-8001-67e71b7e3603 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:47.876634 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd56f7db-7af7-4eab-8001-67e71b7e3603 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:47.886246 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 346/688] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Sep 24 19:38:47 2022] GET /identity/v3/role_assignments?user.id=e9057442a6cd4b45acdd588d432d8318&scope.project.id=5c2da88af5714e619238772bde676a42&role.id=e9acf72f841f4030a76e8f9c41c95d7f => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:47.887172 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56f7db-7af7-4eab-8001-67e71b7e3603 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:47.964297 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a081d2-4ec0-4882-aac4-f7cdb6f3cb83 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:48.003859 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49317c2-a381-4336-833f-0596dc3f8f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:48.005043 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49317c2-a381-4336-833f-0596dc3f8f59 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:48.005329 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49317c2-a381-4336-833f-0596dc3f8f59 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:48.005943 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49317c2-a381-4336-833f-0596dc3f8f59 None admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:48.007002 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49317c2-a381-4336-833f-0596dc3f8f59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:48.007315 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49317c2-a381-4336-833f-0596dc3f8f59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:48.010048 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49317c2-a381-4336-833f-0596dc3f8f59 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:48.021460 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:48.026446 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 343/689] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:38:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:48.031934 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49317c2-a381-4336-833f-0596dc3f8f59 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:48.071681 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56f7db-7af7-4eab-8001-67e71b7e3603 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:48.137144 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:48.142004 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b1a44-a2ba-477d-88c4-ce065f62052f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:48.142632 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b1a44-a2ba-477d-88c4-ce065f62052f None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:48.142910 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b1a44-a2ba-477d-88c4-ce065f62052f None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:48.143182 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b1a44-a2ba-477d-88c4-ce065f62052f None admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:48.143962 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8b1a44-a2ba-477d-88c4-ce065f62052f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:48.144330 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8b1a44-a2ba-477d-88c4-ce065f62052f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:48.145754 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8b1a44-a2ba-477d-88c4-ce065f62052f None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:48.167208 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 347/690] 10.222.0.60 () {56 vars in 1133 bytes} [Sat Sep 24 19:38:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:48.172641 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b1a44-a2ba-477d-88c4-ce065f62052f None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:48.200176 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49317c2-a381-4336-833f-0596dc3f8f59 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:48.239817 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5076bd91-16d6-4bd2-9b0b-5c2dfcc524e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:48.240388 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076bd91-16d6-4bd2-9b0b-5c2dfcc524e6 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:48.240662 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076bd91-16d6-4bd2-9b0b-5c2dfcc524e6 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:48.240934 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076bd91-16d6-4bd2-9b0b-5c2dfcc524e6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:48.249510 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5076bd91-16d6-4bd2-9b0b-5c2dfcc524e6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:48.250978 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5076bd91-16d6-4bd2-9b0b-5c2dfcc524e6 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:48.264943 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-5076bd91-16d6-4bd2-9b0b-5c2dfcc524e6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 24 19:38:48.264943 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:48.264943 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:48.264943 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:48.264943 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:48.264943 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:48.264943 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:48.264943 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:48.264943 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:48.264943 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:48.264943 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:48.264943 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:48.264943 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:38:48.264943 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:38:48.264943 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:38:48.264943 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:38:48.267281 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:48.267281 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:48.267281 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:38:48.267281 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:38:48.267281 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:38:48.267281 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:38:48.267281 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:48.267281 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:48.267281 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:48.267281 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:48.267281 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:48.267281 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:48.267281 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:48.267281 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:48.267281 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:48.267281 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:48.267281 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:48.267281 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:48.269514 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:48.269514 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:48.269514 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:38:48.269514 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:38:48.269514 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:38:48.269514 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:38:48.269514 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:38:48.269514 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:38:48.269514 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 24 19:38:48.269514 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:48.269514 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 344/691] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Sep 24 19:38:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:38:48.274381 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5076bd91-16d6-4bd2-9b0b-5c2dfcc524e6 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:48.302708 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b1a44-a2ba-477d-88c4-ce065f62052f None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:48.349538 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c90bf5-ca85-41e4-affd-11b88d8aac16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:48.350180 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c90bf5-ca85-41e4-affd-11b88d8aac16 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:48.350463 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c90bf5-ca85-41e4-affd-11b88d8aac16 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:48.350735 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c90bf5-ca85-41e4-affd-11b88d8aac16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:48.355775 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:48.454553 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5076bd91-16d6-4bd2-9b0b-5c2dfcc524e6 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:48.467910 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:48.490463 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c90bf5-ca85-41e4-affd-11b88d8aac16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:48.491928 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c90bf5-ca85-41e4-affd-11b88d8aac16 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:48.547750 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acdf4dd-b163-4f8b-847d-f8ab5f92f772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:48.548533 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acdf4dd-b163-4f8b-847d-f8ab5f92f772 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:48.548654 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acdf4dd-b163-4f8b-847d-f8ab5f92f772 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:48.548901 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acdf4dd-b163-4f8b-847d-f8ab5f92f772 None admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:48.549760 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acdf4dd-b163-4f8b-847d-f8ab5f92f772 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:48.551025 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acdf4dd-b163-4f8b-847d-f8ab5f92f772 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:48.552679 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acdf4dd-b163-4f8b-847d-f8ab5f92f772 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:48.600285 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 345/692] 10.222.0.60 () {56 vars in 1135 bytes} [Sat Sep 24 19:38:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:48.605975 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acdf4dd-b163-4f8b-847d-f8ab5f92f772 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:48.624770 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 348/693] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Sep 24 19:38:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 24 19:38:48.630486 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c90bf5-ca85-41e4-affd-11b88d8aac16 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:48.737921 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:48.771606 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acdf4dd-b163-4f8b-847d-f8ab5f92f772 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:48.774284 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c90bf5-ca85-41e4-affd-11b88d8aac16 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:48.810649 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f402b7a-6cf2-4a62-8b17-ec019b8cb660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:48.811392 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f402b7a-6cf2-4a62-8b17-ec019b8cb660 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:48.811748 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f402b7a-6cf2-4a62-8b17-ec019b8cb660 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:48.812098 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f402b7a-6cf2-4a62-8b17-ec019b8cb660 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:48.813905 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d543a4d-b9d9-4420-9242-0c59301a243e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:48.814739 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d543a4d-b9d9-4420-9242-0c59301a243e None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:48.815374 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d543a4d-b9d9-4420-9242-0c59301a243e None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:48.816298 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d543a4d-b9d9-4420-9242-0c59301a243e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:48.828660 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f402b7a-6cf2-4a62-8b17-ec019b8cb660 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:48.830298 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f402b7a-6cf2-4a62-8b17-ec019b8cb660 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:48.846235 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-9f402b7a-6cf2-4a62-8b17-ec019b8cb660 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:48.846235 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:48.846235 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:48.846235 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:48.846235 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:48.846235 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:48.846235 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:48.846235 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:48.846235 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:48.846235 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:48.846235 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:48.846235 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:48.846235 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:38:48.846235 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:38:48.846235 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:38:48.846235 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:38:48.847456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:48.847456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:48.847456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:48.847456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:48.847456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:48.847456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:48.847456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:48.847456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:48.847456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:48.847456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:48.847456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:48.847456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:48.847456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:48.847456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:48.847456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:48.847456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:48.847456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:38:48.848354 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:38:48.848354 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:48.848354 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:48.852461 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 349/694] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:38:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:38:48.854032 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39553c29-1fb9-4829-a9ff-b6e1b855014d None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:48.854392 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39553c29-1fb9-4829-a9ff-b6e1b855014d None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:48.854746 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39553c29-1fb9-4829-a9ff-b6e1b855014d None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:48.856379 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 350/695] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:38:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:38:48.856912 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:48.857228 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39553c29-1fb9-4829-a9ff-b6e1b855014d None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:48.901036 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d543a4d-b9d9-4420-9242-0c59301a243e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:48.903752 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d543a4d-b9d9-4420-9242-0c59301a243e None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:48.967914 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:48.982753 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39553c29-1fb9-4829-a9ff-b6e1b855014d None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:49.017506 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 346/696] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Sep 24 19:38:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:38:49.019616 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dbd8ad-bf86-4429-89c5-d653f9485f24 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:49.020164 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dbd8ad-bf86-4429-89c5-d653f9485f24 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:49.020519 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dbd8ad-bf86-4429-89c5-d653f9485f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:49.031690 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeb5290-02a7-4181-b1ff-ee560fd77a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:49.032591 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb5290-02a7-4181-b1ff-ee560fd77a89 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:49.032983 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb5290-02a7-4181-b1ff-ee560fd77a89 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:49.033263 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb5290-02a7-4181-b1ff-ee560fd77a89 None admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:49.033975 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeb5290-02a7-4181-b1ff-ee560fd77a89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:49.034342 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeb5290-02a7-4181-b1ff-ee560fd77a89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:49.036264 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeb5290-02a7-4181-b1ff-ee560fd77a89 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:49.045060 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-30dbd8ad-bf86-4429-89c5-d653f9485f24 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:38:49.046390 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-30dbd8ad-bf86-4429-89c5-d653f9485f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:38:49.054148 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 351/697] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:38:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:49.055011 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeb5290-02a7-4181-b1ff-ee560fd77a89 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:49.119463 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:49.130232 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 347/698] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:38:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:38:49.131687 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dbd8ad-bf86-4429-89c5-d653f9485f24 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:49.246857 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dbd8ad-bf86-4429-89c5-d653f9485f24 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:49.267658 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeb5290-02a7-4181-b1ff-ee560fd77a89 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:49.290324 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db2065f-1709-48e8-b31e-e61fec15b6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:49.291334 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2065f-1709-48e8-b31e-e61fec15b6a6 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:49.291791 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2065f-1709-48e8-b31e-e61fec15b6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:49.292391 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2065f-1709-48e8-b31e-e61fec15b6a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:49.301166 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db2065f-1709-48e8-b31e-e61fec15b6a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:49.303154 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db2065f-1709-48e8-b31e-e61fec15b6a6 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:49.317131 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-0db2065f-1709-48e8-b31e-e61fec15b6a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:38:49.317131 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:49.317131 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:49.317131 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:49.317131 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:49.317131 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:49.317131 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:49.317131 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:49.317131 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:49.317131 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:49.317131 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:49.317131 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:49.317131 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:38:49.317131 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:38:49.317131 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:38:49.318125 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:38:49.318125 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:49.318125 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:49.318125 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:49.318125 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:49.318125 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:49.318125 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:49.318125 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:49.318125 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:49.318125 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:49.318125 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:49.318125 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:49.318125 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:49.318125 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:49.318125 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:49.318125 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:49.318125 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:49.319002 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:38:49.319002 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:38:49.319002 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:38:49.319002 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:38:49.319002 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:38:49.319002 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:38:49.319002 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:38:49.319002 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:49.321635 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 348/699] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Sep 24 19:38:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:49.327923 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db2065f-1709-48e8-b31e-e61fec15b6a6 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:49.341639 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0390169a-8e58-42b9-8ab5-e0711ce14faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:49.343151 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390169a-8e58-42b9-8ab5-e0711ce14faa None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:49.343618 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390169a-8e58-42b9-8ab5-e0711ce14faa None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:49.344108 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390169a-8e58-42b9-8ab5-e0711ce14faa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:49.360962 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0390169a-8e58-42b9-8ab5-e0711ce14faa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:49.365481 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0390169a-8e58-42b9-8ab5-e0711ce14faa None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:49.377967 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:49.387617 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-0390169a-8e58-42b9-8ab5-e0711ce14faa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:49.387617 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:49.387617 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:49.387617 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:49.387617 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:49.387617 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:49.387617 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:49.387617 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:49.387617 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:49.387617 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:49.387617 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:49.387617 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:49.387617 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:38:49.387617 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:38:49.387617 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:38:49.387617 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:38:49.426917 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:49.426917 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:49.426917 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:49.426917 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:49.426917 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:49.426917 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:49.426917 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:49.426917 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:49.426917 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:49.426917 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:49.426917 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:49.426917 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:49.426917 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:49.426917 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:49.426917 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:49.426917 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:49.426917 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:38:49.427794 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:38:49.427794 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:49.427794 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:49.427794 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 352/700] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:38:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:49.427794 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0390169a-8e58-42b9-8ab5-e0711ce14faa None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:49.466372 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:49.524202 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db2065f-1709-48e8-b31e-e61fec15b6a6 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:49.548695 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0390169a-8e58-42b9-8ab5-e0711ce14faa None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:49.568359 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7696dc5f-19a5-4be5-a750-94915f451e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:49.569273 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696dc5f-19a5-4be5-a750-94915f451e3b None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:49.569726 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696dc5f-19a5-4be5-a750-94915f451e3b None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:49.570277 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696dc5f-19a5-4be5-a750-94915f451e3b None admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:49.571429 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7696dc5f-19a5-4be5-a750-94915f451e3b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:49.571884 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7696dc5f-19a5-4be5-a750-94915f451e3b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:49.573607 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7696dc5f-19a5-4be5-a750-94915f451e3b None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:49.588788 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 349/701] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Sep 24 19:38:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:49.590035 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7696dc5f-19a5-4be5-a750-94915f451e3b None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:49.590607 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506cd69b-1057-4e5b-967f-8c1ef421ddf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:49.591302 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506cd69b-1057-4e5b-967f-8c1ef421ddf8 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:49.591691 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506cd69b-1057-4e5b-967f-8c1ef421ddf8 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:49.592043 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506cd69b-1057-4e5b-967f-8c1ef421ddf8 None admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:49.592763 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506cd69b-1057-4e5b-967f-8c1ef421ddf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:49.593307 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506cd69b-1057-4e5b-967f-8c1ef421ddf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:49.594869 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506cd69b-1057-4e5b-967f-8c1ef421ddf8 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:49.732506 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 353/702] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:38:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:38:49.733616 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506cd69b-1057-4e5b-967f-8c1ef421ddf8 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:49.734918 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7696dc5f-19a5-4be5-a750-94915f451e3b None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:49.754319 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:49.774136 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62050b3e-3166-4114-9781-76a1b0b2659d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:49.774695 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62050b3e-3166-4114-9781-76a1b0b2659d None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:49.774966 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62050b3e-3166-4114-9781-76a1b0b2659d None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:49.775227 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62050b3e-3166-4114-9781-76a1b0b2659d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:49.785206 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62050b3e-3166-4114-9781-76a1b0b2659d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:49.786669 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62050b3e-3166-4114-9781-76a1b0b2659d None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:49.799998 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:49.802871 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-62050b3e-3166-4114-9781-76a1b0b2659d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:49.802871 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:49.802871 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:49.802871 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:49.802871 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:49.802871 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:49.802871 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:49.802871 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:49.802871 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:49.802871 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:49.802871 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:49.802871 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:49.802871 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:38:49.802871 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:38:49.802871 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:38:49.802871 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:38:49.803838 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:49.803838 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:49.803838 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:49.803838 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:49.803838 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:49.803838 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:49.803838 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:49.803838 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:49.803838 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:49.803838 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:49.803838 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:49.803838 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:49.803838 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:49.803838 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:49.803838 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:49.803838 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:49.803838 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:38:49.804763 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:38:49.804763 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:49.804763 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:49.812200 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 350/703] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:38:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:49.813310 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62050b3e-3166-4114-9781-76a1b0b2659d None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:49.855128 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506cd69b-1057-4e5b-967f-8c1ef421ddf8 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:49.902447 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b524ac4-9cff-4b33-aa10-7f9f4f8330e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:49.903060 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b524ac4-9cff-4b33-aa10-7f9f4f8330e3 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:49.903332 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b524ac4-9cff-4b33-aa10-7f9f4f8330e3 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:49.903595 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b524ac4-9cff-4b33-aa10-7f9f4f8330e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:49.904313 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b524ac4-9cff-4b33-aa10-7f9f4f8330e3 None admin] RBAC: Adding query filter params (role.id=f022705fa6ce43828345ef50b3f7efc9, scope.project.id=5c2da88af5714e619238772bde676a42, user.id=f3b5047a59bc4547be643ffa78808a6d) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:49.904988 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b524ac4-9cff-4b33-aa10-7f9f4f8330e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:49.906100 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b524ac4-9cff-4b33-aa10-7f9f4f8330e3 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:49.912359 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 354/704] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Sep 24 19:38:49 2022] GET /identity/v3/role_assignments?user.id=f3b5047a59bc4547be643ffa78808a6d&scope.project.id=5c2da88af5714e619238772bde676a42&role.id=f022705fa6ce43828345ef50b3f7efc9 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:49.913471 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf87827-4e9b-4294-a34c-1a94a08b858f None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:49.913783 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf87827-4e9b-4294-a34c-1a94a08b858f None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:49.914050 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf87827-4e9b-4294-a34c-1a94a08b858f None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:49.915413 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 355/705] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:38:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:38:49.916001 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf87827-4e9b-4294-a34c-1a94a08b858f None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:49.952009 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62050b3e-3166-4114-9781-76a1b0b2659d None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:50.000524 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0eec6f-1487-481d-a197-0ab18a5ee565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:50.001662 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0eec6f-1487-481d-a197-0ab18a5ee565 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:50.002463 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0eec6f-1487-481d-a197-0ab18a5ee565 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:50.004684 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0eec6f-1487-481d-a197-0ab18a5ee565 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:50.014160 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0eec6f-1487-481d-a197-0ab18a5ee565 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:50.017192 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0eec6f-1487-481d-a197-0ab18a5ee565 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:50.033916 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-9c0eec6f-1487-481d-a197-0ab18a5ee565 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:38:50.033916 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:50.033916 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:50.033916 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:50.033916 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:50.033916 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:50.033916 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:50.033916 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:50.033916 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:50.033916 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:50.033916 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:50.033916 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:50.033916 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:38:50.033916 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:38:50.033916 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:38:50.035637 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:38:50.035637 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:50.035637 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:50.035637 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:50.035637 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:50.035637 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:50.035637 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:50.035637 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:50.035637 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:50.035637 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:50.035637 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:50.035637 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:50.035637 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:50.035637 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:50.035637 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:50.035637 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:50.035637 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:50.036556 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:38:50.036556 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:38:50.036556 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:38:50.036556 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:38:50.036556 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:38:50.036556 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:38:50.036556 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:38:50.036556 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:50.045626 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 351/706] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Sep 24 19:38:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:50.045626 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d5170d-0811-4bcd-9484-5cc8a0108a02 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:50.045626 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d5170d-0811-4bcd-9484-5cc8a0108a02 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:50.045626 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d5170d-0811-4bcd-9484-5cc8a0108a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:50.049618 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf87827-4e9b-4294-a34c-1a94a08b858f None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:50.071474 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-18d5170d-0811-4bcd-9484-5cc8a0108a02 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:38:50.073275 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-18d5170d-0811-4bcd-9484-5cc8a0108a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:38:50.079720 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:50.092402 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa93a39e-d981-470f-bb43-e5f752ccecae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:50.093114 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa93a39e-d981-470f-bb43-e5f752ccecae None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:50.093400 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa93a39e-d981-470f-bb43-e5f752ccecae None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:50.093711 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa93a39e-d981-470f-bb43-e5f752ccecae None admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:50.095003 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa93a39e-d981-470f-bb43-e5f752ccecae None admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:50.095003 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa93a39e-d981-470f-bb43-e5f752ccecae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:50.096351 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa93a39e-d981-470f-bb43-e5f752ccecae None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:50.106899 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:50.116208 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 356/707] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:38:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:50.117212 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa93a39e-d981-470f-bb43-e5f752ccecae None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:50.173745 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 352/708] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:38:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:38:50.174901 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d5170d-0811-4bcd-9484-5cc8a0108a02 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:50.227278 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa93a39e-d981-470f-bb43-e5f752ccecae None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:50.276542 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6715911c-dbf8-43bd-ad02-54721116662c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:50.277528 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715911c-dbf8-43bd-ad02-54721116662c None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:50.278581 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715911c-dbf8-43bd-ad02-54721116662c None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:50.278858 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715911c-dbf8-43bd-ad02-54721116662c None admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:50.279575 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6715911c-dbf8-43bd-ad02-54721116662c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:50.279884 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6715911c-dbf8-43bd-ad02-54721116662c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:50.281343 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6715911c-dbf8-43bd-ad02-54721116662c None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:50.309229 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 357/709] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Sep 24 19:38:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:50.317589 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6715911c-dbf8-43bd-ad02-54721116662c None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:50.395156 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d5170d-0811-4bcd-9484-5cc8a0108a02 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:50.401880 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:50.439913 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc8af9-e05f-436d-a4d5-d066f0945d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:50.441147 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc8af9-e05f-436d-a4d5-d066f0945d00 None admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:50.441282 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc8af9-e05f-436d-a4d5-d066f0945d00 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:50.441787 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc8af9-e05f-436d-a4d5-d066f0945d00 None admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:50.442920 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc8af9-e05f-436d-a4d5-d066f0945d00 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:50.445325 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc8af9-e05f-436d-a4d5-d066f0945d00 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:50.508052 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6715911c-dbf8-43bd-ad02-54721116662c None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:50.555289 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef2b797-1e8a-432c-b010-f54106b5b3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:50.560800 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 353/710] 10.222.0.60 () {60 vars in 1132 bytes} [Sat Sep 24 19:38:50 2022] POST /identity/v3/users => generated 254 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:38:50.561674 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc8af9-e05f-436d-a4d5-d066f0945d00 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:50.562189 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2b797-1e8a-432c-b010-f54106b5b3a6 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:50.562529 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2b797-1e8a-432c-b010-f54106b5b3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:50.562800 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2b797-1e8a-432c-b010-f54106b5b3a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:50.563579 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef2b797-1e8a-432c-b010-f54106b5b3a6 None admin] RBAC: Adding query filter params (role.id=e9acf72f841f4030a76e8f9c41c95d7f, scope.project.id=5c2da88af5714e619238772bde676a42, user.id=ebd94cd16acc45e6ac2997204297fb75) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:50.563886 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef2b797-1e8a-432c-b010-f54106b5b3a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:50.568177 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef2b797-1e8a-432c-b010-f54106b5b3a6 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:50.581904 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 358/711] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Sep 24 19:38:50 2022] GET /identity/v3/role_assignments?user.id=ebd94cd16acc45e6ac2997204297fb75&scope.project.id=5c2da88af5714e619238772bde676a42&role.id=e9acf72f841f4030a76e8f9c41c95d7f => generated 608 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:50.589434 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:50.667273 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da624a29-2f6a-446d-9b73-2c13598ddf43 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:50.667921 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da624a29-2f6a-446d-9b73-2c13598ddf43 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:50.668343 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da624a29-2f6a-446d-9b73-2c13598ddf43 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:50.670120 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 359/712] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:38:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:38:50.683318 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7773c-9593-455d-b5a3-4a2f5b3b04bd None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:50.683607 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7773c-9593-455d-b5a3-4a2f5b3b04bd None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:50.684031 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7773c-9593-455d-b5a3-4a2f5b3b04bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:50.719629 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc8af9-e05f-436d-a4d5-d066f0945d00 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:50.721091 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-53c7773c-9593-455d-b5a3-4a2f5b3b04bd None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:38:50.722626 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-53c7773c-9593-455d-b5a3-4a2f5b3b04bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:38:50.794914 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7067c441-7cc7-4058-a665-a8ba4059d075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:50.797233 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067c441-7cc7-4058-a665-a8ba4059d075 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:50.798115 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067c441-7cc7-4058-a665-a8ba4059d075 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:50.799203 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067c441-7cc7-4058-a665-a8ba4059d075 None admin] PATH_INFO: `/v3/services/network` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:50.803349 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7067c441-7cc7-4058-a665-a8ba4059d075 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:50.805191 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7067c441-7cc7-4058-a665-a8ba4059d075 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:50.830005 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-7067c441-7cc7-4058-a665-a8ba4059d075 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 24 19:38:50.830005 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:50.830005 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:38:50.830005 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:38:50.830005 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:38:50.830005 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:38:50.830005 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:38:50.830005 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:38:50.830005 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 24 19:38:50.830005 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:50.830005 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:38:50.830005 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:50.830005 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:50.830005 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:50.830005 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:50.830005 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:50.830005 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:50.831529 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:50.831529 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:50.831529 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:50.831529 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:50.831529 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:50.831529 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:50.831529 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:38:50.831529 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:38:50.831529 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:38:50.831529 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:38:50.831529 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:50.831529 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:50.831529 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:50.831529 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:50.831529 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:50.831529 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:50.832526 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:50.832526 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:50.832526 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:50.832526 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:50.832526 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:50.832526 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:50.832526 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:50.832526 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:50.832526 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:50.832526 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:50.832526 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:38:50.832526 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:38:50.832526 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 24 19:38:50.832526 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:50.836154 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 354/713] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Sep 24 19:38:50 2022] GET /identity/v3/services/network => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:50.843325 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7067c441-7cc7-4058-a665-a8ba4059d075 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:50.866872 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 360/714] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:38:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:38:50.954823 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:50.973277 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7067c441-7cc7-4058-a665-a8ba4059d075 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:51.012656 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a2ca9-ff7d-4106-9ba7-06f155990dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:51.013274 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a2ca9-ff7d-4106-9ba7-06f155990dd5 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:51.013674 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a2ca9-ff7d-4106-9ba7-06f155990dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:51.013949 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a2ca9-ff7d-4106-9ba7-06f155990dd5 None admin] PATH_INFO: `/v3/services` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:51.014586 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3a2ca9-ff7d-4106-9ba7-06f155990dd5 None admin] RBAC: Adding query filter params (name=network) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:51.014886 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3a2ca9-ff7d-4106-9ba7-06f155990dd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:51.016369 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3a2ca9-ff7d-4106-9ba7-06f155990dd5 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:51.023982 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 355/715] 10.222.0.60 () {56 vars in 1112 bytes} [Sat Sep 24 19:38:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:51.029859 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c7773c-9593-455d-b5a3-4a2f5b3b04bd None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:51.083141 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:51.166909 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c7773c-9593-455d-b5a3-4a2f5b3b04bd None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:51.206527 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a2ca9-ff7d-4106-9ba7-06f155990dd5 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:51.232290 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62167315-b188-4f36-82bf-861e0eafd2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:51.233293 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62167315-b188-4f36-82bf-861e0eafd2e4 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:51.233792 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62167315-b188-4f36-82bf-861e0eafd2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:51.234338 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62167315-b188-4f36-82bf-861e0eafd2e4 None admin] PATH_INFO: `/v3/services` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:51.235169 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62167315-b188-4f36-82bf-861e0eafd2e4 None admin] RBAC: Adding query filter params (type=network) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:51.235648 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62167315-b188-4f36-82bf-861e0eafd2e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:51.237863 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62167315-b188-4f36-82bf-861e0eafd2e4 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:51.251862 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 361/716] 10.222.0.60 () {56 vars in 1112 bytes} [Sat Sep 24 19:38:51 2022] GET /identity/v3/services?type=network => generated 124 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:51.335246 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a2ca9-ff7d-4106-9ba7-06f155990dd5 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:51.382426 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e811d83-5222-4172-98d5-e1e81cc05054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:51.383101 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e811d83-5222-4172-98d5-e1e81cc05054 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:51.383382 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e811d83-5222-4172-98d5-e1e81cc05054 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:51.383652 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e811d83-5222-4172-98d5-e1e81cc05054 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:51.384248 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e811d83-5222-4172-98d5-e1e81cc05054 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:51.385690 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e811d83-5222-4172-98d5-e1e81cc05054 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:51.396289 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-3e811d83-5222-4172-98d5-e1e81cc05054 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 24 19:38:51.396289 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:51.396289 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:38:51.396289 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:38:51.396289 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:38:51.396289 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:38:51.396289 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:38:51.396289 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:38:51.396289 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 24 19:38:51.396289 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:51.396289 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:38:51.396289 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:51.396289 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:51.396289 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:51.396289 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:51.396289 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:51.396289 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:51.397835 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:51.397835 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:51.397835 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:51.397835 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:51.397835 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:51.397835 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:51.397835 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:38:51.397835 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:38:51.397835 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:38:51.397835 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:38:51.397835 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:51.397835 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:51.397835 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:51.397835 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:51.397835 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:51.397835 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:51.398651 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:51.398651 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:51.398651 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:51.398651 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:51.398651 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:51.398651 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:51.398651 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:51.398651 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:51.398651 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:51.398651 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:51.398651 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:38:51.398651 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:38:51.398651 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 24 19:38:51.398651 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:51.398651 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 356/717] 10.222.0.60 () {56 vars in 1129 bytes} [Sat Sep 24 19:38:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:51.405546 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62167315-b188-4f36-82bf-861e0eafd2e4 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:51.562503 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62167315-b188-4f36-82bf-861e0eafd2e4 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:51.564102 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:51.606814 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec94ef5-7c5d-428e-bd8c-88caad82aa4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:51.607599 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec94ef5-7c5d-428e-bd8c-88caad82aa4e None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:51.607878 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec94ef5-7c5d-428e-bd8c-88caad82aa4e None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:51.608150 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec94ef5-7c5d-428e-bd8c-88caad82aa4e None admin] PATH_INFO: `/v3/services` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:51.608852 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec94ef5-7c5d-428e-bd8c-88caad82aa4e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:51.609157 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec94ef5-7c5d-428e-bd8c-88caad82aa4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:51.610566 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec94ef5-7c5d-428e-bd8c-88caad82aa4e None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:51.617446 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 362/718] 10.222.0.60 () {56 vars in 1124 bytes} [Sat Sep 24 19:38:51 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:51.623365 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e811d83-5222-4172-98d5-e1e81cc05054 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:51.636186 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:51.764346 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e811d83-5222-4172-98d5-e1e81cc05054 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:51.801777 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a540d1-a966-41e3-879c-9f32f87376a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:51.802397 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a540d1-a966-41e3-879c-9f32f87376a8 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:51.802673 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a540d1-a966-41e3-879c-9f32f87376a8 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:51.802941 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a540d1-a966-41e3-879c-9f32f87376a8 None admin] PATH_INFO: `/v3/services` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:51.803576 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a540d1-a966-41e3-879c-9f32f87376a8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:51.803876 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a540d1-a966-41e3-879c-9f32f87376a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:51.805326 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a540d1-a966-41e3-879c-9f32f87376a8 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:51.811979 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 357/719] 10.222.0.60 () {56 vars in 1124 bytes} [Sat Sep 24 19:38:51 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:52.400036 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33443c6-a467-426d-a564-c77c1bb45ecb None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:52.400450 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33443c6-a467-426d-a564-c77c1bb45ecb None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:52.400575 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33443c6-a467-426d-a564-c77c1bb45ecb None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:52.402272 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 363/720] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:38:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:38:52.407434 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f854e-06c0-4a80-a16e-b2e940cb031f None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:52.407913 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f854e-06c0-4a80-a16e-b2e940cb031f None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:52.408009 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f854e-06c0-4a80-a16e-b2e940cb031f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:52.434587 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-807f854e-06c0-4a80-a16e-b2e940cb031f None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:38:52.435806 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-807f854e-06c0-4a80-a16e-b2e940cb031f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:38:52.521135 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:52.532291 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 358/721] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:38:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:38:52.888871 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33443c6-a467-426d-a564-c77c1bb45ecb None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:53.032297 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33443c6-a467-426d-a564-c77c1bb45ecb None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:53.077954 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49bad9a-a5f0-4843-b079-7e8168595554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:53.078590 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49bad9a-a5f0-4843-b079-7e8168595554 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:53.078864 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49bad9a-a5f0-4843-b079-7e8168595554 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:53.079133 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49bad9a-a5f0-4843-b079-7e8168595554 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:53.094292 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49bad9a-a5f0-4843-b079-7e8168595554 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:38:53.099666 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-b49bad9a-a5f0-4843-b079-7e8168595554 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:38:53.099666 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:53.099666 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:53.099666 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:53.099666 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:53.099666 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:53.099666 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:53.099666 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:53.099666 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:53.099666 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:53.099666 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:53.099666 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:53.099666 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:38:53.099666 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:38:53.099666 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:38:53.099666 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:38:53.100632 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:38:53.100632 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:38:53.100632 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:38:53.100632 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:38:53.100632 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:53.100632 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:53.100632 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:53.100632 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:53.100632 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:53.100632 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:53.100632 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:53.100632 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:53.100632 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:53.100632 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:53.100632 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:53.100632 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:53.101462 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:53.101462 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:53.101462 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:53.101462 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:53.101462 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:38:53.101462 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:38:53.101462 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:38:53.101462 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:38:53.101462 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:38:53.101462 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:38:53.101462 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:38:53.101462 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:53.101462 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 364/722] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Sep 24 19:38:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:53.107046 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f854e-06c0-4a80-a16e-b2e940cb031f None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:53.288387 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f854e-06c0-4a80-a16e-b2e940cb031f None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:53.341145 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a735389f-97ab-4434-9e2a-e7356f18baf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:53.341810 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735389f-97ab-4434-9e2a-e7356f18baf1 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:53.342088 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735389f-97ab-4434-9e2a-e7356f18baf1 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:53.342358 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735389f-97ab-4434-9e2a-e7356f18baf1 None admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:53.343034 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a735389f-97ab-4434-9e2a-e7356f18baf1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:53.343332 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a735389f-97ab-4434-9e2a-e7356f18baf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:53.344716 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a735389f-97ab-4434-9e2a-e7356f18baf1 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:53.354986 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 359/723] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Sep 24 19:38:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:53.360113 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49bad9a-a5f0-4843-b079-7e8168595554 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:53.418071 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:53.519357 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49bad9a-a5f0-4843-b079-7e8168595554 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:53.563510 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7620698a-18c1-41ee-a68e-d6e278812e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:53.564056 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620698a-18c1-41ee-a68e-d6e278812e39 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:53.564338 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620698a-18c1-41ee-a68e-d6e278812e39 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:53.564593 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620698a-18c1-41ee-a68e-d6e278812e39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:53.580527 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7620698a-18c1-41ee-a68e-d6e278812e39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:53.581311 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18779692-6068-4168-bd41-1ac11445fa57 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:53.582300 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7620698a-18c1-41ee-a68e-d6e278812e39 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:53.582861 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18779692-6068-4168-bd41-1ac11445fa57 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:53.583686 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18779692-6068-4168-bd41-1ac11445fa57 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:53.586671 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 360/724] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:38:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:38:53.595403 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae6f8b-dd76-4b9b-9347-e3d9811a602d None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:53.596063 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae6f8b-dd76-4b9b-9347-e3d9811a602d None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:53.597060 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae6f8b-dd76-4b9b-9347-e3d9811a602d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:53.611950 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-7620698a-18c1-41ee-a68e-d6e278812e39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:53.611950 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:53.611950 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:53.611950 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:53.611950 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:53.611950 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:53.611950 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:53.611950 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:53.611950 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:53.611950 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:53.611950 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:53.611950 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:53.611950 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:38:53.611950 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:38:53.611950 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:38:53.611950 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:38:53.613549 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:53.613549 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:53.613549 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:53.613549 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:53.613549 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:53.613549 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:53.613549 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:53.613549 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:53.613549 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:53.613549 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:53.613549 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:53.613549 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:53.613549 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:53.613549 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:53.613549 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:53.613549 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:53.613549 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:38:53.614470 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:38:53.614470 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:53.614470 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:53.614470 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 365/725] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:38:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:53.616552 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7620698a-18c1-41ee-a68e-d6e278812e39 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:53.622302 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-84ae6f8b-dd76-4b9b-9347-e3d9811a602d None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:38:53.623558 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-84ae6f8b-dd76-4b9b-9347-e3d9811a602d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:38:53.736899 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:53.775546 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:53.780658 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7620698a-18c1-41ee-a68e-d6e278812e39 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:53.795862 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 361/726] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:38:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 19:38:53.797425 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3697a-4ba7-4adb-909d-cf022f1bcc50 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:53.797744 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3697a-4ba7-4adb-909d-cf022f1bcc50 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:53.798017 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3697a-4ba7-4adb-909d-cf022f1bcc50 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:53.803788 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 362/727] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:38:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:38:53.806704 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829024aa-f3ed-4ddf-816f-08d197eb288e None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:53.806993 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829024aa-f3ed-4ddf-816f-08d197eb288e None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:53.807266 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829024aa-f3ed-4ddf-816f-08d197eb288e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:53.823112 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1016050-eefc-41f3-8297-083db47b9591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:53.823651 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1016050-eefc-41f3-8297-083db47b9591 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:53.823931 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1016050-eefc-41f3-8297-083db47b9591 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:53.824363 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1016050-eefc-41f3-8297-083db47b9591 None admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:53.825153 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1016050-eefc-41f3-8297-083db47b9591 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:53.825461 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1016050-eefc-41f3-8297-083db47b9591 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:53.826884 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1016050-eefc-41f3-8297-083db47b9591 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:53.829072 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-829024aa-f3ed-4ddf-816f-08d197eb288e None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:38:53.831579 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-829024aa-f3ed-4ddf-816f-08d197eb288e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:38:53.844471 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 366/728] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:38:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:38:53.851205 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1016050-eefc-41f3-8297-083db47b9591 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:53.955159 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 363/729] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:38:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:38:54.017689 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1016050-eefc-41f3-8297-083db47b9591 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:54.054594 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a42dcd-5c83-47ef-9799-143360c09e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:54.055368 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a42dcd-5c83-47ef-9799-143360c09e11 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:54.055649 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a42dcd-5c83-47ef-9799-143360c09e11 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:54.055922 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a42dcd-5c83-47ef-9799-143360c09e11 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:54.063735 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a42dcd-5c83-47ef-9799-143360c09e11 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:54.065232 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a42dcd-5c83-47ef-9799-143360c09e11 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:54.067319 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:54.080999 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-f8a42dcd-5c83-47ef-9799-143360c09e11 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 24 19:38:54.080999 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:54.080999 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:54.080999 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:54.080999 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:54.080999 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:54.080999 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:54.080999 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:54.080999 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:54.080999 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:54.080999 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:54.080999 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:54.080999 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:38:54.080999 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:38:54.080999 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:38:54.080999 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:38:54.082076 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:54.082076 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:54.082076 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:38:54.082076 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:38:54.082076 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:38:54.082076 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:38:54.082076 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:54.082076 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:54.082076 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:54.082076 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:54.082076 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:54.082076 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:54.082076 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:54.082076 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:54.082076 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:54.082076 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:54.082076 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:54.082076 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:54.083036 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:54.083036 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:54.083036 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:38:54.083036 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:38:54.083036 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:38:54.083036 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:38:54.083036 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:38:54.083036 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:38:54.083036 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 24 19:38:54.083036 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:54.083036 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 367/730] 10.222.0.60 () {56 vars in 1093 bytes} [Sat Sep 24 19:38:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:54.093415 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829024aa-f3ed-4ddf-816f-08d197eb288e None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:54.124985 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a42dcd-5c83-47ef-9799-143360c09e11 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:54.264514 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829024aa-f3ed-4ddf-816f-08d197eb288e None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:54.292341 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a42dcd-5c83-47ef-9799-143360c09e11 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:54.309821 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:54.334263 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da54f62a-1e3d-4db0-8c7f-3377b62a1c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:54.335805 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54f62a-1e3d-4db0-8c7f-3377b62a1c1c None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:54.336627 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd568a82-7e00-4edd-9fce-41a18c2c4b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:54.337523 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd568a82-7e00-4edd-9fce-41a18c2c4b5a None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:54.338018 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54f62a-1e3d-4db0-8c7f-3377b62a1c1c None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:54.338498 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54f62a-1e3d-4db0-8c7f-3377b62a1c1c None admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:54.339433 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da54f62a-1e3d-4db0-8c7f-3377b62a1c1c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:54.339902 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd568a82-7e00-4edd-9fce-41a18c2c4b5a None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:54.340368 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd568a82-7e00-4edd-9fce-41a18c2c4b5a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:54.341368 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da54f62a-1e3d-4db0-8c7f-3377b62a1c1c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:54.343059 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da54f62a-1e3d-4db0-8c7f-3377b62a1c1c None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:54.364404 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd568a82-7e00-4edd-9fce-41a18c2c4b5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:38:54.370317 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-dd568a82-7e00-4edd-9fce-41a18c2c4b5a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:38:54.370317 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:54.370317 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:54.370317 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:54.370317 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:54.370317 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:54.370317 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:54.370317 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:54.370317 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:54.370317 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:54.370317 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:54.370317 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:54.370317 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:38:54.370317 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:38:54.370317 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:38:54.370317 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:38:54.371719 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:38:54.371719 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:38:54.371719 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:38:54.371719 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:38:54.371719 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:54.371719 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:54.371719 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:54.371719 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:54.371719 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:54.371719 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:54.371719 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:54.371719 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:54.371719 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:54.371719 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:54.371719 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:54.371719 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:54.372722 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:54.372722 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:54.372722 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:54.372722 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:54.372722 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:38:54.372722 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:38:54.372722 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:38:54.372722 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:38:54.372722 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:38:54.372722 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:38:54.372722 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:38:54.372722 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:54.373585 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 368/731] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Sep 24 19:38:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:54.374571 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd568a82-7e00-4edd-9fce-41a18c2c4b5a None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:54.377273 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 364/732] 10.222.0.60 () {56 vars in 1133 bytes} [Sat Sep 24 19:38:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:54.380704 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf005e5-b5e9-4cae-acaf-b66cd7bd5ba8 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:54.381206 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf005e5-b5e9-4cae-acaf-b66cd7bd5ba8 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:54.381652 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf005e5-b5e9-4cae-acaf-b66cd7bd5ba8 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:54.383143 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 365/733] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:38:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:38:54.384053 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf005e5-b5e9-4cae-acaf-b66cd7bd5ba8 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:54.454585 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:54.505630 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd568a82-7e00-4edd-9fce-41a18c2c4b5a None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:54.528271 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf005e5-b5e9-4cae-acaf-b66cd7bd5ba8 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:54.547105 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c70a23-1878-49df-bc8e-9b3db8179a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:54.547764 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c70a23-1878-49df-bc8e-9b3db8179a1e None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:54.548163 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c70a23-1878-49df-bc8e-9b3db8179a1e None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:54.548298 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c70a23-1878-49df-bc8e-9b3db8179a1e None admin] PATH_INFO: `/v3/roles/service` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:54.560568 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c70a23-1878-49df-bc8e-9b3db8179a1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:38:54.566701 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-46c70a23-1878-49df-bc8e-9b3db8179a1e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:38:54.566701 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:54.566701 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:54.566701 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:54.566701 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:54.566701 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:54.566701 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:54.566701 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:54.566701 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:54.566701 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:54.566701 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:54.566701 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:54.566701 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:38:54.566701 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:38:54.566701 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:38:54.566701 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:38:54.567684 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:38:54.567684 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:38:54.567684 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:38:54.567684 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:38:54.567684 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:54.567684 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:54.567684 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:54.567684 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:54.567684 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:54.567684 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:54.567684 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:54.567684 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:54.567684 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:54.567684 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:54.567684 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:54.567684 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:54.569140 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:54.569140 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:54.569140 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:54.569140 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:54.569140 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:38:54.569140 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:38:54.569140 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:38:54.569140 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:38:54.569140 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:38:54.569140 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:38:54.569140 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:38:54.569140 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:54.569140 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 369/734] 10.222.0.60 () {56 vars in 1102 bytes} [Sat Sep 24 19:38:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:54.569140 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c70a23-1878-49df-bc8e-9b3db8179a1e None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:54.571621 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6348bf72-0e54-44f8-8f7e-f26fbfd15706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:54.572236 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348bf72-0e54-44f8-8f7e-f26fbfd15706 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:54.572769 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348bf72-0e54-44f8-8f7e-f26fbfd15706 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:54.572769 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348bf72-0e54-44f8-8f7e-f26fbfd15706 None admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:54.573439 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6348bf72-0e54-44f8-8f7e-f26fbfd15706 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:54.573783 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6348bf72-0e54-44f8-8f7e-f26fbfd15706 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:54.575769 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6348bf72-0e54-44f8-8f7e-f26fbfd15706 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:54.592047 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 366/735] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Sep 24 19:38:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:54.592047 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bcbb5-b563-43ce-89e6-9cc93841e7c5 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:54.592047 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bcbb5-b563-43ce-89e6-9cc93841e7c5 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:54.592047 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bcbb5-b563-43ce-89e6-9cc93841e7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:54.612078 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-340bcbb5-b563-43ce-89e6-9cc93841e7c5 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:38:54.614166 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-340bcbb5-b563-43ce-89e6-9cc93841e7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:38:54.656336 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:54.694330 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 367/736] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:38:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:38:54.698474 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340bcbb5-b563-43ce-89e6-9cc93841e7c5 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:54.710119 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c70a23-1878-49df-bc8e-9b3db8179a1e None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:54.734907 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:54.754809 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265bf7cf-9d13-45ee-9835-2d823e24230f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:54.755708 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265bf7cf-9d13-45ee-9835-2d823e24230f None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:54.755989 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265bf7cf-9d13-45ee-9835-2d823e24230f None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:54.756267 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265bf7cf-9d13-45ee-9835-2d823e24230f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:54.768112 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265bf7cf-9d13-45ee-9835-2d823e24230f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:54.770283 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265bf7cf-9d13-45ee-9835-2d823e24230f None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:54.788102 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-265bf7cf-9d13-45ee-9835-2d823e24230f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:54.788102 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:54.788102 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:54.788102 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:54.788102 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:54.788102 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:54.788102 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:54.788102 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:54.788102 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:54.788102 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:54.788102 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:54.788102 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:54.788102 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:38:54.788102 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:38:54.788102 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:38:54.788102 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:38:54.789135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:54.789135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:54.789135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:54.789135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:54.789135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:54.789135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:54.789135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:54.789135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:54.789135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:54.789135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:54.789135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:54.789135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:54.789135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:54.789135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:54.789135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:54.789135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:54.789135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:38:54.790072 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:38:54.790072 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:54.790072 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:54.790072 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 370/737] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:38:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:54.790315 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265bf7cf-9d13-45ee-9835-2d823e24230f None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:54.829444 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340bcbb5-b563-43ce-89e6-9cc93841e7c5 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:54.867212 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2facec00-681c-47b6-b26e-c17e38756f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:54.867862 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facec00-681c-47b6-b26e-c17e38756f3c None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:54.868140 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facec00-681c-47b6-b26e-c17e38756f3c None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:54.868412 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facec00-681c-47b6-b26e-c17e38756f3c None admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:54.869075 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2facec00-681c-47b6-b26e-c17e38756f3c None admin] RBAC: Adding query filter params (name=service) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:54.869382 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2facec00-681c-47b6-b26e-c17e38756f3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:54.870846 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2facec00-681c-47b6-b26e-c17e38756f3c None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:54.881554 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 368/738] 10.222.0.60 () {56 vars in 1103 bytes} [Sat Sep 24 19:38:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:54.882835 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4c877-73e8-45ad-bbad-9a39503ee281 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:54.883120 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4c877-73e8-45ad-bbad-9a39503ee281 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:54.883515 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4c877-73e8-45ad-bbad-9a39503ee281 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:54.888709 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 369/739] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:38:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:38:54.888709 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4c877-73e8-45ad-bbad-9a39503ee281 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:54.913027 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265bf7cf-9d13-45ee-9835-2d823e24230f None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:54.930042 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:54.951116 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d58389-905f-4436-82c7-e47526a9e71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:54.951753 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d58389-905f-4436-82c7-e47526a9e71e None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:54.952033 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d58389-905f-4436-82c7-e47526a9e71e None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:54.952312 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d58389-905f-4436-82c7-e47526a9e71e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:54.966143 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d58389-905f-4436-82c7-e47526a9e71e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:54.967589 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d58389-905f-4436-82c7-e47526a9e71e None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:54.983131 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-d2d58389-905f-4436-82c7-e47526a9e71e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:54.983131 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:54.983131 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:54.983131 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:54.983131 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:54.983131 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:54.983131 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:54.983131 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:54.983131 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:54.983131 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:54.983131 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:54.983131 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:54.983131 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:38:54.983131 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:38:54.983131 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:38:54.983131 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:38:54.984189 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:54.984189 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:54.984189 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:54.984189 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:54.984189 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:54.984189 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:54.984189 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:54.984189 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:54.984189 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:54.984189 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:54.984189 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:54.984189 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:54.984189 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:54.984189 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:54.984189 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:54.984189 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:54.984189 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:38:54.985112 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:38:54.985112 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:54.985112 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:54.985112 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 371/740] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:38:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:54.985112 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d58389-905f-4436-82c7-e47526a9e71e None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:55.004031 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4c877-73e8-45ad-bbad-9a39503ee281 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:55.013399 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:55.040030 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476302ff-80b5-4ae2-aa04-58317b24fa00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:55.040739 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476302ff-80b5-4ae2-aa04-58317b24fa00 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:55.041015 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476302ff-80b5-4ae2-aa04-58317b24fa00 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:55.041285 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476302ff-80b5-4ae2-aa04-58317b24fa00 None admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:55.041967 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476302ff-80b5-4ae2-aa04-58317b24fa00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:55.042271 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476302ff-80b5-4ae2-aa04-58317b24fa00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:55.043646 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476302ff-80b5-4ae2-aa04-58317b24fa00 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:55.055716 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 370/741] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:38:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:55.057013 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b9575-8af9-4261-bccf-018f28f9067f None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:55.057309 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b9575-8af9-4261-bccf-018f28f9067f None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:55.057611 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b9575-8af9-4261-bccf-018f28f9067f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:55.076865 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-ea8b9575-8af9-4261-bccf-018f28f9067f None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:38:55.078103 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-ea8b9575-8af9-4261-bccf-018f28f9067f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:38:55.098145 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d58389-905f-4436-82c7-e47526a9e71e None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:55.135842 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4660ca5-07e9-41d4-a368-7ef31621c1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:55.136503 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4660ca5-07e9-41d4-a368-7ef31621c1d6 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:55.136855 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4660ca5-07e9-41d4-a368-7ef31621c1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:55.137187 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4660ca5-07e9-41d4-a368-7ef31621c1d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:55.149041 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4660ca5-07e9-41d4-a368-7ef31621c1d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:55.150525 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4660ca5-07e9-41d4-a368-7ef31621c1d6 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:55.160558 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 371/742] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:38:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:38:55.161486 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8b9575-8af9-4261-bccf-018f28f9067f None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:55.169452 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-d4660ca5-07e9-41d4-a368-7ef31621c1d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:55.169452 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:55.169452 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:55.169452 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:55.169452 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:55.169452 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:55.169452 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:55.169452 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:55.169452 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:55.169452 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:55.169452 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:55.169452 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:55.169452 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:38:55.169452 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:38:55.169452 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:38:55.169452 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:38:55.170572 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:55.170572 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:55.170572 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:55.170572 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:55.170572 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:55.170572 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:55.170572 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:55.170572 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:55.170572 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:55.170572 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:55.170572 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:55.170572 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:55.170572 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:55.170572 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:55.170572 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:55.170572 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:55.170572 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:38:55.171680 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:38:55.171680 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:55.171680 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:55.171680 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 372/743] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:38:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:55.171680 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4660ca5-07e9-41d4-a368-7ef31621c1d6 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:55.199075 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:55.263611 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:55.279002 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8b9575-8af9-4261-bccf-018f28f9067f None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:55.293025 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4660ca5-07e9-41d4-a368-7ef31621c1d6 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:55.314988 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35bb129-ed2f-49a5-9f7b-ef1c434cf940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:55.316402 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35bb129-ed2f-49a5-9f7b-ef1c434cf940 None admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:55.316764 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35bb129-ed2f-49a5-9f7b-ef1c434cf940 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:55.317216 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35bb129-ed2f-49a5-9f7b-ef1c434cf940 None admin] PATH_INFO: `/v3/services` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:55.317904 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35bb129-ed2f-49a5-9f7b-ef1c434cf940 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:55.319292 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35bb129-ed2f-49a5-9f7b-ef1c434cf940 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:55.330205 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955172b-7a5e-4e11-a640-569ca848c61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:55.330953 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955172b-7a5e-4e11-a640-569ca848c61f None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:55.331295 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955172b-7a5e-4e11-a640-569ca848c61f None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:55.331724 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955172b-7a5e-4e11-a640-569ca848c61f None admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:55.332387 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955172b-7a5e-4e11-a640-569ca848c61f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:55.332753 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955172b-7a5e-4e11-a640-569ca848c61f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:55.334273 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955172b-7a5e-4e11-a640-569ca848c61f None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:55.346869 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 373/744] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:38:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:55.347711 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955172b-7a5e-4e11-a640-569ca848c61f None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:55.435484 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 372/745] 10.222.0.60 () {60 vars in 1141 bytes} [Sat Sep 24 19:38:55 2022] POST /identity/v3/services => generated 240 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:38:55.436218 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35bb129-ed2f-49a5-9f7b-ef1c434cf940 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:55.459181 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955172b-7a5e-4e11-a640-569ca848c61f None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:55.503944 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:55.517822 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f7b458-cf88-4618-9c42-a30f3be23e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:55.518793 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f7b458-cf88-4618-9c42-a30f3be23e7d None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:55.519133 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f7b458-cf88-4618-9c42-a30f3be23e7d None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:55.519485 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f7b458-cf88-4618-9c42-a30f3be23e7d None admin] PATH_INFO: `/v3/projects/service` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:55.528498 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f7b458-cf88-4618-9c42-a30f3be23e7d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:55.530041 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f7b458-cf88-4618-9c42-a30f3be23e7d None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:55.543817 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-57f7b458-cf88-4618-9c42-a30f3be23e7d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:38:55.543817 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:55.543817 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:55.543817 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:55.543817 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:55.543817 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:55.543817 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:55.543817 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:55.543817 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:55.543817 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:55.543817 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:55.543817 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:55.543817 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:38:55.543817 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:38:55.543817 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:38:55.552316 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:38:55.552316 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:55.552316 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:55.552316 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:55.552316 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:55.552316 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:55.552316 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:55.552316 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:55.552316 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:55.552316 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:55.552316 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:55.552316 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:55.552316 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:55.552316 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:55.552316 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:55.552316 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:55.552316 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:55.553441 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:38:55.553441 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:38:55.553441 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:38:55.553441 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:38:55.553441 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:38:55.553441 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:38:55.553441 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:38:55.553441 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:55.553441 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 374/746] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Sep 24 19:38:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:55.553441 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f7b458-cf88-4618-9c42-a30f3be23e7d None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:55.577041 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:55.600363 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35bb129-ed2f-49a5-9f7b-ef1c434cf940 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:55.642753 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b579de-b615-42b5-80b7-803d41402f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:55.643570 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b579de-b615-42b5-80b7-803d41402f1a None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:55.643861 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b579de-b615-42b5-80b7-803d41402f1a None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:55.644781 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b579de-b615-42b5-80b7-803d41402f1a None admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:55.644900 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b579de-b615-42b5-80b7-803d41402f1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:55.645162 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b579de-b615-42b5-80b7-803d41402f1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:55.646595 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b579de-b615-42b5-80b7-803d41402f1a None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:55.660605 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 373/747] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:38:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:55.660605 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b579de-b615-42b5-80b7-803d41402f1a None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:55.684807 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f7b458-cf88-4618-9c42-a30f3be23e7d None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:55.723543 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc60dcd-b7b2-404c-b009-603881fe3a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:55.724377 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc60dcd-b7b2-404c-b009-603881fe3a89 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:55.724792 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc60dcd-b7b2-404c-b009-603881fe3a89 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:55.725222 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc60dcd-b7b2-404c-b009-603881fe3a89 None admin] PATH_INFO: `/v3/users/swift` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:55.733946 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc60dcd-b7b2-404c-b009-603881fe3a89 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:55.736575 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc60dcd-b7b2-404c-b009-603881fe3a89 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:55.750413 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-efc60dcd-b7b2-404c-b009-603881fe3a89 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 24 19:38:55.750413 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:55.750413 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:55.750413 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:55.750413 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:55.750413 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:55.750413 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:55.750413 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:55.750413 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:55.750413 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:55.750413 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:55.750413 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:55.750413 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:38:55.750413 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:38:55.750413 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:38:55.750413 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:38:55.751551 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:55.751551 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:55.751551 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:38:55.751551 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:38:55.751551 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:38:55.751551 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:38:55.751551 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:55.751551 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:55.751551 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:55.751551 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:55.751551 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:55.751551 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:55.751551 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:55.751551 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:55.751551 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:55.751551 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:55.751551 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:55.751551 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:55.752733 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:55.752733 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:55.752733 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:38:55.752733 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:38:55.752733 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:38:55.752733 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:38:55.752733 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:38:55.752733 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:38:55.752733 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 24 19:38:55.752733 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:55.752733 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 375/748] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Sep 24 19:38:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:55.752733 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc60dcd-b7b2-404c-b009-603881fe3a89 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:55.783322 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b579de-b615-42b5-80b7-803d41402f1a None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:55.809644 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:55.832934 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a18be6-7021-48d3-9949-3073dd65e531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:55.833601 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a18be6-7021-48d3-9949-3073dd65e531 None admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:55.833880 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a18be6-7021-48d3-9949-3073dd65e531 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:55.834147 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a18be6-7021-48d3-9949-3073dd65e531 None admin] PATH_INFO: `/v3/services` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:55.834811 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a18be6-7021-48d3-9949-3073dd65e531 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:55.836220 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a18be6-7021-48d3-9949-3073dd65e531 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:55.869434 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc60dcd-b7b2-404c-b009-603881fe3a89 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:55.908415 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf862b47-f693-4b27-ba89-fe0507ec2cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:55.910385 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf862b47-f693-4b27-ba89-fe0507ec2cc0 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:55.910672 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf862b47-f693-4b27-ba89-fe0507ec2cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:55.910951 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf862b47-f693-4b27-ba89-fe0507ec2cc0 None admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:55.911655 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf862b47-f693-4b27-ba89-fe0507ec2cc0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:55.911963 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf862b47-f693-4b27-ba89-fe0507ec2cc0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:55.913397 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf862b47-f693-4b27-ba89-fe0507ec2cc0 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:55.929201 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 374/749] 10.222.0.60 () {60 vars in 1141 bytes} [Sat Sep 24 19:38:55 2022] POST /identity/v3/services => generated 251 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:38:55.929201 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a18be6-7021-48d3-9949-3073dd65e531 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:55.934429 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:55.937427 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 376/750] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Sep 24 19:38:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:55.938805 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf862b47-f693-4b27-ba89-fe0507ec2cc0 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:56.068442 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf862b47-f693-4b27-ba89-fe0507ec2cc0 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:56.068692 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a18be6-7021-48d3-9949-3073dd65e531 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:56.081864 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:56.108528 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5fceab-b07f-463d-908c-ac210e44dce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:56.109192 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5fceab-b07f-463d-908c-ac210e44dce7 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:56.109464 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5fceab-b07f-463d-908c-ac210e44dce7 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:56.109725 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5fceab-b07f-463d-908c-ac210e44dce7 None admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:56.110496 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5fceab-b07f-463d-908c-ac210e44dce7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:56.110807 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5fceab-b07f-463d-908c-ac210e44dce7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:56.112280 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5fceab-b07f-463d-908c-ac210e44dce7 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:56.116094 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a76783-30c6-418d-b6d5-0bbe9faf593e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:56.117570 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a76783-30c6-418d-b6d5-0bbe9faf593e None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:56.118154 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a76783-30c6-418d-b6d5-0bbe9faf593e None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:56.118674 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a76783-30c6-418d-b6d5-0bbe9faf593e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:56.131636 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a76783-30c6-418d-b6d5-0bbe9faf593e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:56.133472 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a76783-30c6-418d-b6d5-0bbe9faf593e None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:56.137673 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 377/751] 10.222.0.60 () {56 vars in 1135 bytes} [Sat Sep 24 19:38:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:56.138832 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5fceab-b07f-463d-908c-ac210e44dce7 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:56.148493 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-99a76783-30c6-418d-b6d5-0bbe9faf593e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 24 19:38:56.148493 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:56.148493 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:56.148493 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:56.148493 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:56.148493 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:56.148493 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:56.148493 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:56.148493 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:56.148493 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:56.148493 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:56.148493 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:56.148493 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:38:56.148493 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:38:56.148493 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:38:56.148493 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:38:56.149712 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:56.149712 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:56.149712 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:38:56.149712 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:38:56.149712 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:38:56.149712 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:38:56.149712 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:56.149712 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:56.149712 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:56.149712 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:56.149712 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:56.149712 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:56.149712 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:56.149712 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:56.149712 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:56.149712 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:56.149712 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:56.149712 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:56.150843 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:56.150843 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:56.150843 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:38:56.150843 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:38:56.150843 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:38:56.150843 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:38:56.150843 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:38:56.150843 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:38:56.150843 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 24 19:38:56.150843 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:56.156760 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 375/752] 10.222.0.60 () {56 vars in 1117 bytes} [Sat Sep 24 19:38:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:56.157755 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a76783-30c6-418d-b6d5-0bbe9faf593e None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:56.246165 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:56.291093 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5fceab-b07f-463d-908c-ac210e44dce7 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:56.297462 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a76783-30c6-418d-b6d5-0bbe9faf593e None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:56.337797 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbff1ba-0620-4ab2-a9b2-016db75c01c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:56.338701 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbff1ba-0620-4ab2-a9b2-016db75c01c0 None admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:56.339206 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbff1ba-0620-4ab2-a9b2-016db75c01c0 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:56.339621 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbff1ba-0620-4ab2-a9b2-016db75c01c0 None admin] PATH_INFO: `/v3/projects/5c2da88af5714e619238772bde676a42/users/f3b5047a59bc4547be643ffa78808a6d/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:56.339981 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea1098-d5f1-4c07-9e85-a3a5284cd6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:56.340730 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea1098-d5f1-4c07-9e85-a3a5284cd6c8 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:56.341109 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea1098-d5f1-4c07-9e85-a3a5284cd6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:56.341473 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea1098-d5f1-4c07-9e85-a3a5284cd6c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:56.342311 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbff1ba-0620-4ab2-a9b2-016db75c01c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=5c2da88af5714e619238772bde676a42, user_id=f3b5047a59bc4547be643ffa78808a6d, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:56.343900 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbff1ba-0620-4ab2-a9b2-016db75c01c0 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:56.426228 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 378/753] 10.222.0.60 () {58 vars in 1439 bytes} [Sat Sep 24 19:38:56 2022] PUT /identity/v3/projects/5c2da88af5714e619238772bde676a42/users/f3b5047a59bc4547be643ffa78808a6d/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:38:56.427978 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbff1ba-0620-4ab2-a9b2-016db75c01c0 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:56.434542 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddea1098-d5f1-4c07-9e85-a3a5284cd6c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:56.443113 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddea1098-d5f1-4c07-9e85-a3a5284cd6c8 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:56.491701 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:56.569871 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:56.623518 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbff1ba-0620-4ab2-a9b2-016db75c01c0 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:56.662993 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 376/754] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Sep 24 19:38:56 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 19:38:56.671613 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea1098-d5f1-4c07-9e85-a3a5284cd6c8 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:56.700101 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d6fd21-286f-40d6-bb01-ea0257157c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:56.701089 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6fd21-286f-40d6-bb01-ea0257157c8d None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:56.701746 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6fd21-286f-40d6-bb01-ea0257157c8d None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:56.702225 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6fd21-286f-40d6-bb01-ea0257157c8d None admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:56.703175 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d6fd21-286f-40d6-bb01-ea0257157c8d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:56.703686 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d6fd21-286f-40d6-bb01-ea0257157c8d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:56.705660 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d6fd21-286f-40d6-bb01-ea0257157c8d None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:56.727251 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 379/755] 10.222.0.60 () {56 vars in 1149 bytes} [Sat Sep 24 19:38:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:56.741676 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d6fd21-286f-40d6-bb01-ea0257157c8d None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:56.794537 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea1098-d5f1-4c07-9e85-a3a5284cd6c8 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:56.838291 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e5dbcd-8496-4319-9f26-65200b143157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:56.838939 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5dbcd-8496-4319-9f26-65200b143157 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:56.839215 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5dbcd-8496-4319-9f26-65200b143157 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:56.839486 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5dbcd-8496-4319-9f26-65200b143157 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:56.845409 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:56.855370 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e5dbcd-8496-4319-9f26-65200b143157 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:56.856876 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e5dbcd-8496-4319-9f26-65200b143157 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:56.863499 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d6fd21-286f-40d6-bb01-ea0257157c8d None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:56.882850 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-72e5dbcd-8496-4319-9f26-65200b143157 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:56.882850 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:56.882850 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:56.882850 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:56.882850 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:56.882850 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:56.882850 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:56.882850 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:56.882850 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:56.882850 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:56.882850 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:56.882850 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:56.882850 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:38:56.882850 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:38:56.882850 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:38:56.882850 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:38:56.883833 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:56.883833 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:56.883833 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:56.883833 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:56.883833 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:56.883833 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:56.883833 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:56.883833 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:56.883833 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:56.883833 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:56.883833 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:56.883833 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:56.883833 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:56.883833 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:56.883833 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:56.883833 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:56.883833 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:38:56.884717 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:38:56.884717 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:56.884717 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:56.888610 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 377/756] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:38:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:56.889862 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e5dbcd-8496-4319-9f26-65200b143157 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:56.919515 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:56.943810 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64119e0f-e9bc-4143-822e-c873f8fbbe72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:56.944585 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64119e0f-e9bc-4143-822e-c873f8fbbe72 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:56.944958 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64119e0f-e9bc-4143-822e-c873f8fbbe72 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:56.945322 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64119e0f-e9bc-4143-822e-c873f8fbbe72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:57.067330 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e5dbcd-8496-4319-9f26-65200b143157 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:57.083627 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64119e0f-e9bc-4143-822e-c873f8fbbe72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:57.085102 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64119e0f-e9bc-4143-822e-c873f8fbbe72 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:57.149940 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd018c-4509-467d-9d8a-f95bca0772ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:57.150477 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd018c-4509-467d-9d8a-f95bca0772ed None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:57.150756 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd018c-4509-467d-9d8a-f95bca0772ed None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:57.151023 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd018c-4509-467d-9d8a-f95bca0772ed None admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:57.151671 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfd018c-4509-467d-9d8a-f95bca0772ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:57.151970 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfd018c-4509-467d-9d8a-f95bca0772ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:57.154369 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfd018c-4509-467d-9d8a-f95bca0772ed None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:57.177086 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 378/757] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:38:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:38:57.189343 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd018c-4509-467d-9d8a-f95bca0772ed None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:57.265868 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:57.293740 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 380/758] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Sep 24 19:38:56 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 19:38:57.301893 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64119e0f-e9bc-4143-822e-c873f8fbbe72 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:57.367966 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:57.408060 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd018c-4509-467d-9d8a-f95bca0772ed None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:57.471111 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64119e0f-e9bc-4143-822e-c873f8fbbe72 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:57.496782 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96cb187-faf3-4926-9491-aa0eeea62e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:57.497817 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96cb187-faf3-4926-9491-aa0eeea62e3e None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:57.498340 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96cb187-faf3-4926-9491-aa0eeea62e3e None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:57.498815 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96cb187-faf3-4926-9491-aa0eeea62e3e None admin] PATH_INFO: `/v3/projects/service` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:57.512954 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96cb187-faf3-4926-9491-aa0eeea62e3e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:57.517477 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96cb187-faf3-4926-9491-aa0eeea62e3e None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:57.536288 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-b96cb187-faf3-4926-9491-aa0eeea62e3e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:38:57.536288 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:57.536288 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:57.536288 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:57.536288 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:57.536288 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:57.536288 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:57.536288 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:57.536288 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:57.536288 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:57.536288 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:57.536288 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:57.536288 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:38:57.536288 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:38:57.536288 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:38:57.537267 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:38:57.537267 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:57.537267 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:57.537267 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:57.537267 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:57.537267 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:57.537267 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:57.537267 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:57.537267 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:57.537267 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:57.537267 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:57.537267 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:57.537267 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:57.537267 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:57.537267 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:57.537267 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:57.537267 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:57.538192 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:38:57.538192 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:38:57.538192 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:38:57.538192 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:38:57.538192 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:38:57.538192 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:38:57.538192 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:38:57.538192 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:57.543217 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 379/759] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Sep 24 19:38:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:57.546837 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5bdae6-8669-46de-bd3e-b63aa08ff4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:57.547756 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5bdae6-8669-46de-bd3e-b63aa08ff4f2 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:57.548231 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5bdae6-8669-46de-bd3e-b63aa08ff4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:57.548695 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5bdae6-8669-46de-bd3e-b63aa08ff4f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:57.549019 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96cb187-faf3-4926-9491-aa0eeea62e3e None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:57.570791 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5bdae6-8669-46de-bd3e-b63aa08ff4f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:57.572612 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5bdae6-8669-46de-bd3e-b63aa08ff4f2 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:57.593901 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-6c5bdae6-8669-46de-bd3e-b63aa08ff4f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:57.593901 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:57.593901 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:57.593901 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:57.593901 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:57.593901 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:57.593901 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:57.593901 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:57.593901 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:57.593901 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:57.593901 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:57.593901 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:57.593901 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:38:57.593901 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:38:57.593901 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:38:57.593901 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:38:57.595107 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:57.595107 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:57.595107 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:57.595107 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:57.595107 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:57.595107 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:57.595107 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:57.595107 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:57.595107 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:57.595107 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:57.595107 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:57.595107 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:57.595107 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:57.595107 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:57.595107 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:57.595107 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:57.595107 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:38:57.595997 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:38:57.595997 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:38:57.595997 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:57.599274 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 381/760] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:38:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:38:57.607633 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5bdae6-8669-46de-bd3e-b63aa08ff4f2 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:57.657439 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:57.728171 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5bdae6-8669-46de-bd3e-b63aa08ff4f2 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:57.791725 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e69d0ca-f975-4870-8a9b-e4b2bf88a0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:57.792360 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69d0ca-f975-4870-8a9b-e4b2bf88a0db None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:57.792644 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69d0ca-f975-4870-8a9b-e4b2bf88a0db None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:57.792917 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69d0ca-f975-4870-8a9b-e4b2bf88a0db None admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:57.793612 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e69d0ca-f975-4870-8a9b-e4b2bf88a0db None admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:57.793909 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e69d0ca-f975-4870-8a9b-e4b2bf88a0db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:57.795387 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e69d0ca-f975-4870-8a9b-e4b2bf88a0db None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:57.814078 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96cb187-faf3-4926-9491-aa0eeea62e3e None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:57.828481 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 382/761] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:38:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:57.834911 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e69d0ca-f975-4870-8a9b-e4b2bf88a0db None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:57.879239 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:57.890231 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af86198-e3cf-42cf-acb5-60061406f6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:57.891134 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af86198-e3cf-42cf-acb5-60061406f6f9 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:57.891440 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af86198-e3cf-42cf-acb5-60061406f6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:57.891440 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af86198-e3cf-42cf-acb5-60061406f6f9 None admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:57.892126 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af86198-e3cf-42cf-acb5-60061406f6f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:57.895750 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af86198-e3cf-42cf-acb5-60061406f6f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:57.895750 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af86198-e3cf-42cf-acb5-60061406f6f9 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:57.918909 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 380/762] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Sep 24 19:38:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:38:57.918909 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed205c2c-5096-4936-86bd-06e75601d247 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:57.918909 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed205c2c-5096-4936-86bd-06e75601d247 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:57.918909 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed205c2c-5096-4936-86bd-06e75601d247 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:57.918909 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 381/763] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:38:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:38:57.921526 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed205c2c-5096-4936-86bd-06e75601d247 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:57.982775 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:57.988253 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e69d0ca-f975-4870-8a9b-e4b2bf88a0db None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:58.047053 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed205c2c-5096-4936-86bd-06e75601d247 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:58.064910 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d1c7a0-c66b-4b8e-82ca-88b413e913fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:58.066418 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1c7a0-c66b-4b8e-82ca-88b413e913fe None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:58.066756 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1c7a0-c66b-4b8e-82ca-88b413e913fe None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:58.067027 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1c7a0-c66b-4b8e-82ca-88b413e913fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:58.074865 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d1c7a0-c66b-4b8e-82ca-88b413e913fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:58.076492 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d1c7a0-c66b-4b8e-82ca-88b413e913fe None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:58.088596 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d1866-5c5b-4360-8ac5-f4a577446cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:58.089203 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d1866-5c5b-4360-8ac5-f4a577446cf0 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:58.089476 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d1866-5c5b-4360-8ac5-f4a577446cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:58.089770 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d1866-5c5b-4360-8ac5-f4a577446cf0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:58.090494 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375d1866-5c5b-4360-8ac5-f4a577446cf0 None admin] RBAC: Adding query filter params (role.id=f022705fa6ce43828345ef50b3f7efc9, scope.project.id=5c2da88af5714e619238772bde676a42, user.id=ebd94cd16acc45e6ac2997204297fb75) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:58.090610 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-c6d1c7a0-c66b-4b8e-82ca-88b413e913fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:38:58.090610 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:58.090610 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:58.090610 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:58.090610 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:58.090610 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:58.090610 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:58.090610 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:58.090610 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:58.090610 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:58.090610 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:58.090610 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:58.090610 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:38:58.090610 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:38:58.090610 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:38:58.091484 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:38:58.091484 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:58.091484 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:58.091484 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:58.091484 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:58.091484 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:58.091484 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:58.091484 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:58.091484 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:58.091484 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:58.091484 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:58.091484 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:58.091484 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:58.091484 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:58.091484 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:58.091484 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:58.091484 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:58.093154 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:38:58.093154 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:38:58.093154 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:38:58.093154 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:38:58.093154 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:38:58.093154 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:38:58.093154 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:38:58.093154 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:58.094252 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375d1866-5c5b-4360-8ac5-f4a577446cf0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:58.094407 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 383/764] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Sep 24 19:38:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:38:58.094554 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375d1866-5c5b-4360-8ac5-f4a577446cf0 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:58.094704 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219fb01-9c02-4f94-af5b-8b763f88b9bc None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:58.094704 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219fb01-9c02-4f94-af5b-8b763f88b9bc None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:58.094704 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219fb01-9c02-4f94-af5b-8b763f88b9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:58.101604 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 382/765] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Sep 24 19:38:57 2022] GET /identity/v3/role_assignments?user.id=ebd94cd16acc45e6ac2997204297fb75&scope.project.id=5c2da88af5714e619238772bde676a42&role.id=f022705fa6ce43828345ef50b3f7efc9 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:58.102547 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d1866-5c5b-4360-8ac5-f4a577446cf0 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:58.128435 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-b219fb01-9c02-4f94-af5b-8b763f88b9bc None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:38:58.130572 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-b219fb01-9c02-4f94-af5b-8b763f88b9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:38:58.227962 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:58.272463 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 384/766] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:38:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:38:58.411142 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d1866-5c5b-4360-8ac5-f4a577446cf0 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:58.447842 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df5ea12-8c5f-4344-88f2-5c33d38bc67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:58.448457 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df5ea12-8c5f-4344-88f2-5c33d38bc67e None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:58.448734 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df5ea12-8c5f-4344-88f2-5c33d38bc67e None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:58.449004 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df5ea12-8c5f-4344-88f2-5c33d38bc67e None admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:58.449726 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df5ea12-8c5f-4344-88f2-5c33d38bc67e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:58.450028 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df5ea12-8c5f-4344-88f2-5c33d38bc67e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:58.451456 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df5ea12-8c5f-4344-88f2-5c33d38bc67e None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:58.464709 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 383/767] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Sep 24 19:38:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:58.468461 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb71b3-792a-421f-8870-869d6f657261 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:58.468753 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb71b3-792a-421f-8870-869d6f657261 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:58.469028 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb71b3-792a-421f-8870-869d6f657261 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:58.470500 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df5ea12-8c5f-4344-88f2-5c33d38bc67e None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:58.470768 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 385/768] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:38:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:38:58.477386 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67506cac-1ab5-410f-8f98-679533058c2b None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:58.477781 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67506cac-1ab5-410f-8f98-679533058c2b None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:58.478094 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67506cac-1ab5-410f-8f98-679533058c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:58.506226 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-67506cac-1ab5-410f-8f98-679533058c2b None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:38:58.507444 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-67506cac-1ab5-410f-8f98-679533058c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:38:58.617462 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 386/769] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:38:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 19:38:58.645873 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67506cac-1ab5-410f-8f98-679533058c2b None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:58.665322 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:58.667896 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df5ea12-8c5f-4344-88f2-5c33d38bc67e None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:58.700966 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:58.746213 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd01cf-e65e-452b-882d-6149d71913cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:58.746835 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd01cf-e65e-452b-882d-6149d71913cd None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:58.747110 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd01cf-e65e-452b-882d-6149d71913cd None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:58.747374 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd01cf-e65e-452b-882d-6149d71913cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:58.748159 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdd01cf-e65e-452b-882d-6149d71913cd None admin] RBAC: Adding query filter params (role.id=e9acf72f841f4030a76e8f9c41c95d7f, scope.project.id=5c2da88af5714e619238772bde676a42, user.id=fd597f74abdf49288ea0d92642c6a5a2) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:58.748467 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdd01cf-e65e-452b-882d-6149d71913cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:58.749990 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdd01cf-e65e-452b-882d-6149d71913cd None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:58.751046 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67506cac-1ab5-410f-8f98-679533058c2b None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:58.759784 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 384/770] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Sep 24 19:38:58 2022] GET /identity/v3/role_assignments?user.id=fd597f74abdf49288ea0d92642c6a5a2&scope.project.id=5c2da88af5714e619238772bde676a42&role.id=e9acf72f841f4030a76e8f9c41c95d7f => generated 259 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:38:58.789422 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c835bf2-d76b-40cc-b4ab-cb7648854543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:58.790100 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c835bf2-d76b-40cc-b4ab-cb7648854543 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:58.790374 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c835bf2-d76b-40cc-b4ab-cb7648854543 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:58.790641 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c835bf2-d76b-40cc-b4ab-cb7648854543 None admin] PATH_INFO: `/v3/services/network` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:58.791232 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c835bf2-d76b-40cc-b4ab-cb7648854543 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:58.792636 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c835bf2-d76b-40cc-b4ab-cb7648854543 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:58.804573 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-2c835bf2-d76b-40cc-b4ab-cb7648854543 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 24 19:38:58.804573 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:58.804573 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:38:58.804573 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:38:58.804573 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:38:58.804573 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:38:58.804573 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:38:58.804573 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:38:58.804573 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 24 19:38:58.804573 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:58.804573 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:38:58.804573 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:58.804573 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:58.804573 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:58.804573 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:58.804573 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:58.804573 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:58.805730 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:58.805730 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:58.805730 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:58.805730 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:58.805730 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:58.805730 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:58.805730 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:38:58.805730 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:38:58.805730 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:38:58.805730 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:38:58.805730 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:58.805730 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:58.805730 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:58.805730 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:58.805730 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:58.805730 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:58.806577 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:58.806577 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:58.806577 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:58.806577 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:58.806577 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:58.806577 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:58.806577 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:58.806577 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:58.806577 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:58.806577 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:58.806577 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:38:58.806577 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:38:58.806577 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 24 19:38:58.806577 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:38:58.806577 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 387/771] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Sep 24 19:38:58 2022] GET /identity/v3/services/network => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:38:58.812109 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd01cf-e65e-452b-882d-6149d71913cd None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:58.989375 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd01cf-e65e-452b-882d-6149d71913cd None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:59.038407 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ab6b07-720d-441c-ba79-6b21c8b1db42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:59.039026 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab6b07-720d-441c-ba79-6b21c8b1db42 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:59.039302 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab6b07-720d-441c-ba79-6b21c8b1db42 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:59.039573 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab6b07-720d-441c-ba79-6b21c8b1db42 None admin] PATH_INFO: `/v3/services` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:59.040208 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ab6b07-720d-441c-ba79-6b21c8b1db42 None admin] RBAC: Adding query filter params (name=network) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:59.040508 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ab6b07-720d-441c-ba79-6b21c8b1db42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:59.041897 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ab6b07-720d-441c-ba79-6b21c8b1db42 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:59.050558 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 385/772] 10.222.0.60 () {56 vars in 1112 bytes} [Sat Sep 24 19:38:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:59.056259 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c835bf2-d76b-40cc-b4ab-cb7648854543 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:59.093547 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ab6b07-720d-441c-ba79-6b21c8b1db42 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:59.187359 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:59.210570 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:59.251057 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c835bf2-d76b-40cc-b4ab-cb7648854543 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:59.280545 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ab6b07-720d-441c-ba79-6b21c8b1db42 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:59.296676 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255f270-f5b3-49bd-aadb-a26c476bde5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:59.297639 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255f270-f5b3-49bd-aadb-a26c476bde5c None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:59.297926 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255f270-f5b3-49bd-aadb-a26c476bde5c None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:59.298224 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255f270-f5b3-49bd-aadb-a26c476bde5c None admin] PATH_INFO: `/v3/services` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:59.300143 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d255f270-f5b3-49bd-aadb-a26c476bde5c None admin] RBAC: Adding query filter params (type=network) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:59.300563 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d255f270-f5b3-49bd-aadb-a26c476bde5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:59.302169 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d255f270-f5b3-49bd-aadb-a26c476bde5c None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:59.309382 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 388/773] 10.222.0.60 () {56 vars in 1112 bytes} [Sat Sep 24 19:38:59 2022] GET /identity/v3/services?type=network => generated 350 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:59.311312 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a12c2-28cd-4fd8-a0f7-006633a2c6af None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:59.311670 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a12c2-28cd-4fd8-a0f7-006633a2c6af None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:59.312553 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a12c2-28cd-4fd8-a0f7-006633a2c6af None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:59.317577 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 389/774] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:38:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:38:59.318450 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a12c2-28cd-4fd8-a0f7-006633a2c6af None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:59.331400 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9123c8eb-eb19-4b62-85c4-82eac7e0c31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:59.332173 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123c8eb-eb19-4b62-85c4-82eac7e0c31c None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:59.332550 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123c8eb-eb19-4b62-85c4-82eac7e0c31c None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:59.332951 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123c8eb-eb19-4b62-85c4-82eac7e0c31c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:59.333686 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9123c8eb-eb19-4b62-85c4-82eac7e0c31c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:59.335279 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9123c8eb-eb19-4b62-85c4-82eac7e0c31c None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:59.344822 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-9123c8eb-eb19-4b62-85c4-82eac7e0c31c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 24 19:38:59.344822 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:59.344822 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:38:59.344822 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:38:59.344822 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:38:59.344822 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:38:59.344822 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:38:59.344822 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:38:59.344822 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 24 19:38:59.344822 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:59.344822 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:38:59.344822 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:59.344822 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:38:59.344822 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:38:59.344822 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:38:59.344822 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:38:59.344822 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:38:59.346014 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:38:59.346014 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:38:59.346014 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:38:59.346014 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:38:59.346014 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:38:59.346014 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:38:59.346014 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:38:59.346014 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:38:59.346014 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:38:59.346014 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:38:59.346014 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:38:59.346014 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:38:59.346014 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:38:59.346014 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:38:59.346014 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:38:59.346014 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:38:59.347677 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:38:59.347677 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:38:59.347677 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:38:59.347677 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:38:59.347677 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:38:59.347677 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:38:59.347677 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:38:59.347677 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:38:59.347677 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:38:59.347677 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:38:59.347677 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:38:59.347677 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:38:59.347677 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 24 19:38:59.347677 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:38:59.349237 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 386/775] 10.222.0.60 () {56 vars in 1129 bytes} [Sat Sep 24 19:38:59 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:38:59.351053 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7641fa-953d-4039-8a15-0ba1c2ac6c64 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:59.351336 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7641fa-953d-4039-8a15-0ba1c2ac6c64 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:59.351753 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7641fa-953d-4039-8a15-0ba1c2ac6c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:59.370759 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-ce7641fa-953d-4039-8a15-0ba1c2ac6c64 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:38:59.372064 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-ce7641fa-953d-4039-8a15-0ba1c2ac6c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:38:59.434162 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a12c2-28cd-4fd8-a0f7-006633a2c6af None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:59.452677 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 387/776] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:38:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:38:59.454319 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7641fa-953d-4039-8a15-0ba1c2ac6c64 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:59.469852 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e2e39-d289-47df-af0f-0949d29a8489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:59.470642 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e2e39-d289-47df-af0f-0949d29a8489 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:59.471031 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e2e39-d289-47df-af0f-0949d29a8489 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:59.472005 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e2e39-d289-47df-af0f-0949d29a8489 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:59.472886 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e2e39-d289-47df-af0f-0949d29a8489 None admin] RBAC: Adding query filter params (interface=public, service_id=37f775e154a2444494fb61f5095c8712, region_id=RegionOne) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:59.473235 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e2e39-d289-47df-af0f-0949d29a8489 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:59.474739 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e2e39-d289-47df-af0f-0949d29a8489 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:59.483008 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 390/777] 10.222.0.60 () {56 vars in 1251 bytes} [Sat Sep 24 19:38:59 2022] GET /identity/v3/endpoints?service_id=37f775e154a2444494fb61f5095c8712&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:59.488909 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e2e39-d289-47df-af0f-0949d29a8489 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:59.505930 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:59.525560 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:59.599765 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e2e39-d289-47df-af0f-0949d29a8489 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:59.641815 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e023b7a-faeb-43ee-b711-683a3476e12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:59.642447 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e023b7a-faeb-43ee-b711-683a3476e12b None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:59.642733 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e023b7a-faeb-43ee-b711-683a3476e12b None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:59.643680 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e023b7a-faeb-43ee-b711-683a3476e12b None admin] PATH_INFO: `/v3/services` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:59.644501 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e023b7a-faeb-43ee-b711-683a3476e12b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:59.645889 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e023b7a-faeb-43ee-b711-683a3476e12b None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:59.652225 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 391/778] 10.222.0.60 () {56 vars in 1087 bytes} [Sat Sep 24 19:38:59 2022] GET /identity/v3/services => generated 772 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:38:59.669590 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7641fa-953d-4039-8a15-0ba1c2ac6c64 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:59.709836 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2405e0d5-9e4f-44dd-889a-8ec1d6d4539f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:59.710459 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405e0d5-9e4f-44dd-889a-8ec1d6d4539f None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:59.710734 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405e0d5-9e4f-44dd-889a-8ec1d6d4539f None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:59.710991 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405e0d5-9e4f-44dd-889a-8ec1d6d4539f None admin] PATH_INFO: `/v3/services` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:59.711627 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2405e0d5-9e4f-44dd-889a-8ec1d6d4539f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:59.711924 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2405e0d5-9e4f-44dd-889a-8ec1d6d4539f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:59.713401 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2405e0d5-9e4f-44dd-889a-8ec1d6d4539f None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:59.719348 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 388/779] 10.222.0.60 () {56 vars in 1124 bytes} [Sat Sep 24 19:38:59 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:59.725366 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e023b7a-faeb-43ee-b711-683a3476e12b None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:59.845614 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:59.886052 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e023b7a-faeb-43ee-b711-683a3476e12b None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:59.934130 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c42077-3393-482b-9921-a857d9e42740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:59.934737 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c42077-3393-482b-9921-a857d9e42740 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:59.935012 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c42077-3393-482b-9921-a857d9e42740 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:59.935331 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c42077-3393-482b-9921-a857d9e42740 None admin] PATH_INFO: `/v3/services` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:59.935964 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c42077-3393-482b-9921-a857d9e42740 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:38:59.936263 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c42077-3393-482b-9921-a857d9e42740 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:59.937645 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c42077-3393-482b-9921-a857d9e42740 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:59.943146 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 392/780] 10.222.0.60 () {56 vars in 1124 bytes} [Sat Sep 24 19:38:59 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:38:59.948581 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2405e0d5-9e4f-44dd-889a-8ec1d6d4539f None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:59.951856 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c42077-3393-482b-9921-a857d9e42740 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:00.083455 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c42077-3393-482b-9921-a857d9e42740 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:00.088976 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2405e0d5-9e4f-44dd-889a-8ec1d6d4539f None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:00.089849 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:00.140383 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e77283-194a-4eae-86fa-209e54129cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:00.142286 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e77283-194a-4eae-86fa-209e54129cb8 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:00.143865 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e77283-194a-4eae-86fa-209e54129cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:00.144769 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e77283-194a-4eae-86fa-209e54129cb8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:00.147142 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de62b2b3-b32f-40be-ba90-d1b4387dd4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:00.147459 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e77283-194a-4eae-86fa-209e54129cb8 None admin] RBAC: Adding query filter params (interface=public, service_id=6d01b9af18f746a4a545ce8507a4f75e, region_id=RegionOne) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:00.147959 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e77283-194a-4eae-86fa-209e54129cb8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:00.148828 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de62b2b3-b32f-40be-ba90-d1b4387dd4f1 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:00.150490 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e77283-194a-4eae-86fa-209e54129cb8 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:00.151025 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de62b2b3-b32f-40be-ba90-d1b4387dd4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:00.151489 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de62b2b3-b32f-40be-ba90-d1b4387dd4f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:00.171689 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 389/781] 10.222.0.60 () {56 vars in 1251 bytes} [Sat Sep 24 19:38:59 2022] GET /identity/v3/endpoints?service_id=6d01b9af18f746a4a545ce8507a4f75e&interface=public®ion_id=RegionOne => generated 194 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:39:00.172207 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:00.177442 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de62b2b3-b32f-40be-ba90-d1b4387dd4f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:39:00.182945 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-de62b2b3-b32f-40be-ba90-d1b4387dd4f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:39:00.182945 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:00.182945 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:00.182945 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:00.182945 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:00.182945 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:00.182945 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:00.182945 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:00.182945 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:00.182945 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:00.182945 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:00.182945 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:00.182945 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:39:00.182945 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:39:00.182945 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:39:00.182945 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:39:00.189258 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:39:00.189258 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:39:00.189258 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:39:00.189258 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:39:00.189258 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:00.189258 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:00.189258 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:00.189258 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:00.189258 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:00.189258 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:00.189258 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:00.189258 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:00.189258 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:00.189258 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:00.189258 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:00.189258 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:00.190727 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:00.190727 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:00.190727 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:00.190727 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:00.190727 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:39:00.190727 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:39:00.190727 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:39:00.190727 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:39:00.190727 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:39:00.190727 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:39:00.190727 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:39:00.190727 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:39:00.190727 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 393/782] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Sep 24 19:38:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:39:00.191471 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e77283-194a-4eae-86fa-209e54129cb8 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:00.195468 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de62b2b3-b32f-40be-ba90-d1b4387dd4f1 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:00.312326 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e77283-194a-4eae-86fa-209e54129cb8 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:00.352933 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ee3ae-5b4e-45c8-bace-9d129dec370a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:00.354012 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ee3ae-5b4e-45c8-bace-9d129dec370a None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:00.354515 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ee3ae-5b4e-45c8-bace-9d129dec370a None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:00.354986 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ee3ae-5b4e-45c8-bace-9d129dec370a None admin] PATH_INFO: `/v3/services` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:00.355833 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ee3ae-5b4e-45c8-bace-9d129dec370a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:00.357462 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ee3ae-5b4e-45c8-bace-9d129dec370a None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:00.364038 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 390/783] 10.222.0.60 () {56 vars in 1087 bytes} [Sat Sep 24 19:39:00 2022] GET /identity/v3/services => generated 772 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:00.422058 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de62b2b3-b32f-40be-ba90-d1b4387dd4f1 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:00.486370 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8278d-d99e-4b10-bc06-ec52f91b9a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:00.487543 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8278d-d99e-4b10-bc06-ec52f91b9a46 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:00.487824 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8278d-d99e-4b10-bc06-ec52f91b9a46 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:00.488095 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8278d-d99e-4b10-bc06-ec52f91b9a46 None admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:00.488991 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac8278d-d99e-4b10-bc06-ec52f91b9a46 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:00.489295 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac8278d-d99e-4b10-bc06-ec52f91b9a46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:00.490764 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac8278d-d99e-4b10-bc06-ec52f91b9a46 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:00.501765 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 394/784] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Sep 24 19:39:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:39:00.508596 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ee3ae-5b4e-45c8-bace-9d129dec370a None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:00.563873 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:00.641226 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ee3ae-5b4e-45c8-bace-9d129dec370a None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:00.662496 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fab14c-d33f-4ae7-9afd-b5408046baa8 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:00.662830 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fab14c-d33f-4ae7-9afd-b5408046baa8 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:00.663054 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fab14c-d33f-4ae7-9afd-b5408046baa8 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:00.664665 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 395/785] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:39:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:39:00.671079 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9dea9-e8af-455b-bb01-f29b0bf4b773 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:00.671360 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9dea9-e8af-455b-bb01-f29b0bf4b773 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:00.671632 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9dea9-e8af-455b-bb01-f29b0bf4b773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:00.685448 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b3e437-b25a-429b-97a9-62bfc72f4901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:00.686130 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3e437-b25a-429b-97a9-62bfc72f4901 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:00.686409 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3e437-b25a-429b-97a9-62bfc72f4901 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:00.686681 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3e437-b25a-429b-97a9-62bfc72f4901 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:00.699445 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b3e437-b25a-429b-97a9-62bfc72f4901 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:00.701181 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b3e437-b25a-429b-97a9-62bfc72f4901 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:00.717246 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-43b3e437-b25a-429b-97a9-62bfc72f4901 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:39:00.717246 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:00.717246 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:00.717246 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:00.717246 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:00.717246 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:00.717246 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:00.717246 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:00.717246 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:00.717246 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:00.717246 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:00.717246 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:00.717246 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:39:00.717246 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:39:00.717246 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:39:00.717246 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:39:00.718353 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:00.718353 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:00.718353 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:00.718353 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:00.718353 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:00.718353 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:00.718353 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:00.718353 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:00.718353 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:00.718353 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:00.718353 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:00.718353 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:00.718353 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:00.718353 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:00.718353 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:00.718353 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:00.718353 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:39:00.719277 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:39:00.719277 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:39:00.719277 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:00.719277 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 391/786] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:39:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:39:00.720761 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-b8b9dea9-e8af-455b-bb01-f29b0bf4b773 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:39:00.722552 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-b8b9dea9-e8af-455b-bb01-f29b0bf4b773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:39:00.724454 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b3e437-b25a-429b-97a9-62bfc72f4901 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:00.838143 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:00.857217 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:00.866398 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b3e437-b25a-429b-97a9-62bfc72f4901 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:00.896727 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 396/787] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:39:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:39:00.906594 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7095aa76-914b-4143-a6ff-c80ec8f362dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:00.907730 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7095aa76-914b-4143-a6ff-c80ec8f362dc None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:00.908242 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7095aa76-914b-4143-a6ff-c80ec8f362dc None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:00.908614 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7095aa76-914b-4143-a6ff-c80ec8f362dc None admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:00.909380 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7095aa76-914b-4143-a6ff-c80ec8f362dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:00.909814 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7095aa76-914b-4143-a6ff-c80ec8f362dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:00.911214 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7095aa76-914b-4143-a6ff-c80ec8f362dc None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:00.924007 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 392/788] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:39:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:39:00.934122 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b9dea9-e8af-455b-bb01-f29b0bf4b773 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:01.070388 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b9dea9-e8af-455b-bb01-f29b0bf4b773 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:01.113598 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51815bb-0967-4b42-b6da-24654f5005b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:01.114247 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51815bb-0967-4b42-b6da-24654f5005b0 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:01.114521 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51815bb-0967-4b42-b6da-24654f5005b0 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:01.114788 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51815bb-0967-4b42-b6da-24654f5005b0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:01.127077 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51815bb-0967-4b42-b6da-24654f5005b0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:01.129224 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51815bb-0967-4b42-b6da-24654f5005b0 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:01.145915 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-b51815bb-0967-4b42-b6da-24654f5005b0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 24 19:39:01.145915 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:01.145915 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:01.145915 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:01.145915 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:01.145915 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:01.145915 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:01.145915 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:01.145915 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:01.145915 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:01.145915 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:01.145915 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:01.145915 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:39:01.145915 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:39:01.145915 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:39:01.145915 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:39:01.146940 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:01.146940 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:01.146940 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:39:01.146940 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:39:01.146940 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:39:01.146940 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:39:01.146940 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:01.146940 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:01.146940 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:01.146940 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:01.146940 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:01.146940 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:01.146940 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:01.146940 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:01.146940 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:01.146940 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:01.146940 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:01.146940 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:01.147896 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:01.147896 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:01.147896 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:39:01.147896 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:39:01.147896 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:39:01.147896 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:39:01.147896 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:39:01.147896 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:39:01.147896 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 24 19:39:01.147896 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:39:01.147896 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 397/789] 10.222.0.60 () {56 vars in 1093 bytes} [Sat Sep 24 19:39:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:39:01.157311 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7095aa76-914b-4143-a6ff-c80ec8f362dc None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:01.322747 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51815bb-0967-4b42-b6da-24654f5005b0 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:01.324437 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7095aa76-914b-4143-a6ff-c80ec8f362dc None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:01.369749 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6882e8-f689-4f58-8b89-d8a9219bb8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:01.370375 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6882e8-f689-4f58-8b89-d8a9219bb8e5 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:01.370649 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6882e8-f689-4f58-8b89-d8a9219bb8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:01.370918 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6882e8-f689-4f58-8b89-d8a9219bb8e5 None admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:01.371643 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6882e8-f689-4f58-8b89-d8a9219bb8e5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:01.371942 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6882e8-f689-4f58-8b89-d8a9219bb8e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:01.373770 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6882e8-f689-4f58-8b89-d8a9219bb8e5 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:01.393078 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:01.398658 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 393/790] 10.222.0.60 () {56 vars in 1133 bytes} [Sat Sep 24 19:39:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:01.400438 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d39eba-2548-4ad1-aec6-b43fdb755304 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:01.400724 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d39eba-2548-4ad1-aec6-b43fdb755304 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:01.400997 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d39eba-2548-4ad1-aec6-b43fdb755304 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:01.402698 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 394/791] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:39:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:39:01.406367 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d39eba-2548-4ad1-aec6-b43fdb755304 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:01.417372 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:01.478391 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51815bb-0967-4b42-b6da-24654f5005b0 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:01.523638 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d39eba-2548-4ad1-aec6-b43fdb755304 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:01.528263 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc773db-daa5-4fb3-ac53-144051bfaf7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:01.528927 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc773db-daa5-4fb3-ac53-144051bfaf7d None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:01.529207 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc773db-daa5-4fb3-ac53-144051bfaf7d None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:01.529479 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc773db-daa5-4fb3-ac53-144051bfaf7d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:01.545639 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc773db-daa5-4fb3-ac53-144051bfaf7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:39:01.553355 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-1dc773db-daa5-4fb3-ac53-144051bfaf7d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:39:01.553355 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:01.553355 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:01.553355 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:01.553355 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:01.553355 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:01.553355 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:01.553355 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:01.553355 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:01.553355 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:01.553355 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:01.553355 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:01.553355 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:39:01.553355 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:39:01.553355 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:39:01.553355 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:39:01.554949 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:39:01.554949 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:39:01.554949 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:39:01.554949 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:39:01.554949 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:01.554949 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:01.554949 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:01.554949 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:01.554949 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:01.554949 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:01.554949 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:01.554949 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:01.554949 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:01.554949 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:01.554949 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:01.554949 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:01.556195 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:01.556195 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:01.556195 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:01.556195 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:01.556195 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:39:01.556195 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:39:01.556195 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:39:01.556195 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:39:01.556195 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:39:01.556195 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:39:01.556195 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:39:01.556195 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:39:01.561517 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 398/792] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Sep 24 19:39:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:39:01.561517 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48928c9-2dd4-43ec-a752-d0d642d13ccf None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:01.561517 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48928c9-2dd4-43ec-a752-d0d642d13ccf None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:01.561517 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48928c9-2dd4-43ec-a752-d0d642d13ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:01.573728 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97a00cb-2668-4b5a-b3c0-c1a9d0b4aade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:01.574269 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a00cb-2668-4b5a-b3c0-c1a9d0b4aade None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:01.574545 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a00cb-2668-4b5a-b3c0-c1a9d0b4aade None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:01.574813 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a00cb-2668-4b5a-b3c0-c1a9d0b4aade None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:01.579118 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-a48928c9-2dd4-43ec-a752-d0d642d13ccf None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:39:01.580372 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-a48928c9-2dd4-43ec-a752-d0d642d13ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:39:01.651073 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:01.661521 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97a00cb-2668-4b5a-b3c0-c1a9d0b4aade None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:01.661521 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97a00cb-2668-4b5a-b3c0-c1a9d0b4aade None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:01.662531 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 399/793] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:39:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:39:01.663146 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48928c9-2dd4-43ec-a752-d0d642d13ccf None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:01.716628 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:01.781650 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48928c9-2dd4-43ec-a752-d0d642d13ccf None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:01.825237 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f404a7-0c16-45bc-8dfa-0a1addc3fe33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:01.826249 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f404a7-0c16-45bc-8dfa-0a1addc3fe33 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:01.826735 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f404a7-0c16-45bc-8dfa-0a1addc3fe33 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:01.827207 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f404a7-0c16-45bc-8dfa-0a1addc3fe33 None admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:01.828084 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f404a7-0c16-45bc-8dfa-0a1addc3fe33 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:01.828632 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f404a7-0c16-45bc-8dfa-0a1addc3fe33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:01.830236 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f404a7-0c16-45bc-8dfa-0a1addc3fe33 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:01.840618 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 400/794] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Sep 24 19:39:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:01.847949 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f404a7-0c16-45bc-8dfa-0a1addc3fe33 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:01.901324 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 395/795] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Sep 24 19:39:01 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 19:39:01.908060 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97a00cb-2668-4b5a-b3c0-c1a9d0b4aade None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:02.045731 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:02.049887 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97a00cb-2668-4b5a-b3c0-c1a9d0b4aade None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:02.061967 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f404a7-0c16-45bc-8dfa-0a1addc3fe33 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:02.064874 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:02.101158 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382fb5e-446f-47d4-a80c-51e97ec78b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:02.102006 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382fb5e-446f-47d4-a80c-51e97ec78b2f None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:02.102286 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382fb5e-446f-47d4-a80c-51e97ec78b2f None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:02.102559 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382fb5e-446f-47d4-a80c-51e97ec78b2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:02.113249 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36263af-d791-46b0-ba35-e735d16784f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:02.114330 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36263af-d791-46b0-ba35-e735d16784f3 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:02.115417 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36263af-d791-46b0-ba35-e735d16784f3 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:02.115924 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36263af-d791-46b0-ba35-e735d16784f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:02.117391 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9382fb5e-446f-47d4-a80c-51e97ec78b2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:02.119291 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9382fb5e-446f-47d4-a80c-51e97ec78b2f None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:02.130226 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36263af-d791-46b0-ba35-e735d16784f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:02.132462 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36263af-d791-46b0-ba35-e735d16784f3 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:02.139059 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-9382fb5e-446f-47d4-a80c-51e97ec78b2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:39:02.139059 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:02.139059 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:02.139059 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:02.139059 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:02.139059 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:02.139059 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:02.139059 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:02.139059 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:02.139059 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:02.139059 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:02.139059 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:02.139059 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:39:02.139059 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:39:02.139059 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:39:02.139059 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:39:02.140007 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:02.140007 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:02.140007 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:02.140007 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:02.140007 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:02.140007 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:02.140007 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:02.140007 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:02.140007 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:02.140007 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:02.140007 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:02.140007 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:02.140007 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:02.140007 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:02.140007 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:02.140007 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:02.140007 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:39:02.140908 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:39:02.140908 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:39:02.140908 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:02.145377 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 396/796] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:39:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:39:02.146570 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382fb5e-446f-47d4-a80c-51e97ec78b2f None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:02.155879 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-f36263af-d791-46b0-ba35-e735d16784f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:39:02.155879 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:02.155879 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:02.155879 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:02.155879 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:02.155879 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:02.155879 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:02.155879 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:02.155879 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:02.155879 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:02.155879 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:02.155879 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:02.155879 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:39:02.155879 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:39:02.155879 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:39:02.155879 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:39:02.156854 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:02.156854 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:02.156854 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:02.156854 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:02.156854 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:02.156854 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:02.156854 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:02.156854 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:02.156854 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:02.156854 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:02.156854 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:02.156854 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:02.156854 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:02.156854 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:02.156854 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:02.156854 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:02.156854 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:39:02.157794 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:39:02.157794 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:39:02.157794 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:39:02.161814 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 401/797] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:39:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:39:02.162915 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36263af-d791-46b0-ba35-e735d16784f3 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:02.293511 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36263af-d791-46b0-ba35-e735d16784f3 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:02.300012 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382fb5e-446f-47d4-a80c-51e97ec78b2f None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:02.333233 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1fb101-ad99-4d25-ac1c-ba544a9fe3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:02.334251 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1fb101-ad99-4d25-ac1c-ba544a9fe3da None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:02.334761 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1fb101-ad99-4d25-ac1c-ba544a9fe3da None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:02.335244 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1fb101-ad99-4d25-ac1c-ba544a9fe3da None admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:02.336091 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1fb101-ad99-4d25-ac1c-ba544a9fe3da None admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:02.336612 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1fb101-ad99-4d25-ac1c-ba544a9fe3da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:02.338214 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1fb101-ad99-4d25-ac1c-ba544a9fe3da None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:02.347268 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d007be54-02d3-45da-b1f2-5cc46230f219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:02.348023 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007be54-02d3-45da-b1f2-5cc46230f219 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:02.348304 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007be54-02d3-45da-b1f2-5cc46230f219 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:02.348576 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007be54-02d3-45da-b1f2-5cc46230f219 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:02.353016 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 402/798] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:39:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:02.354235 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1fb101-ad99-4d25-ac1c-ba544a9fe3da None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:02.374173 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d007be54-02d3-45da-b1f2-5cc46230f219 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:39:02.377875 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:02.381961 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-d007be54-02d3-45da-b1f2-5cc46230f219 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:39:02.381961 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:02.381961 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:02.381961 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:02.381961 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:02.381961 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:02.381961 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:02.381961 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:02.381961 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:02.381961 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:02.381961 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:02.381961 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:02.381961 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:39:02.381961 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:39:02.381961 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:39:02.381961 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:39:02.382991 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:39:02.382991 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:39:02.382991 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:39:02.382991 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:39:02.382991 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:02.382991 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:02.382991 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:02.382991 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:02.382991 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:02.382991 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:02.382991 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:02.382991 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:02.382991 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:02.382991 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:02.382991 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:02.382991 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:02.383823 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:02.383823 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:02.383823 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:02.383823 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:02.383823 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:39:02.383823 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:39:02.383823 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:39:02.383823 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:39:02.383823 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:39:02.383823 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:39:02.383823 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:39:02.383823 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:02.383823 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 397/799] 10.222.0.60 () {56 vars in 1102 bytes} [Sat Sep 24 19:39:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:39:02.384612 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d007be54-02d3-45da-b1f2-5cc46230f219 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:02.405295 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:02.508859 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d007be54-02d3-45da-b1f2-5cc46230f219 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:02.510245 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1fb101-ad99-4d25-ac1c-ba544a9fe3da None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:02.552250 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5336c8a4-ac59-4de1-8c1f-811867c8ed17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:02.552925 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336c8a4-ac59-4de1-8c1f-811867c8ed17 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:02.553207 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336c8a4-ac59-4de1-8c1f-811867c8ed17 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:02.553480 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336c8a4-ac59-4de1-8c1f-811867c8ed17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:02.554650 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f30fd8-1a3a-47ea-a0e7-e778c02b77ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:02.555444 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f30fd8-1a3a-47ea-a0e7-e778c02b77ab None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:02.555898 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f30fd8-1a3a-47ea-a0e7-e778c02b77ab None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:02.556322 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f30fd8-1a3a-47ea-a0e7-e778c02b77ab None admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:02.557126 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f30fd8-1a3a-47ea-a0e7-e778c02b77ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:02.557604 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f30fd8-1a3a-47ea-a0e7-e778c02b77ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:02.559126 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f30fd8-1a3a-47ea-a0e7-e778c02b77ab None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:02.561092 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5336c8a4-ac59-4de1-8c1f-811867c8ed17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:02.562571 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5336c8a4-ac59-4de1-8c1f-811867c8ed17 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:02.573156 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 403/800] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:39:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:02.574355 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f30fd8-1a3a-47ea-a0e7-e778c02b77ab None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:02.578580 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-5336c8a4-ac59-4de1-8c1f-811867c8ed17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:39:02.578580 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:02.578580 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:02.578580 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:02.578580 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:02.578580 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:02.578580 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:02.578580 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:02.578580 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:02.578580 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:02.578580 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:02.578580 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:02.578580 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:39:02.578580 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:39:02.578580 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:39:02.579689 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:39:02.579689 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:02.579689 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:02.579689 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:02.579689 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:02.579689 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:02.579689 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:02.579689 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:02.579689 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:02.579689 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:02.579689 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:02.579689 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:02.579689 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:02.579689 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:02.579689 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:02.579689 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:02.579689 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:02.582007 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:39:02.582007 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:39:02.582007 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:39:02.582007 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:39:02.582007 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:39:02.582007 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:39:02.582007 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:39:02.582007 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:02.582007 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 398/801] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Sep 24 19:39:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:39:02.582007 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527f4d6-85c2-442c-a3f1-a995f0616829 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:02.582007 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527f4d6-85c2-442c-a3f1-a995f0616829 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:02.582605 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527f4d6-85c2-442c-a3f1-a995f0616829 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:02.583515 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 399/802] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:39:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:39:02.584048 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5527f4d6-85c2-442c-a3f1-a995f0616829 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:02.669258 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:02.680984 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:02.706332 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5527f4d6-85c2-442c-a3f1-a995f0616829 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:02.708343 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f30fd8-1a3a-47ea-a0e7-e778c02b77ab None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:02.743218 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68292f41-326f-4317-b978-a9d5a8cf300c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:02.743850 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68292f41-326f-4317-b978-a9d5a8cf300c None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:02.744126 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68292f41-326f-4317-b978-a9d5a8cf300c None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:02.744391 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68292f41-326f-4317-b978-a9d5a8cf300c None admin] PATH_INFO: `/v3/users/swift` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:02.746944 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ebf3b4-61e3-4248-ae37-5ec1862314ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:02.747641 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ebf3b4-61e3-4248-ae37-5ec1862314ce None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:02.747865 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ebf3b4-61e3-4248-ae37-5ec1862314ce None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:02.748109 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ebf3b4-61e3-4248-ae37-5ec1862314ce None admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:02.748785 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ebf3b4-61e3-4248-ae37-5ec1862314ce None admin] RBAC: Adding query filter params (name=service) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:02.749258 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ebf3b4-61e3-4248-ae37-5ec1862314ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:02.751788 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ebf3b4-61e3-4248-ae37-5ec1862314ce None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:02.754103 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68292f41-326f-4317-b978-a9d5a8cf300c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:02.755414 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68292f41-326f-4317-b978-a9d5a8cf300c None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:02.767427 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-68292f41-326f-4317-b978-a9d5a8cf300c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 24 19:39:02.767427 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:02.767427 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:02.767427 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:02.767427 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:02.767427 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:02.767427 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:02.767427 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:02.767427 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:02.767427 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:02.767427 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:02.767427 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:02.767427 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:39:02.767427 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:39:02.767427 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:39:02.767427 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:39:02.768661 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:02.768661 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:02.768661 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:39:02.768661 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:39:02.768661 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:39:02.768661 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:39:02.768661 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:02.768661 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:02.768661 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:02.768661 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:02.768661 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:02.768661 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:02.768661 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:02.768661 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:02.768661 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:02.768661 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:02.768661 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:02.768661 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:02.769634 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:02.769634 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:02.769634 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:39:02.769634 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:39:02.769634 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:39:02.769634 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:39:02.769634 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:39:02.769634 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:39:02.769634 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 24 19:39:02.769634 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:02.776640 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 404/803] 10.222.0.60 () {56 vars in 1103 bytes} [Sat Sep 24 19:39:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:02.776640 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ebf3b4-61e3-4248-ae37-5ec1862314ce None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:02.776929 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 400/804] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Sep 24 19:39:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:39:02.776929 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd0d6e-f9a5-4a63-bc89-852468b7a1b8 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:02.776929 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd0d6e-f9a5-4a63-bc89-852468b7a1b8 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:02.776929 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd0d6e-f9a5-4a63-bc89-852468b7a1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:02.795344 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-bdbd0d6e-f9a5-4a63-bc89-852468b7a1b8 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:39:02.796578 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-bdbd0d6e-f9a5-4a63-bc89-852468b7a1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:39:02.876480 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 401/805] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:39:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:39:02.878293 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd0d6e-f9a5-4a63-bc89-852468b7a1b8 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:02.902226 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ebf3b4-61e3-4248-ae37-5ec1862314ce None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:02.943483 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a3fe2d-5339-4b72-ab03-e559fc93a772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:02.944145 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a3fe2d-5339-4b72-ab03-e559fc93a772 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:02.944424 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a3fe2d-5339-4b72-ab03-e559fc93a772 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:02.944724 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a3fe2d-5339-4b72-ab03-e559fc93a772 None admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:02.945426 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a3fe2d-5339-4b72-ab03-e559fc93a772 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:02.967575 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a3fe2d-5339-4b72-ab03-e559fc93a772 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:02.967575 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a3fe2d-5339-4b72-ab03-e559fc93a772 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:02.967575 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:02.967575 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 405/806] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Sep 24 19:39:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:02.967575 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a3fe2d-5339-4b72-ab03-e559fc93a772 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:02.976592 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:03.020564 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd0d6e-f9a5-4a63-bc89-852468b7a1b8 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:03.062665 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03ed3f-cd60-49fc-a601-8f79933bfbcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:03.063286 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03ed3f-cd60-49fc-a601-8f79933bfbcb None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:03.063567 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03ed3f-cd60-49fc-a601-8f79933bfbcb None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:03.063839 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03ed3f-cd60-49fc-a601-8f79933bfbcb None admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:03.064567 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f03ed3f-cd60-49fc-a601-8f79933bfbcb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:03.066600 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f03ed3f-cd60-49fc-a601-8f79933bfbcb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:03.068136 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f03ed3f-cd60-49fc-a601-8f79933bfbcb None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:03.075965 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a3fe2d-5339-4b72-ab03-e559fc93a772 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:03.088216 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 402/807] 10.222.0.60 () {56 vars in 1135 bytes} [Sat Sep 24 19:39:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:03.089462 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35351a-cbdb-4fd6-84a4-9b4b8869be3a None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:03.089789 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35351a-cbdb-4fd6-84a4-9b4b8869be3a None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:03.090045 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35351a-cbdb-4fd6-84a4-9b4b8869be3a None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:03.091414 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 403/808] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:39:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:39:03.091940 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35351a-cbdb-4fd6-84a4-9b4b8869be3a None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:03.123612 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34059f5-7822-4457-b754-b92328dbf75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:03.124252 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34059f5-7822-4457-b754-b92328dbf75f None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:03.124533 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34059f5-7822-4457-b754-b92328dbf75f None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:03.124804 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34059f5-7822-4457-b754-b92328dbf75f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:03.136227 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34059f5-7822-4457-b754-b92328dbf75f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:03.137968 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34059f5-7822-4457-b754-b92328dbf75f None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:03.154381 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-a34059f5-7822-4457-b754-b92328dbf75f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:39:03.154381 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:03.154381 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:03.154381 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:03.154381 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:03.154381 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:03.154381 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:03.154381 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:03.154381 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:03.154381 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:03.154381 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:03.154381 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:03.154381 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:39:03.154381 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:39:03.154381 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:39:03.154381 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:39:03.155360 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:03.155360 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:03.155360 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:03.155360 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:03.155360 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:03.155360 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:03.155360 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:03.155360 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:03.155360 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:03.155360 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:03.155360 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:03.155360 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:03.155360 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:03.155360 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:03.155360 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:03.155360 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:03.155360 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:39:03.156306 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:39:03.156306 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:39:03.156306 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:39:03.160961 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 406/809] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:39:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:39:03.161917 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34059f5-7822-4457-b754-b92328dbf75f None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:03.217763 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:03.224585 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35351a-cbdb-4fd6-84a4-9b4b8869be3a None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:03.246468 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:03.261748 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76879e03-60d6-43f9-812d-dd07b66b399e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:03.262350 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76879e03-60d6-43f9-812d-dd07b66b399e None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:03.262622 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76879e03-60d6-43f9-812d-dd07b66b399e None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:03.262886 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76879e03-60d6-43f9-812d-dd07b66b399e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:03.263607 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76879e03-60d6-43f9-812d-dd07b66b399e None admin] RBAC: Adding query filter params (role.id=f022705fa6ce43828345ef50b3f7efc9, scope.project.id=5c2da88af5714e619238772bde676a42, user.id=f3b5047a59bc4547be643ffa78808a6d) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:03.263906 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76879e03-60d6-43f9-812d-dd07b66b399e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:03.265338 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76879e03-60d6-43f9-812d-dd07b66b399e None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:03.274102 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34059f5-7822-4457-b754-b92328dbf75f None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:03.279086 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 404/810] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Sep 24 19:39:03 2022] GET /identity/v3/role_assignments?user.id=f3b5047a59bc4547be643ffa78808a6d&scope.project.id=5c2da88af5714e619238772bde676a42&role.id=f022705fa6ce43828345ef50b3f7efc9 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:03.280325 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec54de-7683-485a-b4c3-b1e9713b0cb8 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:03.280605 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec54de-7683-485a-b4c3-b1e9713b0cb8 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:03.280852 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec54de-7683-485a-b4c3-b1e9713b0cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:03.301974 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-28ec54de-7683-485a-b4c3-b1e9713b0cb8 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:39:03.303214 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-28ec54de-7683-485a-b4c3-b1e9713b0cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:39:03.331319 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e667ad7-717a-4c33-a354-5c4cc34ef260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:03.332245 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e667ad7-717a-4c33-a354-5c4cc34ef260 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:03.332636 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e667ad7-717a-4c33-a354-5c4cc34ef260 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:03.333041 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e667ad7-717a-4c33-a354-5c4cc34ef260 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:03.345441 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e667ad7-717a-4c33-a354-5c4cc34ef260 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:03.347821 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e667ad7-717a-4c33-a354-5c4cc34ef260 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:03.365866 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-3e667ad7-717a-4c33-a354-5c4cc34ef260 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:39:03.365866 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:03.365866 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:03.365866 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:03.365866 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:03.365866 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:03.365866 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:03.365866 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:03.365866 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:03.365866 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:03.365866 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:03.365866 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:03.365866 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:39:03.365866 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:39:03.365866 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:39:03.365866 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:39:03.366908 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:03.366908 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:03.366908 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:03.366908 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:03.366908 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:03.366908 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:03.366908 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:03.366908 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:03.366908 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:03.366908 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:03.366908 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:03.366908 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:03.366908 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:03.366908 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:03.366908 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:03.366908 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:03.366908 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:39:03.367783 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:39:03.367783 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:39:03.367783 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:39:03.367783 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 407/811] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:39:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:39:03.368007 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e667ad7-717a-4c33-a354-5c4cc34ef260 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:03.394747 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 405/812] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:39:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:39:03.395639 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec54de-7683-485a-b4c3-b1e9713b0cb8 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:03.520703 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:03.523525 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e667ad7-717a-4c33-a354-5c4cc34ef260 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:03.525328 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec54de-7683-485a-b4c3-b1e9713b0cb8 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:03.549308 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:03.571170 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3afc8a0-3a2a-4402-a7f0-a5fcac6e5a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:03.572159 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afc8a0-3a2a-4402-a7f0-a5fcac6e5a20 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:03.572674 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afc8a0-3a2a-4402-a7f0-a5fcac6e5a20 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:03.573163 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afc8a0-3a2a-4402-a7f0-a5fcac6e5a20 None admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:03.574108 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3afc8a0-3a2a-4402-a7f0-a5fcac6e5a20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:03.574491 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e4bfc-cdc4-49e9-ac98-d6854e16dd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:03.574894 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3afc8a0-3a2a-4402-a7f0-a5fcac6e5a20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:03.575133 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e4bfc-cdc4-49e9-ac98-d6854e16dd6e None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:03.575481 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e4bfc-cdc4-49e9-ac98-d6854e16dd6e None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:03.575837 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e4bfc-cdc4-49e9-ac98-d6854e16dd6e None admin] PATH_INFO: `/v3/services/network` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:03.576336 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929e4bfc-cdc4-49e9-ac98-d6854e16dd6e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:03.577577 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3afc8a0-3a2a-4402-a7f0-a5fcac6e5a20 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:03.577789 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929e4bfc-cdc4-49e9-ac98-d6854e16dd6e None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:03.588955 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-929e4bfc-cdc4-49e9-ac98-d6854e16dd6e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 24 19:39:03.588955 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:03.588955 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:39:03.588955 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:39:03.588955 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:39:03.588955 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:39:03.588955 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:39:03.588955 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:39:03.588955 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 24 19:39:03.588955 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:03.588955 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:39:03.588955 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:03.588955 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:03.588955 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:03.588955 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:03.588955 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:03.588955 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:03.590054 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:03.590054 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:03.590054 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:03.590054 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:03.590054 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:03.590054 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:03.590054 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:39:03.590054 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:39:03.590054 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:39:03.590054 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:39:03.590054 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:03.590054 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:03.590054 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:03.590054 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:03.590054 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:03.590054 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:03.596709 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:03.596709 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:03.596709 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:03.596709 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:03.596709 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:03.596709 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:03.596709 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:03.596709 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:03.596709 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:03.596709 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:03.596709 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:39:03.596709 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:39:03.596709 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 24 19:39:03.596709 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:03.596709 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 406/813] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Sep 24 19:39:03 2022] GET /identity/v3/services/network => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:39:03.597739 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e4bfc-cdc4-49e9-ac98-d6854e16dd6e None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:03.602833 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 408/814] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:39:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:03.603965 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3afc8a0-3a2a-4402-a7f0-a5fcac6e5a20 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:03.731872 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e4bfc-cdc4-49e9-ac98-d6854e16dd6e None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:03.740482 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3afc8a0-3a2a-4402-a7f0-a5fcac6e5a20 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:03.771394 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d33ed7-b715-491a-8bd3-86c1b7d7e385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:03.771924 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d33ed7-b715-491a-8bd3-86c1b7d7e385 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:03.772309 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d33ed7-b715-491a-8bd3-86c1b7d7e385 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:03.772577 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d33ed7-b715-491a-8bd3-86c1b7d7e385 None admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:03.773224 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d33ed7-b715-491a-8bd3-86c1b7d7e385 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:03.773543 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d33ed7-b715-491a-8bd3-86c1b7d7e385 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:03.774927 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d33ed7-b715-491a-8bd3-86c1b7d7e385 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:03.781736 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ba779-2bae-453e-9d1c-7c55f18cdabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:03.782879 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ba779-2bae-453e-9d1c-7c55f18cdabc None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:03.783166 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ba779-2bae-453e-9d1c-7c55f18cdabc None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:03.783513 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ba779-2bae-453e-9d1c-7c55f18cdabc None admin] PATH_INFO: `/v3/services` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:03.784263 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503ba779-2bae-453e-9d1c-7c55f18cdabc None admin] RBAC: Adding query filter params (name=network) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:03.784571 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503ba779-2bae-453e-9d1c-7c55f18cdabc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:03.786699 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503ba779-2bae-453e-9d1c-7c55f18cdabc None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:03.788609 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 407/815] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:39:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:03.789629 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d33ed7-b715-491a-8bd3-86c1b7d7e385 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:03.796200 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 409/816] 10.222.0.60 () {56 vars in 1112 bytes} [Sat Sep 24 19:39:03 2022] GET /identity/v3/services?name=network => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:03.797332 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ba779-2bae-453e-9d1c-7c55f18cdabc None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:03.836493 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:03.847597 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:03.917324 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d33ed7-b715-491a-8bd3-86c1b7d7e385 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:03.931494 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ba779-2bae-453e-9d1c-7c55f18cdabc None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:03.955909 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08616ba2-9ffe-42ae-bb1b-a3ad0c8f295c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:03.956544 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08616ba2-9ffe-42ae-bb1b-a3ad0c8f295c None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:03.956935 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08616ba2-9ffe-42ae-bb1b-a3ad0c8f295c None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:03.957088 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08616ba2-9ffe-42ae-bb1b-a3ad0c8f295c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:03.965197 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08616ba2-9ffe-42ae-bb1b-a3ad0c8f295c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:03.966737 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08616ba2-9ffe-42ae-bb1b-a3ad0c8f295c None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:03.975514 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38034263-75dd-4c85-829c-2a3432d0aa72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:03.977874 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38034263-75dd-4c85-829c-2a3432d0aa72 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:03.977874 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38034263-75dd-4c85-829c-2a3432d0aa72 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:03.977874 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38034263-75dd-4c85-829c-2a3432d0aa72 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:03.977874 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38034263-75dd-4c85-829c-2a3432d0aa72 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:03.978799 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38034263-75dd-4c85-829c-2a3432d0aa72 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:03.982000 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-08616ba2-9ffe-42ae-bb1b-a3ad0c8f295c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 24 19:39:03.982000 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:03.982000 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:03.982000 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:03.982000 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:03.982000 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:03.982000 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:03.982000 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:03.982000 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:03.982000 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:03.982000 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:03.982000 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:03.982000 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:39:03.982000 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:39:03.982000 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:39:03.982000 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:39:03.982900 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:03.982900 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:03.982900 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:39:03.982900 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:39:03.982900 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:39:03.982900 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:39:03.982900 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:03.982900 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:03.982900 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:03.982900 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:03.982900 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:03.982900 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:03.982900 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:03.982900 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:03.982900 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:03.982900 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:03.982900 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:03.982900 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:03.984201 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:03.984201 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:03.984201 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:39:03.984201 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:39:03.984201 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:39:03.984201 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:39:03.984201 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:39:03.984201 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:39:03.984201 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 24 19:39:03.984201 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:03.989186 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-38034263-75dd-4c85-829c-2a3432d0aa72 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 24 19:39:03.989186 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:03.989186 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:39:03.989186 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:39:03.989186 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:39:03.989186 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:39:03.989186 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:39:03.989186 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:39:03.989186 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 24 19:39:03.989186 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:39:03.989186 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:39:03.989186 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:39:03.989186 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:03.989186 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:03.989186 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:03.989186 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:03.989186 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:03.991790 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:03.991790 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:03.991790 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:03.991790 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:03.991790 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:03.991790 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:03.991790 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:39:03.991790 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:39:03.991790 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:39:03.991790 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:39:03.991790 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:03.991790 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:03.991790 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:03.991790 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:03.991790 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:03.991790 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:03.995012 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:03.995012 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:03.995012 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:03.995012 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:03.995012 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:03.995012 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:03.995012 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:03.995012 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:03.995012 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:03.995012 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:03.995012 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:39:03.995012 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:39:03.995012 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 24 19:39:03.995012 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:39:03.997149 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 408/817] 10.222.0.60 () {56 vars in 1117 bytes} [Sat Sep 24 19:39:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:39:03.997149 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08616ba2-9ffe-42ae-bb1b-a3ad0c8f295c None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:03.997518 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 410/818] 10.222.0.60 () {56 vars in 1129 bytes} [Sat Sep 24 19:39:03 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:39:03.997518 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38034263-75dd-4c85-829c-2a3432d0aa72 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:04.093776 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:04.106507 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38034263-75dd-4c85-829c-2a3432d0aa72 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:04.106718 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:04.112131 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08616ba2-9ffe-42ae-bb1b-a3ad0c8f295c None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:04.149822 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3015fc93-a48e-4e23-af28-d401c26aab6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:04.150435 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3015fc93-a48e-4e23-af28-d401c26aab6b None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:04.150718 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3015fc93-a48e-4e23-af28-d401c26aab6b None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:04.150999 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3015fc93-a48e-4e23-af28-d401c26aab6b None admin] PATH_INFO: `/v3/services` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:04.151626 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3015fc93-a48e-4e23-af28-d401c26aab6b None admin] RBAC: Adding query filter params (type=network) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:04.151930 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3015fc93-a48e-4e23-af28-d401c26aab6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:04.152975 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b8ea7-fcd1-4f99-9d04-019ff048b66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:04.153291 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3015fc93-a48e-4e23-af28-d401c26aab6b None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:04.153646 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b8ea7-fcd1-4f99-9d04-019ff048b66d None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:04.153926 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b8ea7-fcd1-4f99-9d04-019ff048b66d None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:04.154192 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b8ea7-fcd1-4f99-9d04-019ff048b66d None admin] PATH_INFO: `/v3/projects/service` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:04.164092 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 411/819] 10.222.0.60 () {56 vars in 1112 bytes} [Sat Sep 24 19:39:03 2022] GET /identity/v3/services?type=network => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:04.164092 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3015fc93-a48e-4e23-af28-d401c26aab6b None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:04.164366 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8b8ea7-fcd1-4f99-9d04-019ff048b66d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:04.164366 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8b8ea7-fcd1-4f99-9d04-019ff048b66d None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:04.176169 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-7a8b8ea7-fcd1-4f99-9d04-019ff048b66d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:39:04.176169 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:04.176169 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:04.176169 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:04.176169 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:04.176169 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:04.176169 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:04.176169 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:04.176169 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:04.176169 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:04.176169 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:04.176169 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:04.176169 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:39:04.176169 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:39:04.176169 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:39:04.177136 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:39:04.177136 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:04.177136 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:04.177136 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:04.177136 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:04.177136 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:04.177136 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:04.177136 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:04.177136 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:04.177136 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:04.177136 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:04.177136 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:04.177136 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:04.177136 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:04.177136 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:04.177136 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:04.177136 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:04.178061 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:39:04.178061 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:39:04.178061 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:39:04.178061 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:39:04.178061 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:39:04.178061 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:39:04.178061 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:39:04.178061 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:04.178061 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 409/820] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Sep 24 19:39:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:39:04.178542 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b8ea7-fcd1-4f99-9d04-019ff048b66d None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:04.293027 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b8ea7-fcd1-4f99-9d04-019ff048b66d None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:04.302783 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3015fc93-a48e-4e23-af28-d401c26aab6b None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:04.334246 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da9e64b-4a2f-48d1-adef-719efae12ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:04.334880 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da9e64b-4a2f-48d1-adef-719efae12ef2 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:04.335136 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da9e64b-4a2f-48d1-adef-719efae12ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:04.335408 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da9e64b-4a2f-48d1-adef-719efae12ef2 None admin] PATH_INFO: `/v3/services` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:04.336212 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da9e64b-4a2f-48d1-adef-719efae12ef2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:04.336520 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da9e64b-4a2f-48d1-adef-719efae12ef2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:04.338287 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da9e64b-4a2f-48d1-adef-719efae12ef2 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:04.342237 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa02a8d3-0265-43d7-9b32-8b73c46fc6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:04.343058 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02a8d3-0265-43d7-9b32-8b73c46fc6f8 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:04.343183 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 410/821] 10.222.0.60 () {56 vars in 1124 bytes} [Sat Sep 24 19:39:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:04.343612 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02a8d3-0265-43d7-9b32-8b73c46fc6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:04.343998 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da9e64b-4a2f-48d1-adef-719efae12ef2 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:04.344293 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02a8d3-0265-43d7-9b32-8b73c46fc6f8 None admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:04.345197 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa02a8d3-0265-43d7-9b32-8b73c46fc6f8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:04.345518 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa02a8d3-0265-43d7-9b32-8b73c46fc6f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:04.347023 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa02a8d3-0265-43d7-9b32-8b73c46fc6f8 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:04.368565 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 412/822] 10.222.0.60 () {56 vars in 1149 bytes} [Sat Sep 24 19:39:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:04.369414 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa02a8d3-0265-43d7-9b32-8b73c46fc6f8 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:04.381152 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:04.384049 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:04.473853 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da9e64b-4a2f-48d1-adef-719efae12ef2 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:04.479793 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa02a8d3-0265-43d7-9b32-8b73c46fc6f8 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:04.513640 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425072c3-ffc4-4bdf-a941-6339e373425b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:04.514263 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425072c3-ffc4-4bdf-a941-6339e373425b None admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:04.514546 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425072c3-ffc4-4bdf-a941-6339e373425b None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:04.514811 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425072c3-ffc4-4bdf-a941-6339e373425b None admin] PATH_INFO: `/v3/endpoints` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:04.515479 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425072c3-ffc4-4bdf-a941-6339e373425b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:04.516861 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425072c3-ffc4-4bdf-a941-6339e373425b None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:04.517154 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8920f6e-c54d-42ce-bd4d-a244dfd4dbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:04.518346 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8920f6e-c54d-42ce-bd4d-a244dfd4dbf8 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:04.518706 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8920f6e-c54d-42ce-bd4d-a244dfd4dbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:04.519234 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8920f6e-c54d-42ce-bd4d-a244dfd4dbf8 None admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:04.520087 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8920f6e-c54d-42ce-bd4d-a244dfd4dbf8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:04.520396 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8920f6e-c54d-42ce-bd4d-a244dfd4dbf8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:04.521847 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8920f6e-c54d-42ce-bd4d-a244dfd4dbf8 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:04.540041 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 413/823] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Sep 24 19:39:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:04.540894 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8920f6e-c54d-42ce-bd4d-a244dfd4dbf8 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:04.600656 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 411/824] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:39:04 2022] POST /identity/v3/endpoints => generated 337 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:39:04.606644 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425072c3-ffc4-4bdf-a941-6339e373425b None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:04.625667 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:04.677315 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8920f6e-c54d-42ce-bd4d-a244dfd4dbf8 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:04.744152 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:04.744530 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae3301-8d3a-4584-b78b-c6a18765ce32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:04.745378 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae3301-8d3a-4584-b78b-c6a18765ce32 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:04.746590 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae3301-8d3a-4584-b78b-c6a18765ce32 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:04.746875 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae3301-8d3a-4584-b78b-c6a18765ce32 None admin] PATH_INFO: `/v3/services` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:04.747532 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ae3301-8d3a-4584-b78b-c6a18765ce32 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:04.747866 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ae3301-8d3a-4584-b78b-c6a18765ce32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:04.757621 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ae3301-8d3a-4584-b78b-c6a18765ce32 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:04.757621 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 414/825] 10.222.0.60 () {56 vars in 1124 bytes} [Sat Sep 24 19:39:04 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:04.757621 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae3301-8d3a-4584-b78b-c6a18765ce32 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:04.787452 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425072c3-ffc4-4bdf-a941-6339e373425b None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:04.835615 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2905a1c4-51bd-4a43-8c4b-6f53c55cd2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:04.836268 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905a1c4-51bd-4a43-8c4b-6f53c55cd2e5 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:04.836544 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905a1c4-51bd-4a43-8c4b-6f53c55cd2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:04.836812 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905a1c4-51bd-4a43-8c4b-6f53c55cd2e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:04.851579 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2905a1c4-51bd-4a43-8c4b-6f53c55cd2e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:04.853542 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2905a1c4-51bd-4a43-8c4b-6f53c55cd2e5 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:04.876341 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-2905a1c4-51bd-4a43-8c4b-6f53c55cd2e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:39:04.876341 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:04.876341 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:04.876341 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:04.876341 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:04.876341 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:04.876341 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:04.876341 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:04.876341 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:04.876341 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:04.876341 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:04.876341 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:04.876341 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:39:04.876341 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:39:04.876341 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:39:04.876341 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:39:04.877480 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:04.877480 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:04.877480 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:04.877480 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:04.877480 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:04.877480 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:04.877480 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:04.877480 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:04.877480 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:04.877480 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:04.877480 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:04.877480 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:04.877480 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:04.877480 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:04.877480 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:04.877480 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:04.877480 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:39:04.878467 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:39:04.878467 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:39:04.878467 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:04.878467 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 412/826] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:39:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:39:04.879829 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2905a1c4-51bd-4a43-8c4b-6f53c55cd2e5 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:04.889896 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae3301-8d3a-4584-b78b-c6a18765ce32 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:04.937811 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:04.946446 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d4631-fdef-4b8d-88bd-d60497bb2e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:04.947483 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d4631-fdef-4b8d-88bd-d60497bb2e71 None admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:04.947965 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d4631-fdef-4b8d-88bd-d60497bb2e71 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:04.948462 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d4631-fdef-4b8d-88bd-d60497bb2e71 None admin] PATH_INFO: `/v3/projects/5c2da88af5714e619238772bde676a42/users/ebd94cd16acc45e6ac2997204297fb75/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:04.950751 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384d4631-fdef-4b8d-88bd-d60497bb2e71 None admin] RBAC: Authorizing `identity:create_grant(project_id=5c2da88af5714e619238772bde676a42, user_id=ebd94cd16acc45e6ac2997204297fb75, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:04.952484 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384d4631-fdef-4b8d-88bd-d60497bb2e71 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:05.003164 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2905a1c4-51bd-4a43-8c4b-6f53c55cd2e5 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:05.031429 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:05.037207 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c3bc08-3313-4a80-94a2-8d02af397452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:05.037900 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c3bc08-3313-4a80-94a2-8d02af397452 None admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:05.038184 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c3bc08-3313-4a80-94a2-8d02af397452 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:05.038451 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c3bc08-3313-4a80-94a2-8d02af397452 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:05.039124 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c3bc08-3313-4a80-94a2-8d02af397452 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:05.044645 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c3bc08-3313-4a80-94a2-8d02af397452 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:05.068765 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 415/827] 10.222.0.60 () {58 vars in 1439 bytes} [Sat Sep 24 19:39:04 2022] PUT /identity/v3/projects/5c2da88af5714e619238772bde676a42/users/ebd94cd16acc45e6ac2997204297fb75/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:39:05.069627 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d4631-fdef-4b8d-88bd-d60497bb2e71 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:05.142166 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 413/828] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:39:04 2022] POST /identity/v3/endpoints => generated 346 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:39:05.228283 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d4631-fdef-4b8d-88bd-d60497bb2e71 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:05.278963 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be46e8c-38f9-4e93-b29f-0dee04bd4154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:05.279929 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be46e8c-38f9-4e93-b29f-0dee04bd4154 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:05.280393 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be46e8c-38f9-4e93-b29f-0dee04bd4154 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:05.280850 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be46e8c-38f9-4e93-b29f-0dee04bd4154 None admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:05.281746 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be46e8c-38f9-4e93-b29f-0dee04bd4154 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:05.282362 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be46e8c-38f9-4e93-b29f-0dee04bd4154 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:05.284672 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be46e8c-38f9-4e93-b29f-0dee04bd4154 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:05.299997 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 416/829] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:39:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:05.306599 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c3bc08-3313-4a80-94a2-8d02af397452 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:05.434252 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c3bc08-3313-4a80-94a2-8d02af397452 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:05.476197 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea4e62b-a370-494d-b3cb-14fc7d5cfe77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:05.476844 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea4e62b-a370-494d-b3cb-14fc7d5cfe77 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:05.477199 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea4e62b-a370-494d-b3cb-14fc7d5cfe77 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:05.477473 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea4e62b-a370-494d-b3cb-14fc7d5cfe77 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:05.485042 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea4e62b-a370-494d-b3cb-14fc7d5cfe77 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:05.486689 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea4e62b-a370-494d-b3cb-14fc7d5cfe77 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:05.499626 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-7ea4e62b-a370-494d-b3cb-14fc7d5cfe77 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:39:05.499626 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:05.499626 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:05.499626 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:05.499626 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:05.499626 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:05.499626 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:05.499626 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:05.499626 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:05.499626 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:05.499626 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:05.499626 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:05.499626 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:39:05.499626 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:39:05.499626 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:39:05.500595 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:39:05.500595 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:05.500595 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:05.500595 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:05.500595 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:05.500595 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:05.500595 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:05.500595 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:05.500595 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:05.500595 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:05.500595 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:05.500595 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:05.500595 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:05.500595 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:05.500595 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:05.500595 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:05.500595 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:05.502597 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:39:05.502597 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:39:05.502597 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:39:05.502597 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:39:05.502597 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:39:05.502597 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:39:05.502597 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:39:05.502597 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:05.502597 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 414/830] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Sep 24 19:39:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:39:05.508676 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be46e8c-38f9-4e93-b29f-0dee04bd4154 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:05.568465 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:05.624611 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69f010-805a-4ba0-a6e4-0a47e32a9c36 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:05.624943 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69f010-805a-4ba0-a6e4-0a47e32a9c36 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:05.625173 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69f010-805a-4ba0-a6e4-0a47e32a9c36 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:05.628063 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 415/831] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:39:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:39:05.634027 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6eb2b5-9e33-4e09-b444-fb65a1d0daf7 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:05.634324 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6eb2b5-9e33-4e09-b444-fb65a1d0daf7 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:05.634602 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6eb2b5-9e33-4e09-b444-fb65a1d0daf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:05.636768 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be46e8c-38f9-4e93-b29f-0dee04bd4154 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:05.655705 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-bf6eb2b5-9e33-4e09-b444-fb65a1d0daf7 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:39:05.657020 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-bf6eb2b5-9e33-4e09-b444-fb65a1d0daf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:39:05.675577 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8004a7-243f-4666-86a0-1e4461504514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:05.678577 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8004a7-243f-4666-86a0-1e4461504514 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:05.679085 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8004a7-243f-4666-86a0-1e4461504514 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:05.679562 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8004a7-243f-4666-86a0-1e4461504514 None admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:05.680476 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8004a7-243f-4666-86a0-1e4461504514 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:05.680987 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8004a7-243f-4666-86a0-1e4461504514 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:05.682684 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8004a7-243f-4666-86a0-1e4461504514 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:05.697224 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 417/832] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Sep 24 19:39:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:05.702744 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8004a7-243f-4666-86a0-1e4461504514 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:05.716184 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:05.755532 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 416/833] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:39:05 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:39:05.822804 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8004a7-243f-4666-86a0-1e4461504514 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:05.831693 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:05.859963 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ed2896-f14b-48ed-b5ce-e3b0fce0b815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:05.860625 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed2896-f14b-48ed-b5ce-e3b0fce0b815 None admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:05.860901 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed2896-f14b-48ed-b5ce-e3b0fce0b815 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:05.861173 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed2896-f14b-48ed-b5ce-e3b0fce0b815 None admin] PATH_INFO: `/v3/projects/5c2da88af5714e619238772bde676a42/users/fd597f74abdf49288ea0d92642c6a5a2/roles/e9acf72f841f4030a76e8f9c41c95d7f` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:05.876898 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ed2896-f14b-48ed-b5ce-e3b0fce0b815 None admin] RBAC: Authorizing `identity:create_grant(project_id=5c2da88af5714e619238772bde676a42, user_id=fd597f74abdf49288ea0d92642c6a5a2, role_id=e9acf72f841f4030a76e8f9c41c95d7f)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:05.878951 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ed2896-f14b-48ed-b5ce-e3b0fce0b815 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:05.961408 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 418/834] 10.222.0.60 () {58 vars in 1439 bytes} [Sat Sep 24 19:39:05 2022] PUT /identity/v3/projects/5c2da88af5714e619238772bde676a42/users/fd597f74abdf49288ea0d92642c6a5a2/roles/e9acf72f841f4030a76e8f9c41c95d7f => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:39:06.052767 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6eb2b5-9e33-4e09-b444-fb65a1d0daf7 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:06.175413 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6eb2b5-9e33-4e09-b444-fb65a1d0daf7 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:06.214231 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1694dc3-59b0-43f3-8c43-92d8bd5a7ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:06.214797 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1694dc3-59b0-43f3-8c43-92d8bd5a7ab4 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:06.215156 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1694dc3-59b0-43f3-8c43-92d8bd5a7ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:06.215431 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1694dc3-59b0-43f3-8c43-92d8bd5a7ab4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:06.216018 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1694dc3-59b0-43f3-8c43-92d8bd5a7ab4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:06.217398 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1694dc3-59b0-43f3-8c43-92d8bd5a7ab4 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:06.227612 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-d1694dc3-59b0-43f3-8c43-92d8bd5a7ab4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 24 19:39:06.227612 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:06.227612 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:39:06.227612 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:39:06.227612 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:39:06.227612 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:39:06.227612 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:39:06.227612 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:39:06.227612 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 24 19:39:06.227612 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:06.227612 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:39:06.227612 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:06.227612 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:06.227612 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:06.227612 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:06.227612 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:06.228599 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:06.228599 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:06.228599 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:06.228599 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:06.228599 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:06.228599 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:06.228599 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:06.228599 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:39:06.228599 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:39:06.228599 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:39:06.228599 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:39:06.228599 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:06.228599 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:06.228599 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:06.228599 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:06.228599 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:06.228599 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:06.229523 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:06.229523 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:06.229523 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:06.229523 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:06.229523 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:06.229523 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:06.229523 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:06.229523 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:06.229523 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:06.229523 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:06.229523 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:39:06.229523 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:39:06.229523 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 24 19:39:06.229523 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:06.229523 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 417/835] 10.222.0.60 () {56 vars in 1132 bytes} [Sat Sep 24 19:39:06 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:39:06.235153 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ed2896-f14b-48ed-b5ce-e3b0fce0b815 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:06.345574 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ed2896-f14b-48ed-b5ce-e3b0fce0b815 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:06.387710 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c15d73d-c161-4fa1-a86b-03da70d45996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:06.388489 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15d73d-c161-4fa1-a86b-03da70d45996 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:06.388766 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15d73d-c161-4fa1-a86b-03da70d45996 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:06.389031 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15d73d-c161-4fa1-a86b-03da70d45996 None admin] PATH_INFO: `/v3/services` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:06.389693 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c15d73d-c161-4fa1-a86b-03da70d45996 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:06.389995 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c15d73d-c161-4fa1-a86b-03da70d45996 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:06.391348 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c15d73d-c161-4fa1-a86b-03da70d45996 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:06.396691 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 419/836] 10.222.0.60 () {56 vars in 1126 bytes} [Sat Sep 24 19:39:06 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:06.402077 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1694dc3-59b0-43f3-8c43-92d8bd5a7ab4 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:06.461906 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:06.513849 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1694dc3-59b0-43f3-8c43-92d8bd5a7ab4 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:06.551819 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae0476-f067-44ce-be7f-dc173d8dedb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:06.552451 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae0476-f067-44ce-be7f-dc173d8dedb4 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:06.552727 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae0476-f067-44ce-be7f-dc173d8dedb4 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:06.552997 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae0476-f067-44ce-be7f-dc173d8dedb4 None admin] PATH_INFO: `/v3/services` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:06.553663 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ae0476-f067-44ce-be7f-dc173d8dedb4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:06.553965 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ae0476-f067-44ce-be7f-dc173d8dedb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:06.555438 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ae0476-f067-44ce-be7f-dc173d8dedb4 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:06.561081 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 418/837] 10.222.0.60 () {56 vars in 1126 bytes} [Sat Sep 24 19:39:06 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:07.513224 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f7b34-52cf-4b6b-aba6-cd760fc0d8fd None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:07.513779 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f7b34-52cf-4b6b-aba6-cd760fc0d8fd None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:07.513779 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f7b34-52cf-4b6b-aba6-cd760fc0d8fd None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:07.515540 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 420/838] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:39:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:39:07.522132 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d335a4-047d-4d9e-8194-811877c4346c None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:07.522643 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d335a4-047d-4d9e-8194-811877c4346c None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:07.522728 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d335a4-047d-4d9e-8194-811877c4346c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:07.526991 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03bce6-688c-41e2-b028-5040bf4d6445 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:07.527554 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03bce6-688c-41e2-b028-5040bf4d6445 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:07.528079 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03bce6-688c-41e2-b028-5040bf4d6445 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:07.530110 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 421/839] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:39:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:39:07.536215 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48352ab2-cb0f-40df-96f2-0b3f58650740 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:07.536746 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48352ab2-cb0f-40df-96f2-0b3f58650740 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:07.537248 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48352ab2-cb0f-40df-96f2-0b3f58650740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:07.543379 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-04d335a4-047d-4d9e-8194-811877c4346c None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:39:07.544872 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-04d335a4-047d-4d9e-8194-811877c4346c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:39:07.556947 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-48352ab2-cb0f-40df-96f2-0b3f58650740 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:39:07.558463 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-48352ab2-cb0f-40df-96f2-0b3f58650740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:39:07.574645 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:07.633695 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 419/840] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:39:07 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:39:07.649514 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 422/841] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:39:07 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 19:39:07.912149 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d335a4-047d-4d9e-8194-811877c4346c None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:07.931219 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48352ab2-cb0f-40df-96f2-0b3f58650740 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:07.950522 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:08.030282 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d335a4-047d-4d9e-8194-811877c4346c None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:08.069165 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a5b94-c64e-4778-8431-4c2a0a5c0a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:08.069938 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a5b94-c64e-4778-8431-4c2a0a5c0a79 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:08.070282 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a5b94-c64e-4778-8431-4c2a0a5c0a79 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:08.070619 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a5b94-c64e-4778-8431-4c2a0a5c0a79 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:08.086429 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71a5b94-c64e-4778-8431-4c2a0a5c0a79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:39:08.088901 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48352ab2-cb0f-40df-96f2-0b3f58650740 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:08.093327 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-e71a5b94-c64e-4778-8431-4c2a0a5c0a79 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:39:08.093327 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:08.093327 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:08.093327 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:08.093327 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:08.093327 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:08.093327 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:08.093327 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:08.093327 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:08.093327 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:08.093327 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:08.093327 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:08.093327 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:39:08.093327 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:39:08.093327 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:39:08.093327 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:39:08.094326 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:39:08.094326 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:39:08.094326 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:39:08.094326 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:39:08.094326 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:08.094326 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:08.094326 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:08.094326 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:08.094326 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:08.094326 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:08.094326 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:08.094326 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:08.094326 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:08.094326 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:08.094326 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:08.094326 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:08.095146 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:08.095146 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:08.095146 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:08.095146 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:08.095146 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:39:08.095146 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:39:08.095146 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:39:08.095146 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:39:08.095146 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:39:08.095146 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:39:08.095146 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:39:08.095146 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:08.099510 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 420/842] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Sep 24 19:39:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:39:08.106545 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a5b94-c64e-4778-8431-4c2a0a5c0a79 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:08.131995 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71487f0-c5ff-484e-b79b-c6398a41f762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:08.133010 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71487f0-c5ff-484e-b79b-c6398a41f762 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:08.133518 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71487f0-c5ff-484e-b79b-c6398a41f762 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:08.134028 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71487f0-c5ff-484e-b79b-c6398a41f762 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:08.134827 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71487f0-c5ff-484e-b79b-c6398a41f762 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:08.136408 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71487f0-c5ff-484e-b79b-c6398a41f762 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:08.146103 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-f71487f0-c5ff-484e-b79b-c6398a41f762 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 24 19:39:08.146103 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:08.146103 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:39:08.146103 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:39:08.146103 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:39:08.146103 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:39:08.146103 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:39:08.146103 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:39:08.146103 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 24 19:39:08.146103 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:39:08.146103 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:39:08.146103 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:39:08.146103 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:08.146103 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:08.146103 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:08.146103 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:08.146103 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:08.147163 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:08.147163 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:08.147163 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:08.147163 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:08.147163 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:08.147163 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:08.147163 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:39:08.147163 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:39:08.147163 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:39:08.147163 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:39:08.147163 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:08.147163 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:08.147163 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:08.147163 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:08.147163 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:08.147163 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:08.147990 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:08.147990 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:08.147990 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:08.147990 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:08.147990 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:08.147990 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:08.147990 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:08.147990 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:08.147990 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:08.147990 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:08.147990 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:39:08.147990 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:39:08.147990 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 24 19:39:08.147990 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:39:08.150868 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 423/843] 10.222.0.60 () {56 vars in 1114 bytes} [Sat Sep 24 19:39:07 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:39:08.157891 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71487f0-c5ff-484e-b79b-c6398a41f762 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:08.179785 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:08.232481 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:08.242263 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a5b94-c64e-4778-8431-4c2a0a5c0a79 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:08.287265 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71487f0-c5ff-484e-b79b-c6398a41f762 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:08.295320 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef6b05-0a9c-4b1e-93db-432a1183093b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:08.296708 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef6b05-0a9c-4b1e-93db-432a1183093b None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:08.297087 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef6b05-0a9c-4b1e-93db-432a1183093b None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:08.297455 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef6b05-0a9c-4b1e-93db-432a1183093b None admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:08.298252 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eef6b05-0a9c-4b1e-93db-432a1183093b None admin] RBAC: Adding query filter params (name=admin) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:08.298649 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eef6b05-0a9c-4b1e-93db-432a1183093b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:08.301169 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eef6b05-0a9c-4b1e-93db-432a1183093b None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:08.315916 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 421/844] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Sep 24 19:39:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:08.317378 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb5f743-aae4-4d21-9818-4913a43be84b None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:08.317868 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb5f743-aae4-4d21-9818-4913a43be84b None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:08.318211 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb5f743-aae4-4d21-9818-4913a43be84b None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:08.319818 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 422/845] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:39:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:39:08.322405 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb5f743-aae4-4d21-9818-4913a43be84b None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:08.328703 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5083b9-c542-48ca-9c34-956a9ab6a7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:08.329364 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5083b9-c542-48ca-9c34-956a9ab6a7ce None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:08.329690 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5083b9-c542-48ca-9c34-956a9ab6a7ce None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:08.329971 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5083b9-c542-48ca-9c34-956a9ab6a7ce None admin] PATH_INFO: `/v3/services` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:08.331162 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5083b9-c542-48ca-9c34-956a9ab6a7ce None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:08.331463 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5083b9-c542-48ca-9c34-956a9ab6a7ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:08.332850 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5083b9-c542-48ca-9c34-956a9ab6a7ce None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:08.338251 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 424/846] 10.222.0.60 () {56 vars in 1114 bytes} [Sat Sep 24 19:39:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:39:08.340556 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e3f7b-807b-4f2a-bdbd-50fd1c4b73a0 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:08.340556 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e3f7b-807b-4f2a-bdbd-50fd1c4b73a0 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:08.340556 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e3f7b-807b-4f2a-bdbd-50fd1c4b73a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:08.358876 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-f24e3f7b-807b-4f2a-bdbd-50fd1c4b73a0 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:39:08.360003 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-f24e3f7b-807b-4f2a-bdbd-50fd1c4b73a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:39:08.439068 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 425/847] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:39:08 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:39:08.439068 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e3f7b-807b-4f2a-bdbd-50fd1c4b73a0 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:08.453093 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:08.457420 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb5f743-aae4-4d21-9818-4913a43be84b None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:08.503514 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f349a9e-d151-41dc-8ed0-79ef46fe7d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:08.505043 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f349a9e-d151-41dc-8ed0-79ef46fe7d67 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:08.505716 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f349a9e-d151-41dc-8ed0-79ef46fe7d67 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:08.506664 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f349a9e-d151-41dc-8ed0-79ef46fe7d67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:08.525806 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f349a9e-d151-41dc-8ed0-79ef46fe7d67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:08.529703 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f349a9e-d151-41dc-8ed0-79ef46fe7d67 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:08.551364 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-1f349a9e-d151-41dc-8ed0-79ef46fe7d67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:39:08.551364 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:08.551364 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:08.551364 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:08.551364 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:08.551364 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:08.551364 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:08.551364 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:08.551364 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:08.551364 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:08.551364 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:08.551364 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:08.551364 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:39:08.551364 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:39:08.551364 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:39:08.551364 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:39:08.552583 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:08.552583 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:08.552583 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:08.552583 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:08.552583 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:08.552583 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:08.552583 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:08.552583 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:08.552583 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:08.552583 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:08.552583 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:08.552583 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:08.552583 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:08.552583 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:08.552583 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:08.552583 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:08.552583 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:39:08.553716 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:39:08.553716 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:39:08.553716 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:08.555942 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 423/848] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:39:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:39:08.562454 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f349a9e-d151-41dc-8ed0-79ef46fe7d67 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:08.575074 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:08.581212 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e3f7b-807b-4f2a-bdbd-50fd1c4b73a0 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:08.621305 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e424f82c-cb14-4719-9216-857fb94258f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:08.622277 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e424f82c-cb14-4719-9216-857fb94258f0 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:08.622841 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e424f82c-cb14-4719-9216-857fb94258f0 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:08.623295 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e424f82c-cb14-4719-9216-857fb94258f0 None admin] PATH_INFO: `/v3/services` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:08.624211 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e424f82c-cb14-4719-9216-857fb94258f0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:08.624696 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e424f82c-cb14-4719-9216-857fb94258f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:08.626464 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e424f82c-cb14-4719-9216-857fb94258f0 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:08.633107 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 426/849] 10.222.0.60 () {56 vars in 1114 bytes} [Sat Sep 24 19:39:08 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:08.685857 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f349a9e-d151-41dc-8ed0-79ef46fe7d67 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:08.723690 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e424f82c-cb14-4719-9216-857fb94258f0 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:08.730181 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b4350-f9fb-4fc9-8eb9-5fb896d4cb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:08.730812 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b4350-f9fb-4fc9-8eb9-5fb896d4cb6b None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:08.731086 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b4350-f9fb-4fc9-8eb9-5fb896d4cb6b None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:08.731355 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b4350-f9fb-4fc9-8eb9-5fb896d4cb6b None admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:08.732022 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4b4350-f9fb-4fc9-8eb9-5fb896d4cb6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:08.732321 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4b4350-f9fb-4fc9-8eb9-5fb896d4cb6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:08.733772 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4b4350-f9fb-4fc9-8eb9-5fb896d4cb6b None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:08.750327 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 424/850] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:39:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:08.756912 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b4350-f9fb-4fc9-8eb9-5fb896d4cb6b None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:08.834671 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:08.861032 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:08.875647 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e424f82c-cb14-4719-9216-857fb94258f0 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:08.900849 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b4350-f9fb-4fc9-8eb9-5fb896d4cb6b None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:08.914648 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958fab6c-0e42-4fdf-b828-6f203f39247b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:08.915397 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958fab6c-0e42-4fdf-b828-6f203f39247b None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:08.915682 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958fab6c-0e42-4fdf-b828-6f203f39247b None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:08.915955 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958fab6c-0e42-4fdf-b828-6f203f39247b None admin] PATH_INFO: `/v3/roles/service` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:08.927695 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958fab6c-0e42-4fdf-b828-6f203f39247b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:39:08.933209 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-958fab6c-0e42-4fdf-b828-6f203f39247b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:39:08.933209 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:08.933209 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:08.933209 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:08.933209 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:08.933209 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:08.933209 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:08.933209 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:08.933209 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:08.933209 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:08.933209 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:08.933209 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:08.933209 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:39:08.933209 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:39:08.933209 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:39:08.933209 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:39:08.934350 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:39:08.934350 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:39:08.934350 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:39:08.934350 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:39:08.934350 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:08.934350 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:08.934350 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:08.934350 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:08.934350 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:08.934350 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:08.934350 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:08.934350 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:08.934350 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:08.934350 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:08.934350 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:08.934350 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:08.935483 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:08.935483 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:08.935483 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:08.935483 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:08.935483 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:39:08.935483 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:39:08.935483 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:39:08.935483 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:39:08.935483 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:39:08.935483 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:39:08.935483 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:39:08.935483 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:39:08.935483 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 427/851] 10.222.0.60 () {56 vars in 1102 bytes} [Sat Sep 24 19:39:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:39:08.936335 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ad419-ce81-49f2-8416-d22aef69e4c1 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:08.936335 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ad419-ce81-49f2-8416-d22aef69e4c1 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:08.936335 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ad419-ce81-49f2-8416-d22aef69e4c1 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:08.937481 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 428/852] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:39:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:39:08.940682 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ad419-ce81-49f2-8416-d22aef69e4c1 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:08.958399 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2539ed-1439-44ea-9ad5-3f77670f3049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:08.959443 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2539ed-1439-44ea-9ad5-3f77670f3049 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:08.959900 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2539ed-1439-44ea-9ad5-3f77670f3049 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:08.960346 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2539ed-1439-44ea-9ad5-3f77670f3049 None admin] PATH_INFO: `/v3/users/swift` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:08.969621 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2539ed-1439-44ea-9ad5-3f77670f3049 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:08.971494 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2539ed-1439-44ea-9ad5-3f77670f3049 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:08.985323 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-0f2539ed-1439-44ea-9ad5-3f77670f3049 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 24 19:39:08.985323 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:08.985323 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:08.985323 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:08.985323 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:08.985323 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:08.985323 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:08.985323 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:08.985323 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:08.985323 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:08.985323 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:08.985323 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:08.985323 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:39:08.985323 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:39:08.985323 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:39:08.985323 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:39:08.986466 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:08.986466 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:08.986466 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:39:08.986466 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:39:08.986466 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:39:08.986466 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:39:08.986466 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:08.986466 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:08.986466 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:08.986466 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:08.986466 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:08.986466 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:08.986466 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:08.986466 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:08.986466 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:08.986466 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:08.986466 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:08.986466 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:08.987556 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:08.987556 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:08.987556 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:39:08.987556 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:39:08.987556 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:39:08.987556 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:39:08.987556 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:39:08.987556 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:39:08.987556 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 24 19:39:08.987556 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:08.987556 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 425/853] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Sep 24 19:39:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:39:08.988862 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997c83f-0282-4919-8b26-43ec5ed69763 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:08.988862 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997c83f-0282-4919-8b26-43ec5ed69763 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:08.988862 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997c83f-0282-4919-8b26-43ec5ed69763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:09.008744 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-e997c83f-0282-4919-8b26-43ec5ed69763 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:39:09.009979 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-e997c83f-0282-4919-8b26-43ec5ed69763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:39:09.077735 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ad419-ce81-49f2-8416-d22aef69e4c1 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:09.086178 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 426/854] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:39:08 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:39:09.087027 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e997c83f-0282-4919-8b26-43ec5ed69763 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:09.121674 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:09.130253 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d198696-ceed-4e90-a8dd-6e4c412ec56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:09.130871 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d198696-ceed-4e90-a8dd-6e4c412ec56b None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:09.131147 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d198696-ceed-4e90-a8dd-6e4c412ec56b None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:09.135455 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d198696-ceed-4e90-a8dd-6e4c412ec56b None admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:09.135455 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d198696-ceed-4e90-a8dd-6e4c412ec56b None admin] RBAC: Adding query filter params (name=service) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:09.135455 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d198696-ceed-4e90-a8dd-6e4c412ec56b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:09.135455 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d198696-ceed-4e90-a8dd-6e4c412ec56b None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:09.149539 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 429/855] 10.222.0.60 () {56 vars in 1103 bytes} [Sat Sep 24 19:39:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:09.152987 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d198696-ceed-4e90-a8dd-6e4c412ec56b None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:09.194572 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:09.238705 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e997c83f-0282-4919-8b26-43ec5ed69763 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:09.277482 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c17c11-91a6-4ac7-8e58-6970e2165696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:09.278276 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c17c11-91a6-4ac7-8e58-6970e2165696 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:09.278657 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c17c11-91a6-4ac7-8e58-6970e2165696 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:09.279033 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c17c11-91a6-4ac7-8e58-6970e2165696 None admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:09.279996 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c17c11-91a6-4ac7-8e58-6970e2165696 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:09.280390 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c17c11-91a6-4ac7-8e58-6970e2165696 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:09.282115 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c17c11-91a6-4ac7-8e58-6970e2165696 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:09.285077 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d198696-ceed-4e90-a8dd-6e4c412ec56b None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:09.307686 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 427/856] 10.222.0.60 () {56 vars in 1135 bytes} [Sat Sep 24 19:39:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:09.308841 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c17c11-91a6-4ac7-8e58-6970e2165696 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:09.333740 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f04a4b5-0eb3-4bfe-89f3-31d8041c31dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:09.335101 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04a4b5-0eb3-4bfe-89f3-31d8041c31dc None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:09.335703 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04a4b5-0eb3-4bfe-89f3-31d8041c31dc None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:09.336160 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04a4b5-0eb3-4bfe-89f3-31d8041c31dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:09.350943 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f04a4b5-0eb3-4bfe-89f3-31d8041c31dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:09.352686 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f04a4b5-0eb3-4bfe-89f3-31d8041c31dc None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:09.369650 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-5f04a4b5-0eb3-4bfe-89f3-31d8041c31dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:39:09.369650 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:09.369650 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:09.369650 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:09.369650 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:09.369650 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:09.369650 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:09.369650 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:09.369650 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:09.369650 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:09.369650 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:09.369650 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:09.369650 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:39:09.369650 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:39:09.369650 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:39:09.369650 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:39:09.370690 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:09.370690 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:09.370690 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:09.370690 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:09.370690 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:09.370690 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:09.370690 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:09.370690 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:09.370690 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:09.370690 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:09.370690 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:09.370690 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:09.370690 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:09.370690 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:09.370690 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:09.370690 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:09.370690 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:39:09.371623 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:39:09.371623 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:39:09.371623 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:39:09.373379 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 430/857] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:39:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:39:09.374344 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f04a4b5-0eb3-4bfe-89f3-31d8041c31dc None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:09.422986 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c17c11-91a6-4ac7-8e58-6970e2165696 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:09.433843 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:09.450818 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:09.467002 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd2640-0510-44cd-972e-783125a24747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:09.467612 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd2640-0510-44cd-972e-783125a24747 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:09.467925 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd2640-0510-44cd-972e-783125a24747 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:09.468400 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd2640-0510-44cd-972e-783125a24747 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:09.498733 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f04a4b5-0eb3-4bfe-89f3-31d8041c31dc None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:09.535835 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d0cba-d59f-4d0e-b996-001b2ff41617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:09.536464 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d0cba-d59f-4d0e-b996-001b2ff41617 None admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:09.536731 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d0cba-d59f-4d0e-b996-001b2ff41617 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:09.537000 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d0cba-d59f-4d0e-b996-001b2ff41617 None admin] PATH_INFO: `/v3/services` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:09.537750 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24d0cba-d59f-4d0e-b996-001b2ff41617 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:09.539125 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24d0cba-d59f-4d0e-b996-001b2ff41617 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:09.553249 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdd2640-0510-44cd-972e-783125a24747 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:09.558654 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdd2640-0510-44cd-972e-783125a24747 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:09.624865 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 431/858] 10.222.0.60 () {60 vars in 1141 bytes} [Sat Sep 24 19:39:09 2022] POST /identity/v3/services => generated 269 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:39:09.626556 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d0cba-d59f-4d0e-b996-001b2ff41617 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:09.682829 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 428/859] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Sep 24 19:39:09 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 19:39:09.694353 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd2640-0510-44cd-972e-783125a24747 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:09.713058 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:09.777884 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d0cba-d59f-4d0e-b996-001b2ff41617 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:09.779736 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:09.819511 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd2640-0510-44cd-972e-783125a24747 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:09.820135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c1787-fabb-47cb-8bec-f7b5d2217152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:09.820895 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c1787-fabb-47cb-8bec-f7b5d2217152 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:09.821270 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c1787-fabb-47cb-8bec-f7b5d2217152 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:09.821679 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c1787-fabb-47cb-8bec-f7b5d2217152 None admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:09.822548 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518c1787-fabb-47cb-8bec-f7b5d2217152 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:09.823017 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518c1787-fabb-47cb-8bec-f7b5d2217152 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:09.824677 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518c1787-fabb-47cb-8bec-f7b5d2217152 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:09.842349 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 432/860] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:39:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:09.845571 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c1787-fabb-47cb-8bec-f7b5d2217152 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:09.875440 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e3f7b5-6aa2-47d4-86ac-0095e250b9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:09.876275 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e3f7b5-6aa2-47d4-86ac-0095e250b9f8 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:09.876545 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e3f7b5-6aa2-47d4-86ac-0095e250b9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:09.877405 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e3f7b5-6aa2-47d4-86ac-0095e250b9f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:09.893433 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e3f7b5-6aa2-47d4-86ac-0095e250b9f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:09.896538 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e3f7b5-6aa2-47d4-86ac-0095e250b9f8 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:09.914788 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-89e3f7b5-6aa2-47d4-86ac-0095e250b9f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:39:09.914788 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:09.914788 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:09.914788 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:09.914788 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:09.914788 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:09.914788 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:09.914788 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:09.914788 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:09.914788 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:09.914788 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:09.914788 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:09.914788 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:39:09.914788 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:39:09.914788 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:39:09.914788 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:39:09.915802 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:09.915802 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:09.915802 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:09.915802 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:09.915802 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:09.915802 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:09.915802 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:09.915802 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:09.915802 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:09.915802 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:09.915802 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:09.915802 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:09.915802 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:09.915802 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:09.915802 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:09.915802 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:09.915802 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:39:09.916680 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:39:09.916680 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:39:09.916680 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:09.916680 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 429/861] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:39:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:39:09.923335 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e3f7b5-6aa2-47d4-86ac-0095e250b9f8 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:09.994597 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c1787-fabb-47cb-8bec-f7b5d2217152 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:10.002758 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:10.035776 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ead802-aa04-4fcb-b488-a0d669ea4eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:10.036348 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ead802-aa04-4fcb-b488-a0d669ea4eb6 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:10.036542 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ead802-aa04-4fcb-b488-a0d669ea4eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:10.036814 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ead802-aa04-4fcb-b488-a0d669ea4eb6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:10.048875 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ead802-aa04-4fcb-b488-a0d669ea4eb6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:10.050089 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e3f7b5-6aa2-47d4-86ac-0095e250b9f8 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:10.050762 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ead802-aa04-4fcb-b488-a0d669ea4eb6 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:10.067598 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-97ead802-aa04-4fcb-b488-a0d669ea4eb6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 24 19:39:10.067598 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:10.067598 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:10.067598 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:10.067598 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:10.067598 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:10.067598 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:10.067598 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:10.067598 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:10.067598 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:10.067598 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:10.067598 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:10.067598 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:39:10.067598 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:39:10.067598 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:39:10.067598 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:39:10.068594 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:10.068594 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:10.068594 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:39:10.068594 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:39:10.068594 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:39:10.068594 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:39:10.068594 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:10.068594 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:10.068594 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:10.068594 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:10.068594 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:10.068594 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:10.068594 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:10.068594 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:10.068594 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:10.068594 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:10.068594 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:10.068594 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:10.069979 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:10.069979 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:10.069979 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:39:10.069979 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:39:10.069979 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:39:10.069979 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:39:10.069979 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:39:10.069979 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:39:10.069979 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 24 19:39:10.069979 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:39:10.073963 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 433/862] 10.222.0.60 () {56 vars in 1117 bytes} [Sat Sep 24 19:39:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:39:10.075283 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ead802-aa04-4fcb-b488-a0d669ea4eb6 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:10.096752 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c568e3-4860-43d2-b139-b03aa9eb0ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:10.097700 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c568e3-4860-43d2-b139-b03aa9eb0ce0 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:10.098474 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c568e3-4860-43d2-b139-b03aa9eb0ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:10.098909 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c568e3-4860-43d2-b139-b03aa9eb0ce0 None admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:10.099709 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c568e3-4860-43d2-b139-b03aa9eb0ce0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:10.100153 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c568e3-4860-43d2-b139-b03aa9eb0ce0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:10.102238 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c568e3-4860-43d2-b139-b03aa9eb0ce0 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:10.117866 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:10.125529 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 430/863] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:39:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:10.126523 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c568e3-4860-43d2-b139-b03aa9eb0ce0 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:10.201225 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ead802-aa04-4fcb-b488-a0d669ea4eb6 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:10.248875 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd05f70-8f99-4238-9f06-a6751b9bae75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:10.250134 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd05f70-8f99-4238-9f06-a6751b9bae75 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:10.250657 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd05f70-8f99-4238-9f06-a6751b9bae75 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:10.251429 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd05f70-8f99-4238-9f06-a6751b9bae75 None admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:10.253238 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd05f70-8f99-4238-9f06-a6751b9bae75 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:10.253823 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd05f70-8f99-4238-9f06-a6751b9bae75 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:10.255938 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd05f70-8f99-4238-9f06-a6751b9bae75 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:10.257337 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c568e3-4860-43d2-b139-b03aa9eb0ce0 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:10.283442 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 434/864] 10.222.0.60 () {56 vars in 1149 bytes} [Sat Sep 24 19:39:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:39:10.285110 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd05f70-8f99-4238-9f06-a6751b9bae75 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:10.296130 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:10.318064 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a65f2-e41f-4e6d-bba6-c23289d0c4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:10.318064 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a65f2-e41f-4e6d-bba6-c23289d0c4f2 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:10.318064 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a65f2-e41f-4e6d-bba6-c23289d0c4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:10.318064 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a65f2-e41f-4e6d-bba6-c23289d0c4f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:10.330919 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365a65f2-e41f-4e6d-bba6-c23289d0c4f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:10.332333 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365a65f2-e41f-4e6d-bba6-c23289d0c4f2 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:10.344281 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-365a65f2-e41f-4e6d-bba6-c23289d0c4f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:39:10.344281 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:10.344281 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:10.344281 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:10.344281 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:10.344281 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:10.344281 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:10.344281 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:10.344281 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:10.344281 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:10.344281 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:10.344281 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:10.344281 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:39:10.344281 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:39:10.344281 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:39:10.345639 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:39:10.345639 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:10.345639 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:10.345639 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:10.345639 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:10.345639 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:10.345639 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:10.345639 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:10.345639 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:10.345639 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:10.345639 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:10.345639 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:10.345639 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:10.345639 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:10.345639 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:10.345639 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:10.345639 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:10.347142 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:39:10.347142 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:39:10.347142 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:39:10.347142 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:39:10.347142 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:39:10.347142 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:39:10.347142 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:39:10.347142 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:10.349876 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 431/865] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Sep 24 19:39:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:39:10.351782 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a65f2-e41f-4e6d-bba6-c23289d0c4f2 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:10.412942 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:10.435967 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd05f70-8f99-4238-9f06-a6751b9bae75 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:10.466350 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a65f2-e41f-4e6d-bba6-c23289d0c4f2 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:10.480969 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a6273-1c58-48a5-86c3-5ba95af56285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:10.482048 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a6273-1c58-48a5-86c3-5ba95af56285 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:10.482581 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a6273-1c58-48a5-86c3-5ba95af56285 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:10.483053 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a6273-1c58-48a5-86c3-5ba95af56285 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:10.504292 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fc3996-2438-43b6-9dc9-d557da9054b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:10.505168 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc3996-2438-43b6-9dc9-d557da9054b1 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:10.505440 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc3996-2438-43b6-9dc9-d557da9054b1 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:10.505736 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc3996-2438-43b6-9dc9-d557da9054b1 None admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:10.506430 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fc3996-2438-43b6-9dc9-d557da9054b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:10.506728 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fc3996-2438-43b6-9dc9-d557da9054b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:10.508158 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fc3996-2438-43b6-9dc9-d557da9054b1 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:10.527599 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 432/866] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Sep 24 19:39:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:39:10.529198 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fc3996-2438-43b6-9dc9-d557da9054b1 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:10.568897 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07a6273-1c58-48a5-86c3-5ba95af56285 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:10.570668 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07a6273-1c58-48a5-86c3-5ba95af56285 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:10.585272 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:10.651061 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fc3996-2438-43b6-9dc9-d557da9054b1 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:10.671898 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:10.692336 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8e351-0301-4d48-b9bc-2c3745974731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:10.692945 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8e351-0301-4d48-b9bc-2c3745974731 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:10.693223 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8e351-0301-4d48-b9bc-2c3745974731 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:10.693818 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8e351-0301-4d48-b9bc-2c3745974731 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:10.694247 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c8e351-0301-4d48-b9bc-2c3745974731 None admin] RBAC: Adding query filter params (role.id=f022705fa6ce43828345ef50b3f7efc9, scope.project.id=5c2da88af5714e619238772bde676a42, user.id=ebd94cd16acc45e6ac2997204297fb75) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:10.694551 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c8e351-0301-4d48-b9bc-2c3745974731 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:10.695976 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c8e351-0301-4d48-b9bc-2c3745974731 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:10.709883 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 435/868] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Sep 24 19:39:10 2022] GET /identity/v3/auth/tokens => generated 1271 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 19:39:10.710085 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 433/868] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Sep 24 19:39:10 2022] GET /identity/v3/role_assignments?user.id=ebd94cd16acc45e6ac2997204297fb75&scope.project.id=5c2da88af5714e619238772bde676a42&role.id=f022705fa6ce43828345ef50b3f7efc9 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:10.711937 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8e351-0301-4d48-b9bc-2c3745974731 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:10.842901 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8e351-0301-4d48-b9bc-2c3745974731 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:10.858713 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:10.886470 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa007d55-5147-4fc6-a602-c94086939628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:10.887132 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa007d55-5147-4fc6-a602-c94086939628 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:10.887408 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa007d55-5147-4fc6-a602-c94086939628 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:10.887672 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa007d55-5147-4fc6-a602-c94086939628 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:10.900570 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa007d55-5147-4fc6-a602-c94086939628 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:10.902086 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa007d55-5147-4fc6-a602-c94086939628 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:10.917935 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-aa007d55-5147-4fc6-a602-c94086939628 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:39:10.917935 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:10.917935 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:10.917935 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:10.917935 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:10.917935 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:10.917935 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:10.917935 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:10.917935 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:10.917935 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:10.917935 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:10.917935 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:10.917935 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:39:10.917935 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:39:10.917935 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:39:10.917935 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:39:10.919133 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:10.919133 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:10.919133 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:10.919133 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:10.919133 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:10.919133 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:10.919133 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:10.919133 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:10.919133 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:10.919133 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:10.919133 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:10.919133 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:10.919133 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:10.919133 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:10.919133 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:10.919133 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:10.919133 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:39:10.920300 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:39:10.920300 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:39:10.920300 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:10.920300 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 434/869] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:39:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:39:10.927101 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a6273-1c58-48a5-86c3-5ba95af56285 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:10.998757 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49e077-875b-4fd9-b5d6-74c2eb61f838 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:10.999107 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49e077-875b-4fd9-b5d6-74c2eb61f838 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:10.999308 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49e077-875b-4fd9-b5d6-74c2eb61f838 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:11.000787 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 435/870] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:39:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:39:11.007992 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823605d-2cb4-4390-9862-7f0619b2acf6 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:11.008297 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823605d-2cb4-4390-9862-7f0619b2acf6 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:11.008546 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823605d-2cb4-4390-9862-7f0619b2acf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:11.029468 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-f823605d-2cb4-4390-9862-7f0619b2acf6 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:39:11.030777 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-f823605d-2cb4-4390-9862-7f0619b2acf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:39:11.050237 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a6273-1c58-48a5-86c3-5ba95af56285 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:11.089052 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc7f062-7f6f-44cd-b145-f87e5bd70694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:11.089799 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7f062-7f6f-44cd-b145-f87e5bd70694 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:11.090147 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7f062-7f6f-44cd-b145-f87e5bd70694 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:11.090488 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7f062-7f6f-44cd-b145-f87e5bd70694 None admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:11.091214 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc7f062-7f6f-44cd-b145-f87e5bd70694 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:11.091586 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc7f062-7f6f-44cd-b145-f87e5bd70694 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:11.093089 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc7f062-7f6f-44cd-b145-f87e5bd70694 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:11.106083 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 436/871] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:39:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:11.111793 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc7f062-7f6f-44cd-b145-f87e5bd70694 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:11.133663 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 436/872] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:39:11 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 19:39:11.157915 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:11.222414 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc7f062-7f6f-44cd-b145-f87e5bd70694 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:11.258465 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201c53d-e7ea-4df6-ba66-a52ee2cda52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:11.259114 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201c53d-e7ea-4df6-ba66-a52ee2cda52e None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:11.259399 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201c53d-e7ea-4df6-ba66-a52ee2cda52e None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:11.259672 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201c53d-e7ea-4df6-ba66-a52ee2cda52e None admin] PATH_INFO: `/v3/projects/service` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:11.266943 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4201c53d-e7ea-4df6-ba66-a52ee2cda52e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:11.268630 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4201c53d-e7ea-4df6-ba66-a52ee2cda52e None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:11.280786 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-4201c53d-e7ea-4df6-ba66-a52ee2cda52e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:39:11.280786 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:11.280786 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:11.280786 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:11.280786 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:11.280786 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:11.280786 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:11.280786 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:11.280786 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:11.280786 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:11.280786 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:11.280786 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:11.280786 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:39:11.280786 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:39:11.280786 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:39:11.283421 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:39:11.283421 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:11.283421 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:11.283421 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:11.283421 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:11.283421 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:11.283421 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:11.283421 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:11.283421 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:11.283421 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:11.283421 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:11.283421 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:11.283421 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:11.283421 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:11.283421 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:11.283421 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:11.283421 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:11.286295 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:39:11.286295 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:39:11.286295 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:39:11.286295 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:39:11.286295 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:39:11.286295 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:39:11.286295 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:39:11.286295 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:39:11.286295 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 437/873] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Sep 24 19:39:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:39:11.293517 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f823605d-2cb4-4390-9862-7f0619b2acf6 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:11.401574 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:11.409844 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f823605d-2cb4-4390-9862-7f0619b2acf6 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:11.415224 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201c53d-e7ea-4df6-ba66-a52ee2cda52e None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:11.458295 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c6a29c-fb79-4bb3-8d4b-a17825a288bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:11.459908 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6a29c-fb79-4bb3-8d4b-a17825a288bd None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:11.460198 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6a29c-fb79-4bb3-8d4b-a17825a288bd None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:11.460472 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6a29c-fb79-4bb3-8d4b-a17825a288bd None admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:11.461178 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c6a29c-fb79-4bb3-8d4b-a17825a288bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:11.461486 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c6a29c-fb79-4bb3-8d4b-a17825a288bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:11.462972 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c6a29c-fb79-4bb3-8d4b-a17825a288bd None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:11.484870 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 437/874] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Sep 24 19:39:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:11.485861 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c6a29c-fb79-4bb3-8d4b-a17825a288bd None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:11.534415 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:11.537828 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201c53d-e7ea-4df6-ba66-a52ee2cda52e None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:11.576079 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a904ef8f-508c-4573-8c50-f421ef4ce133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:11.576869 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a904ef8f-508c-4573-8c50-f421ef4ce133 None admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:11.577261 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a904ef8f-508c-4573-8c50-f421ef4ce133 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:11.577669 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a904ef8f-508c-4573-8c50-f421ef4ce133 None admin] PATH_INFO: `/v3/services` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:11.578440 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a904ef8f-508c-4573-8c50-f421ef4ce133 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:11.580154 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a904ef8f-508c-4573-8c50-f421ef4ce133 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:11.616430 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c6a29c-fb79-4bb3-8d4b-a17825a288bd None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:11.655795 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87898a9-2b73-4575-9f3f-f54da1cbd01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:11.656350 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87898a9-2b73-4575-9f3f-f54da1cbd01f None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:11.656649 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87898a9-2b73-4575-9f3f-f54da1cbd01f None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:11.656818 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87898a9-2b73-4575-9f3f-f54da1cbd01f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:11.657560 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87898a9-2b73-4575-9f3f-f54da1cbd01f None admin] RBAC: Adding query filter params (role.id=e9acf72f841f4030a76e8f9c41c95d7f, scope.project.id=5c2da88af5714e619238772bde676a42, user.id=fd597f74abdf49288ea0d92642c6a5a2) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:11.657908 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87898a9-2b73-4575-9f3f-f54da1cbd01f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:11.660412 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87898a9-2b73-4575-9f3f-f54da1cbd01f None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:11.669540 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 438/875] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Sep 24 19:39:11 2022] GET /identity/v3/role_assignments?user.id=fd597f74abdf49288ea0d92642c6a5a2&scope.project.id=5c2da88af5714e619238772bde676a42&role.id=e9acf72f841f4030a76e8f9c41c95d7f => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:11.693785 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 438/876] 10.222.0.60 () {60 vars in 1141 bytes} [Sat Sep 24 19:39:11 2022] POST /identity/v3/services => generated 251 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:39:12.133111 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1262754-e574-4c66-86bd-8c8bbbe103e1 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:12.133451 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1262754-e574-4c66-86bd-8c8bbbe103e1 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:12.133751 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1262754-e574-4c66-86bd-8c8bbbe103e1 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:12.135354 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 439/877] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:39:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:39:12.142271 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd673c4-55ae-49b7-9fcb-ee19291eed3a None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:12.143006 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd673c4-55ae-49b7-9fcb-ee19291eed3a None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:12.143553 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd673c4-55ae-49b7-9fcb-ee19291eed3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:12.163421 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-fdd673c4-55ae-49b7-9fcb-ee19291eed3a None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:39:12.164969 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-fdd673c4-55ae-49b7-9fcb-ee19291eed3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:39:12.250404 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 439/878] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:39:12 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 19:39:12.538372 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1262754-e574-4c66-86bd-8c8bbbe103e1 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:12.561407 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:12.654314 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1262754-e574-4c66-86bd-8c8bbbe103e1 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:12.711379 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d6443-326b-4712-8394-f6bdbbbf5b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:12.712494 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d6443-326b-4712-8394-f6bdbbbf5b79 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:12.712972 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d6443-326b-4712-8394-f6bdbbbf5b79 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:12.713438 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d6443-326b-4712-8394-f6bdbbbf5b79 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:12.714255 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780d6443-326b-4712-8394-f6bdbbbf5b79 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:12.716045 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780d6443-326b-4712-8394-f6bdbbbf5b79 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:12.727080 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-780d6443-326b-4712-8394-f6bdbbbf5b79 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 24 19:39:12.727080 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:12.727080 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:39:12.727080 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:39:12.727080 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:39:12.727080 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:39:12.727080 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:39:12.727080 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:39:12.727080 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 24 19:39:12.727080 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:12.727080 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:39:12.727080 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:12.727080 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:12.727080 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:12.727080 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:12.727080 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:12.728050 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:12.728050 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:12.728050 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:12.728050 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:12.728050 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:12.728050 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:12.728050 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:12.728050 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:39:12.728050 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:39:12.728050 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:39:12.728050 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:39:12.728050 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:12.728050 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:12.728050 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:12.728050 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:12.728050 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:12.728050 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:12.728919 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:12.728919 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:12.728919 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:12.728919 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:12.728919 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:12.728919 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:12.728919 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:12.728919 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:12.728919 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:12.728919 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:12.728919 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:39:12.728919 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:39:12.728919 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 24 19:39:12.728919 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:12.732033 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 440/879] 10.222.0.60 () {56 vars in 1132 bytes} [Sat Sep 24 19:39:12 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:39:12.737781 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd673c4-55ae-49b7-9fcb-ee19291eed3a None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:12.833760 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:12.849671 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd673c4-55ae-49b7-9fcb-ee19291eed3a None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:12.886578 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5daba-adf9-4113-9c01-9941d88fbd33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:12.887203 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5daba-adf9-4113-9c01-9941d88fbd33 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:12.887485 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5daba-adf9-4113-9c01-9941d88fbd33 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:12.887759 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5daba-adf9-4113-9c01-9941d88fbd33 None admin] PATH_INFO: `/v3/services` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:12.888400 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb5daba-adf9-4113-9c01-9941d88fbd33 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:12.888704 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb5daba-adf9-4113-9c01-9941d88fbd33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:12.890104 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb5daba-adf9-4113-9c01-9941d88fbd33 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:12.896232 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 440/880] 10.222.0.60 () {56 vars in 1126 bytes} [Sat Sep 24 19:39:12 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:12.901813 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d6443-326b-4712-8394-f6bdbbbf5b79 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:12.998806 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:13.021748 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d6443-326b-4712-8394-f6bdbbbf5b79 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:13.062592 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf97cb98-eb68-48a2-a07b-1b4976358e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:13.063702 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97cb98-eb68-48a2-a07b-1b4976358e90 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:13.064884 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97cb98-eb68-48a2-a07b-1b4976358e90 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:13.065702 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97cb98-eb68-48a2-a07b-1b4976358e90 None admin] PATH_INFO: `/v3/services` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:13.066654 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf97cb98-eb68-48a2-a07b-1b4976358e90 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:13.067176 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf97cb98-eb68-48a2-a07b-1b4976358e90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:13.068896 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf97cb98-eb68-48a2-a07b-1b4976358e90 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:13.076084 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 441/881] 10.222.0.60 () {56 vars in 1126 bytes} [Sat Sep 24 19:39:12 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:13.083370 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5daba-adf9-4113-9c01-9941d88fbd33 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:13.179902 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6956f-6c58-4a66-bd11-85068487204c None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:13.180519 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6956f-6c58-4a66-bd11-85068487204c None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:13.180987 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6956f-6c58-4a66-bd11-85068487204c None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:13.182554 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 442/882] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:39:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:39:13.188555 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe16452-c486-417d-8859-1a9fd2697849 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:13.189935 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe16452-c486-417d-8859-1a9fd2697849 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:13.190515 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe16452-c486-417d-8859-1a9fd2697849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:13.201368 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5daba-adf9-4113-9c01-9941d88fbd33 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:13.213614 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-cbe16452-c486-417d-8859-1a9fd2697849 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:39:13.215328 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-cbe16452-c486-417d-8859-1a9fd2697849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:39:13.237678 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea855ca-a7b1-4891-9756-4e697036b447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:13.238291 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea855ca-a7b1-4891-9756-4e697036b447 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:13.238569 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea855ca-a7b1-4891-9756-4e697036b447 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:13.238840 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea855ca-a7b1-4891-9756-4e697036b447 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:13.239548 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea855ca-a7b1-4891-9756-4e697036b447 None admin] RBAC: Adding query filter params (interface=public, service_id=0bf68e0320eb4e978272dad2027c1bf7, region_id=RegionOne) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:13.239852 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea855ca-a7b1-4891-9756-4e697036b447 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:13.243291 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea855ca-a7b1-4891-9756-4e697036b447 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:13.247766 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 441/883] 10.222.0.60 () {56 vars in 1251 bytes} [Sat Sep 24 19:39:13 2022] GET /identity/v3/endpoints?service_id=0bf68e0320eb4e978272dad2027c1bf7&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:13.254134 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea855ca-a7b1-4891-9756-4e697036b447 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:13.274915 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:13.312872 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 443/884] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:39:13 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 19:39:13.385856 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea855ca-a7b1-4891-9756-4e697036b447 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:13.434244 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9eb345-a16c-463b-88e1-b8221e6bac52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:13.435227 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9eb345-a16c-463b-88e1-b8221e6bac52 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:13.435702 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9eb345-a16c-463b-88e1-b8221e6bac52 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:13.436172 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9eb345-a16c-463b-88e1-b8221e6bac52 None admin] PATH_INFO: `/v3/services` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:13.436989 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9eb345-a16c-463b-88e1-b8221e6bac52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:13.438760 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9eb345-a16c-463b-88e1-b8221e6bac52 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:13.445919 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 442/885] 10.222.0.60 () {56 vars in 1087 bytes} [Sat Sep 24 19:39:13 2022] GET /identity/v3/services => generated 1268 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 19:39:13.589665 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe16452-c486-417d-8859-1a9fd2697849 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:13.684787 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:13.709737 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe16452-c486-417d-8859-1a9fd2697849 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:13.746103 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a066e1-f948-4411-ae5d-8aa59ff38b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:13.746744 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a066e1-f948-4411-ae5d-8aa59ff38b68 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:13.747019 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a066e1-f948-4411-ae5d-8aa59ff38b68 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:13.747292 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a066e1-f948-4411-ae5d-8aa59ff38b68 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:13.747879 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a066e1-f948-4411-ae5d-8aa59ff38b68 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:13.749260 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a066e1-f948-4411-ae5d-8aa59ff38b68 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:13.760182 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-58a066e1-f948-4411-ae5d-8aa59ff38b68 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 24 19:39:13.760182 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:13.760182 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:39:13.760182 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:39:13.760182 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:39:13.760182 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:39:13.760182 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:39:13.760182 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:39:13.760182 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 24 19:39:13.760182 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:13.760182 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:39:13.760182 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:13.760182 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:13.760182 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:13.760182 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:13.760182 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:13.760182 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:13.761248 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:13.761248 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:13.761248 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:13.761248 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:13.761248 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:13.761248 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:13.761248 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:39:13.761248 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:39:13.761248 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:39:13.761248 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:39:13.761248 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:13.761248 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:13.761248 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:13.761248 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:13.761248 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:13.761248 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:13.762676 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:13.762676 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:13.762676 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:13.762676 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:13.762676 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:13.762676 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:13.762676 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:13.762676 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:13.762676 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:13.762676 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:13.762676 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:39:13.762676 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:39:13.762676 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 24 19:39:13.762676 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:13.762676 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 444/886] 10.222.0.60 () {56 vars in 1126 bytes} [Sat Sep 24 19:39:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:39:13.768188 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9eb345-a16c-463b-88e1-b8221e6bac52 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:13.858400 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:13.883050 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9eb345-a16c-463b-88e1-b8221e6bac52 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:13.920514 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4fcb5-a86e-4c27-b707-cfefd1b37430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:13.921120 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4fcb5-a86e-4c27-b707-cfefd1b37430 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:13.921391 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4fcb5-a86e-4c27-b707-cfefd1b37430 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:13.921690 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4fcb5-a86e-4c27-b707-cfefd1b37430 None admin] PATH_INFO: `/v3/services` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:13.922488 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4fcb5-a86e-4c27-b707-cfefd1b37430 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:13.922788 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4fcb5-a86e-4c27-b707-cfefd1b37430 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:13.924757 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4fcb5-a86e-4c27-b707-cfefd1b37430 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:13.930010 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 443/887] 10.222.0.60 () {56 vars in 1122 bytes} [Sat Sep 24 19:39:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:13.935927 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a066e1-f948-4411-ae5d-8aa59ff38b68 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:14.070177 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a066e1-f948-4411-ae5d-8aa59ff38b68 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:14.103189 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37e5f8-f40c-4686-afd3-d3586399e28e None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:14.103469 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37e5f8-f40c-4686-afd3-d3586399e28e None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:14.103742 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37e5f8-f40c-4686-afd3-d3586399e28e None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:14.105318 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 444/888] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:39:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:39:14.110561 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676bd623-8c22-4d7c-9f09-2744518286ad None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:14.111579 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676bd623-8c22-4d7c-9f09-2744518286ad None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:14.112278 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676bd623-8c22-4d7c-9f09-2744518286ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:14.115836 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902cf063-2973-4548-949a-e71844965d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:14.116515 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902cf063-2973-4548-949a-e71844965d91 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:14.116787 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902cf063-2973-4548-949a-e71844965d91 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:14.117051 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902cf063-2973-4548-949a-e71844965d91 None admin] PATH_INFO: `/v3/services` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:14.117808 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902cf063-2973-4548-949a-e71844965d91 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:14.118107 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902cf063-2973-4548-949a-e71844965d91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:14.119721 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902cf063-2973-4548-949a-e71844965d91 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:14.125962 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 445/889] 10.222.0.60 () {56 vars in 1122 bytes} [Sat Sep 24 19:39:13 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:14.146733 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-676bd623-8c22-4d7c-9f09-2744518286ad None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:39:14.148015 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-676bd623-8c22-4d7c-9f09-2744518286ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:39:14.155996 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb2ec2-b042-426f-8920-f84f74bd0331 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:14.156307 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb2ec2-b042-426f-8920-f84f74bd0331 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:14.156546 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb2ec2-b042-426f-8920-f84f74bd0331 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:14.158417 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 446/890] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:39:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:39:14.164105 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782a2e6-8083-4c09-8682-72bd3fbb6533 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:14.164372 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782a2e6-8083-4c09-8682-72bd3fbb6533 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:14.164648 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782a2e6-8083-4c09-8682-72bd3fbb6533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:14.178956 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:14.184538 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-9782a2e6-8083-4c09-8682-72bd3fbb6533 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:39:14.185798 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-9782a2e6-8083-4c09-8682-72bd3fbb6533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:39:14.242026 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 445/891] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:39:14 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:39:14.278810 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 447/892] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:39:14 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 19:39:14.539945 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676bd623-8c22-4d7c-9f09-2744518286ad None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:14.550720 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9782a2e6-8083-4c09-8682-72bd3fbb6533 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:14.623678 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:14.657198 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676bd623-8c22-4d7c-9f09-2744518286ad None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:14.660370 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9782a2e6-8083-4c09-8682-72bd3fbb6533 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:14.696724 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c21d72-0210-4375-a78d-34393c9db203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:14.697366 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c21d72-0210-4375-a78d-34393c9db203 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:14.697673 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c21d72-0210-4375-a78d-34393c9db203 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:14.697947 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c21d72-0210-4375-a78d-34393c9db203 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:14.698164 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e399e-a555-4680-a42e-82ddac5557aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:14.699001 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e399e-a555-4680-a42e-82ddac5557aa None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:14.699292 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e399e-a555-4680-a42e-82ddac5557aa None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:14.699566 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e399e-a555-4680-a42e-82ddac5557aa None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:14.700163 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3e399e-a555-4680-a42e-82ddac5557aa None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:14.701651 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3e399e-a555-4680-a42e-82ddac5557aa None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:14.710027 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c21d72-0210-4375-a78d-34393c9db203 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:39:14.711526 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-7a3e399e-a555-4680-a42e-82ddac5557aa None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 24 19:39:14.711526 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:14.711526 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:39:14.711526 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:39:14.711526 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:39:14.711526 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:39:14.711526 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:39:14.711526 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:39:14.711526 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 24 19:39:14.711526 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:14.711526 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:39:14.711526 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:14.711526 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:14.711526 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:14.711526 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:14.711526 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:14.711526 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:14.712495 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:14.712495 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:14.712495 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:14.712495 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:14.712495 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:14.712495 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:14.712495 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:39:14.712495 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:39:14.712495 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:39:14.712495 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:39:14.712495 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:14.712495 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:14.712495 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:14.712495 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:14.712495 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:14.712495 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:14.713319 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:14.713319 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:14.713319 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:14.713319 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:14.713319 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:14.713319 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:14.713319 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:14.713319 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:14.713319 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:14.713319 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:14.713319 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:39:14.713319 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:39:14.713319 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 24 19:39:14.713319 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:14.714937 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:14.715402 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-12c21d72-0210-4375-a78d-34393c9db203 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 24 19:39:14.715402 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:14.715402 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:14.715402 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:14.715402 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:14.715402 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:14.715402 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:14.715402 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:14.715402 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:14.715402 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:14.715402 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:14.715402 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:14.715402 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:39:14.715402 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:39:14.715402 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:39:14.715402 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:39:14.716300 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:39:14.716300 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:39:14.716300 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:39:14.716300 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:39:14.716300 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:14.716300 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:14.716300 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:14.716300 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:14.716300 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:14.716300 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:14.716300 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:14.716300 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:14.716300 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:14.716300 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:14.716300 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:14.716300 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:14.717133 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:14.717133 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:14.717133 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:14.717133 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:14.717133 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:39:14.717133 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:39:14.717133 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:39:14.717133 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:39:14.717133 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:39:14.717133 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:39:14.717133 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 24 19:39:14.717133 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:39:14.717802 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 448/894] 10.222.0.60 () {56 vars in 1114 bytes} [Sat Sep 24 19:39:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:39:14.722161 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 446/894] 10.222.0.60 () {56 vars in 1120 bytes} [Sat Sep 24 19:39:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:39:14.725517 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c21d72-0210-4375-a78d-34393c9db203 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:14.726270 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e399e-a555-4680-a42e-82ddac5557aa None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:14.848958 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c21d72-0210-4375-a78d-34393c9db203 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:14.851234 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e399e-a555-4680-a42e-82ddac5557aa None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:14.888535 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:14.895297 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177d548-218f-4f8a-b0cc-de7cd7dd5468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:14.897705 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177d548-218f-4f8a-b0cc-de7cd7dd5468 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:14.897835 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb331f-1205-4791-a4af-f7634e522758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:14.897967 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177d548-218f-4f8a-b0cc-de7cd7dd5468 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:14.897967 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177d548-218f-4f8a-b0cc-de7cd7dd5468 None admin] PATH_INFO: `/v3/services` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:14.898135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb331f-1205-4791-a4af-f7634e522758 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:14.898135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb331f-1205-4791-a4af-f7634e522758 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:14.898345 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e177d548-218f-4f8a-b0cc-de7cd7dd5468 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:14.898474 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb331f-1205-4791-a4af-f7634e522758 None admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:14.898599 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e177d548-218f-4f8a-b0cc-de7cd7dd5468 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:14.898736 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb331f-1205-4791-a4af-f7634e522758 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:14.898736 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb331f-1205-4791-a4af-f7634e522758 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:14.899579 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb331f-1205-4791-a4af-f7634e522758 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:14.899729 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e177d548-218f-4f8a-b0cc-de7cd7dd5468 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:14.909788 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 449/895] 10.222.0.60 () {56 vars in 1114 bytes} [Sat Sep 24 19:39:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:14.912512 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177d548-218f-4f8a-b0cc-de7cd7dd5468 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:14.913585 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 447/896] 10.222.0.60 () {56 vars in 1115 bytes} [Sat Sep 24 19:39:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:14.916341 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb331f-1205-4791-a4af-f7634e522758 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:14.991622 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:15.044073 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb331f-1205-4791-a4af-f7634e522758 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:15.048361 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177d548-218f-4f8a-b0cc-de7cd7dd5468 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:15.082909 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc51d9-14f1-4f15-b51d-38133323fcf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:15.083677 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc51d9-14f1-4f15-b51d-38133323fcf4 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:15.083957 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc51d9-14f1-4f15-b51d-38133323fcf4 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:15.084224 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc51d9-14f1-4f15-b51d-38133323fcf4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:15.096690 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bc51d9-14f1-4f15-b51d-38133323fcf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:15.097668 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150e51ff-b4ee-4d43-80a3-f08a94d91ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:15.098186 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bc51d9-14f1-4f15-b51d-38133323fcf4 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:15.098362 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e51ff-b4ee-4d43-80a3-f08a94d91ea3 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:15.098551 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e51ff-b4ee-4d43-80a3-f08a94d91ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:15.099056 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e51ff-b4ee-4d43-80a3-f08a94d91ea3 None admin] PATH_INFO: `/v3/services` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:15.099641 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150e51ff-b4ee-4d43-80a3-f08a94d91ea3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:15.099941 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150e51ff-b4ee-4d43-80a3-f08a94d91ea3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:15.102118 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150e51ff-b4ee-4d43-80a3-f08a94d91ea3 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:15.109071 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 450/897] 10.222.0.60 () {56 vars in 1114 bytes} [Sat Sep 24 19:39:14 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:15.114766 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150e51ff-b4ee-4d43-80a3-f08a94d91ea3 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:15.117202 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-21bc51d9-14f1-4f15-b51d-38133323fcf4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:39:15.117202 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:15.117202 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:15.117202 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:15.117202 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:15.117202 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:15.117202 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:15.117202 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:15.117202 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:15.117202 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:15.117202 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:15.117202 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:15.117202 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:39:15.117202 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:39:15.117202 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:39:15.117202 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:39:15.118119 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:15.118119 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:15.118119 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:15.118119 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:15.118119 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:15.118119 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:15.118119 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:15.118119 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:15.118119 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:15.118119 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:15.118119 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:15.118119 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:15.118119 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:15.118119 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:15.118119 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:15.118119 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:15.118119 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:39:15.119078 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:39:15.119078 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:39:15.119078 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:39:15.121659 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 448/898] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:39:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:39:15.125858 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc51d9-14f1-4f15-b51d-38133323fcf4 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:15.191159 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:15.245849 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150e51ff-b4ee-4d43-80a3-f08a94d91ea3 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:15.268834 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc51d9-14f1-4f15-b51d-38133323fcf4 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:15.277315 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:15.287607 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f37347-00cb-4850-85a7-ed36478ef0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:15.288602 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f37347-00cb-4850-85a7-ed36478ef0ad None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:15.289100 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f37347-00cb-4850-85a7-ed36478ef0ad None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:15.289598 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f37347-00cb-4850-85a7-ed36478ef0ad None admin] PATH_INFO: `/v3/endpoints` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:15.290525 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f37347-00cb-4850-85a7-ed36478ef0ad None admin] RBAC: Adding query filter params (interface=public, service_id=c930358bc3804725991115c5fbc99451, region_id=RegionOne) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:15.291026 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f37347-00cb-4850-85a7-ed36478ef0ad None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:15.292609 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f37347-00cb-4850-85a7-ed36478ef0ad None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:15.303281 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 451/899] 10.222.0.60 () {56 vars in 1251 bytes} [Sat Sep 24 19:39:15 2022] GET /identity/v3/endpoints?service_id=c930358bc3804725991115c5fbc99451&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:39:15.304508 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f37347-00cb-4850-85a7-ed36478ef0ad None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:15.310740 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1fd95d-add7-4291-992a-cce5a34a894b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:15.311368 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1fd95d-add7-4291-992a-cce5a34a894b None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:15.311650 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1fd95d-add7-4291-992a-cce5a34a894b None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:15.311926 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1fd95d-add7-4291-992a-cce5a34a894b None admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:15.312588 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1fd95d-add7-4291-992a-cce5a34a894b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:15.312892 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1fd95d-add7-4291-992a-cce5a34a894b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:15.314994 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1fd95d-add7-4291-992a-cce5a34a894b None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:15.333587 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 449/900] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:15.338040 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1fd95d-add7-4291-992a-cce5a34a894b None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:15.444980 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f37347-00cb-4850-85a7-ed36478ef0ad None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:15.461115 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1fd95d-add7-4291-992a-cce5a34a894b None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:15.486039 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:15.490656 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b7aac4-8862-4a33-84b8-f854b81913f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:15.491288 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7aac4-8862-4a33-84b8-f854b81913f3 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:15.491562 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7aac4-8862-4a33-84b8-f854b81913f3 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:15.492096 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7aac4-8862-4a33-84b8-f854b81913f3 None admin] PATH_INFO: `/v3/services` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:15.492719 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b7aac4-8862-4a33-84b8-f854b81913f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:15.494316 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b7aac4-8862-4a33-84b8-f854b81913f3 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:15.509606 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfbb36f-0f05-4068-9c70-5cada8bcce5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:15.509821 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 452/901] 10.222.0.60 () {56 vars in 1087 bytes} [Sat Sep 24 19:39:15 2022] GET /identity/v3/services => generated 1268 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:39:15.510752 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfbb36f-0f05-4068-9c70-5cada8bcce5c None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:15.511261 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfbb36f-0f05-4068-9c70-5cada8bcce5c None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:15.511738 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfbb36f-0f05-4068-9c70-5cada8bcce5c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:15.521412 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfbb36f-0f05-4068-9c70-5cada8bcce5c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:15.523322 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfbb36f-0f05-4068-9c70-5cada8bcce5c None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:15.537985 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-ecfbb36f-0f05-4068-9c70-5cada8bcce5c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 24 19:39:15.537985 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:15.537985 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:15.537985 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:15.537985 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:15.537985 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:15.537985 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:15.537985 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:15.537985 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:15.537985 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:15.537985 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:15.537985 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:15.537985 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:39:15.537985 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:39:15.537985 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:39:15.537985 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:39:15.539022 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:15.539022 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:15.539022 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:39:15.539022 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:39:15.539022 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:39:15.539022 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:39:15.539022 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:15.539022 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:15.539022 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:15.539022 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:15.539022 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:15.539022 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:15.539022 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:15.539022 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:15.539022 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:15.539022 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:15.539022 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:15.539022 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:15.539969 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:15.539969 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:15.539969 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:39:15.539969 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:39:15.539969 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:39:15.539969 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:39:15.539969 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:39:15.539969 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:39:15.539969 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 24 19:39:15.539969 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:39:15.542869 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 450/902] 10.222.0.60 () {56 vars in 1117 bytes} [Sat Sep 24 19:39:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:39:15.549817 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b7aac4-8862-4a33-84b8-f854b81913f3 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:15.617987 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:15.672241 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b7aac4-8862-4a33-84b8-f854b81913f3 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:15.711786 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca265d-dd1b-4a88-92c9-8b837fd0690b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:15.712405 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca265d-dd1b-4a88-92c9-8b837fd0690b None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:15.712673 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca265d-dd1b-4a88-92c9-8b837fd0690b None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:15.712849 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca265d-dd1b-4a88-92c9-8b837fd0690b None admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:15.713605 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca265d-dd1b-4a88-92c9-8b837fd0690b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:15.713912 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca265d-dd1b-4a88-92c9-8b837fd0690b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:15.715367 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca265d-dd1b-4a88-92c9-8b837fd0690b None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:15.736927 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 453/903] 10.222.0.60 () {56 vars in 1149 bytes} [Sat Sep 24 19:39:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:15.742675 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfbb36f-0f05-4068-9c70-5cada8bcce5c None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:15.857579 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfbb36f-0f05-4068-9c70-5cada8bcce5c None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:15.895700 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b4f59-7a43-42e4-afb2-aa2e2e4e1ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:15.896323 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b4f59-7a43-42e4-afb2-aa2e2e4e1ac7 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:15.896606 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b4f59-7a43-42e4-afb2-aa2e2e4e1ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:15.896875 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b4f59-7a43-42e4-afb2-aa2e2e4e1ac7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:15.933294 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:15.953447 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1fcb99-6c0b-42e5-87c3-18d2d8fc8710 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:15.953769 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1fcb99-6c0b-42e5-87c3-18d2d8fc8710 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:15.955996 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1fcb99-6c0b-42e5-87c3-18d2d8fc8710 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:15.956214 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 454/904] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:39:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:39:15.961688 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe13bfd-a05a-49a3-af44-5234bc4c91a2 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:15.961885 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe13bfd-a05a-49a3-af44-5234bc4c91a2 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:15.962089 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe13bfd-a05a-49a3-af44-5234bc4c91a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:15.974856 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399b4f59-7a43-42e4-afb2-aa2e2e4e1ac7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:15.976334 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399b4f59-7a43-42e4-afb2-aa2e2e4e1ac7 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:15.981345 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-ffe13bfd-a05a-49a3-af44-5234bc4c91a2 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:39:15.982867 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-ffe13bfd-a05a-49a3-af44-5234bc4c91a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:39:16.085367 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 455/905] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:39:15 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 19:39:16.101213 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 451/906] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Sep 24 19:39:15 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 19:39:16.107241 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe13bfd-a05a-49a3-af44-5234bc4c91a2 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:16.156947 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:16.221876 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe13bfd-a05a-49a3-af44-5234bc4c91a2 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:16.258518 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc9b987-b210-4f80-90ec-3d1637e6349f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:16.259166 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9b987-b210-4f80-90ec-3d1637e6349f None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:16.259441 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9b987-b210-4f80-90ec-3d1637e6349f None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:16.259709 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9b987-b210-4f80-90ec-3d1637e6349f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:16.271853 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc9b987-b210-4f80-90ec-3d1637e6349f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:16.273333 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc9b987-b210-4f80-90ec-3d1637e6349f None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:16.290175 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-bbc9b987-b210-4f80-90ec-3d1637e6349f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:39:16.290175 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:16.290175 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:16.290175 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:16.290175 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:16.290175 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:16.290175 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:16.290175 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:16.290175 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:16.290175 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:16.290175 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:16.290175 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:16.290175 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:39:16.290175 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:39:16.290175 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:39:16.290175 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:39:16.291172 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:16.291172 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:16.291172 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:16.291172 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:16.291172 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:16.291172 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:16.291172 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:16.291172 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:16.291172 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:16.291172 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:16.291172 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:16.291172 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:16.291172 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:16.291172 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:16.291172 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:16.291172 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:16.291172 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:39:16.292493 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:39:16.292493 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:39:16.292493 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:16.292493 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 456/907] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:39:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:39:16.297584 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b4f59-7a43-42e4-afb2-aa2e2e4e1ac7 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:16.365339 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc9b987-b210-4f80-90ec-3d1637e6349f None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:16.375387 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:16.420436 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b4f59-7a43-42e4-afb2-aa2e2e4e1ac7 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:16.465589 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed0fc83-97ff-469d-9fac-5066bcd7d860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:16.466209 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0fc83-97ff-469d-9fac-5066bcd7d860 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:16.466486 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0fc83-97ff-469d-9fac-5066bcd7d860 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:16.466745 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0fc83-97ff-469d-9fac-5066bcd7d860 None admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:16.467392 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed0fc83-97ff-469d-9fac-5066bcd7d860 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:16.467692 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed0fc83-97ff-469d-9fac-5066bcd7d860 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:16.469057 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed0fc83-97ff-469d-9fac-5066bcd7d860 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:16.488089 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 452/908] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:39:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:16.488089 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112e22c-ccd8-4b74-8a2a-8828211a6c1b None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:16.488089 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112e22c-ccd8-4b74-8a2a-8828211a6c1b None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:16.488089 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112e22c-ccd8-4b74-8a2a-8828211a6c1b None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:16.488089 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 453/909] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:39:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:39:16.490142 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d112e22c-ccd8-4b74-8a2a-8828211a6c1b None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:16.494021 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:16.500731 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc9b987-b210-4f80-90ec-3d1637e6349f None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:16.541670 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ae645-36e8-4ed7-b54b-55b61070aafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:16.542648 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ae645-36e8-4ed7-b54b-55b61070aafc None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:16.543129 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ae645-36e8-4ed7-b54b-55b61070aafc None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:16.543571 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ae645-36e8-4ed7-b54b-55b61070aafc None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:16.544346 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580ae645-36e8-4ed7-b54b-55b61070aafc None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:16.545926 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580ae645-36e8-4ed7-b54b-55b61070aafc None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:16.557039 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-580ae645-36e8-4ed7-b54b-55b61070aafc None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 24 19:39:16.557039 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:16.557039 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:39:16.557039 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:39:16.557039 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:39:16.557039 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:39:16.557039 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:39:16.557039 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:39:16.557039 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 24 19:39:16.557039 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:16.557039 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:39:16.557039 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:16.557039 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:16.557039 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:16.557039 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:16.557039 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:16.558132 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:16.558132 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:16.558132 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:16.558132 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:16.558132 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:16.558132 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:16.558132 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:16.558132 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:39:16.558132 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:39:16.558132 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:39:16.558132 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:39:16.558132 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:16.558132 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:16.558132 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:16.558132 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:16.558132 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:16.558132 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:16.562939 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:16.562939 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:16.562939 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:16.562939 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:16.562939 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:16.562939 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:16.562939 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:16.562939 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:16.562939 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:16.562939 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:16.562939 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:39:16.562939 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:39:16.562939 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 24 19:39:16.562939 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:16.562939 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 457/910] 10.222.0.60 () {56 vars in 1132 bytes} [Sat Sep 24 19:39:16 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:39:16.563762 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577e8c0-15b4-4a19-9fe0-51afeddac1b1 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:16.563762 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577e8c0-15b4-4a19-9fe0-51afeddac1b1 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:16.563762 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577e8c0-15b4-4a19-9fe0-51afeddac1b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:16.582230 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-c577e8c0-15b4-4a19-9fe0-51afeddac1b1 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:39:16.583184 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-c577e8c0-15b4-4a19-9fe0-51afeddac1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:39:16.631578 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d112e22c-ccd8-4b74-8a2a-8828211a6c1b None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:16.657971 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:16.669666 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 458/911] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:39:16 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:39:16.670592 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577e8c0-15b4-4a19-9fe0-51afeddac1b1 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:16.682188 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642fa986-3cd7-4d9d-ac9b-e7832de12bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:16.683139 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642fa986-3cd7-4d9d-ac9b-e7832de12bb2 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:16.683620 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642fa986-3cd7-4d9d-ac9b-e7832de12bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:16.684069 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642fa986-3cd7-4d9d-ac9b-e7832de12bb2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:16.693282 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642fa986-3cd7-4d9d-ac9b-e7832de12bb2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:16.696250 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642fa986-3cd7-4d9d-ac9b-e7832de12bb2 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:16.712065 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-642fa986-3cd7-4d9d-ac9b-e7832de12bb2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:39:16.712065 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:16.712065 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:16.712065 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:16.712065 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:16.712065 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:16.712065 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:16.712065 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:16.712065 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:16.712065 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:16.712065 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:16.712065 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:16.712065 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:39:16.712065 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:39:16.712065 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:39:16.713871 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:39:16.713871 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:16.713871 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:16.713871 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:16.713871 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:16.713871 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:16.713871 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:16.713871 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:16.713871 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:16.713871 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:16.713871 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:16.713871 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:16.713871 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:16.713871 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:16.713871 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:16.713871 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:16.713871 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:16.719767 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:39:16.719767 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:39:16.719767 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:39:16.719767 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:39:16.719767 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:39:16.719767 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:39:16.719767 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:39:16.719767 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:39:16.719767 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 454/912] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Sep 24 19:39:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:39:16.722031 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642fa986-3cd7-4d9d-ac9b-e7832de12bb2 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:16.785607 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:16.792819 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577e8c0-15b4-4a19-9fe0-51afeddac1b1 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:16.834057 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4d214-f4c9-453c-beb9-2a3e08e11f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:16.834686 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4d214-f4c9-453c-beb9-2a3e08e11f15 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:16.834968 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4d214-f4c9-453c-beb9-2a3e08e11f15 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:16.835241 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4d214-f4c9-453c-beb9-2a3e08e11f15 None admin] PATH_INFO: `/v3/services` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:16.835875 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d4d214-f4c9-453c-beb9-2a3e08e11f15 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:16.836284 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d4d214-f4c9-453c-beb9-2a3e08e11f15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:16.837848 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d4d214-f4c9-453c-beb9-2a3e08e11f15 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:16.840049 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642fa986-3cd7-4d9d-ac9b-e7832de12bb2 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:16.843143 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 459/913] 10.222.0.60 () {56 vars in 1126 bytes} [Sat Sep 24 19:39:16 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:16.849788 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4d214-f4c9-453c-beb9-2a3e08e11f15 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:16.884012 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a50fd-7fa9-428b-b9c6-75df6760fc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:16.884703 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a50fd-7fa9-428b-b9c6-75df6760fc38 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:16.884892 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a50fd-7fa9-428b-b9c6-75df6760fc38 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:16.885163 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a50fd-7fa9-428b-b9c6-75df6760fc38 None admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:16.885883 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408a50fd-7fa9-428b-b9c6-75df6760fc38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:16.886230 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408a50fd-7fa9-428b-b9c6-75df6760fc38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:16.887906 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408a50fd-7fa9-428b-b9c6-75df6760fc38 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:16.908230 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 455/914] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Sep 24 19:39:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:39:16.912054 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a50fd-7fa9-428b-b9c6-75df6760fc38 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:16.970651 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:16.980642 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4d214-f4c9-453c-beb9-2a3e08e11f15 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:17.021656 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb893d0-918c-44d1-b4c7-6de27019a00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:17.022269 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb893d0-918c-44d1-b4c7-6de27019a00c None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:17.022542 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb893d0-918c-44d1-b4c7-6de27019a00c None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:17.022810 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb893d0-918c-44d1-b4c7-6de27019a00c None admin] PATH_INFO: `/v3/services` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:17.023435 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb893d0-918c-44d1-b4c7-6de27019a00c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:17.023733 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb893d0-918c-44d1-b4c7-6de27019a00c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:17.025101 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb893d0-918c-44d1-b4c7-6de27019a00c None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:17.030372 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a50fd-7fa9-428b-b9c6-75df6760fc38 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:17.030694 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 460/915] 10.222.0.60 () {56 vars in 1126 bytes} [Sat Sep 24 19:39:16 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:17.031524 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb893d0-918c-44d1-b4c7-6de27019a00c None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:17.054952 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:17.071648 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc9a40-682f-4748-9101-7c39c85809fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:17.072259 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc9a40-682f-4748-9101-7c39c85809fa None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:17.072592 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc9a40-682f-4748-9101-7c39c85809fa None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:17.076394 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc9a40-682f-4748-9101-7c39c85809fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:17.077124 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acc9a40-682f-4748-9101-7c39c85809fa None admin] RBAC: Adding query filter params (role.id=ccbad8fea592451d9078a68926df4aca, scope.project.id=5c2da88af5714e619238772bde676a42, user.id=fd597f74abdf49288ea0d92642c6a5a2) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:17.077442 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acc9a40-682f-4748-9101-7c39c85809fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:17.078915 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acc9a40-682f-4748-9101-7c39c85809fa None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:17.087751 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 456/916] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Sep 24 19:39:16 2022] GET /identity/v3/role_assignments?user.id=fd597f74abdf49288ea0d92642c6a5a2&scope.project.id=5c2da88af5714e619238772bde676a42&role.id=ccbad8fea592451d9078a68926df4aca => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:17.087751 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc9a40-682f-4748-9101-7c39c85809fa None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:17.166479 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb893d0-918c-44d1-b4c7-6de27019a00c None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:17.212898 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc9a40-682f-4748-9101-7c39c85809fa None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:17.214122 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f30969-6d56-4498-a7cd-bc154eb4a111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:17.215049 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f30969-6d56-4498-a7cd-bc154eb4a111 None admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:17.215614 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f30969-6d56-4498-a7cd-bc154eb4a111 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:17.216133 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f30969-6d56-4498-a7cd-bc154eb4a111 None admin] PATH_INFO: `/v3/services` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:17.216952 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f30969-6d56-4498-a7cd-bc154eb4a111 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:17.218581 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f30969-6d56-4498-a7cd-bc154eb4a111 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:17.226451 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:17.261097 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d79edf8-ea1b-4b44-a7fc-2e0700df02c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:17.261880 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79edf8-ea1b-4b44-a7fc-2e0700df02c5 None admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:17.262232 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79edf8-ea1b-4b44-a7fc-2e0700df02c5 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:17.262576 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79edf8-ea1b-4b44-a7fc-2e0700df02c5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:17.264971 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d79edf8-ea1b-4b44-a7fc-2e0700df02c5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:17.264971 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d79edf8-ea1b-4b44-a7fc-2e0700df02c5 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:17.325264 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 461/917] 10.222.0.60 () {60 vars in 1141 bytes} [Sat Sep 24 19:39:17 2022] POST /identity/v3/services => generated 241 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:39:17.359489 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 457/918] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:39:17 2022] POST /identity/v3/endpoints => generated 347 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:39:17.816960 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec049c8-ed26-406a-b2fe-d766d8cc0ffa None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:17.817486 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec049c8-ed26-406a-b2fe-d766d8cc0ffa None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:17.817763 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec049c8-ed26-406a-b2fe-d766d8cc0ffa None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:17.819492 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 462/919] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:39:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:39:17.825195 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d582a-266f-47ca-bf6d-f918208cb920 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:17.825665 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d582a-266f-47ca-bf6d-f918208cb920 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:17.826042 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d582a-266f-47ca-bf6d-f918208cb920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:17.848917 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-4b2d582a-266f-47ca-bf6d-f918208cb920 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:39:17.850323 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-4b2d582a-266f-47ca-bf6d-f918208cb920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:39:17.940025 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 458/920] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:39:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:39:18.216847 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec049c8-ed26-406a-b2fe-d766d8cc0ffa None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:18.313279 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:18.339849 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec049c8-ed26-406a-b2fe-d766d8cc0ffa None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:18.389871 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb269d4-1112-4f8c-a028-fe212e5eb32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:18.391171 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb269d4-1112-4f8c-a028-fe212e5eb32b None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:18.391450 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb269d4-1112-4f8c-a028-fe212e5eb32b None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:18.391721 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb269d4-1112-4f8c-a028-fe212e5eb32b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:18.392535 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb269d4-1112-4f8c-a028-fe212e5eb32b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:18.393980 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb269d4-1112-4f8c-a028-fe212e5eb32b None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:18.405986 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-adb269d4-1112-4f8c-a028-fe212e5eb32b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 24 19:39:18.405986 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:18.405986 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:39:18.405986 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:39:18.405986 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:39:18.405986 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:39:18.405986 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:39:18.405986 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:39:18.405986 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 24 19:39:18.405986 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:18.405986 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:39:18.405986 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:18.405986 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:18.405986 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:18.405986 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:18.405986 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:18.405986 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:18.408876 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:18.408876 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:18.408876 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:18.408876 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:18.408876 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:18.408876 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:18.408876 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:39:18.408876 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:39:18.408876 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:39:18.408876 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:39:18.408876 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:18.408876 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:18.408876 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:18.408876 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:18.408876 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:18.408876 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:18.411020 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:18.411020 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:18.411020 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:18.411020 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:18.411020 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:18.411020 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:18.411020 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:18.411020 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:18.411020 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:18.411020 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:18.411020 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:39:18.411020 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:39:18.411020 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 24 19:39:18.411020 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:18.411020 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 463/921] 10.222.0.60 () {56 vars in 1114 bytes} [Sat Sep 24 19:39:18 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:39:18.417514 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d582a-266f-47ca-bf6d-f918208cb920 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:18.514698 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:18.524502 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d582a-266f-47ca-bf6d-f918208cb920 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:18.563571 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1391cb-b8ce-4eec-8984-927e750f1b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:18.564583 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1391cb-b8ce-4eec-8984-927e750f1b6a None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:18.564972 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1391cb-b8ce-4eec-8984-927e750f1b6a None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:18.565250 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1391cb-b8ce-4eec-8984-927e750f1b6a None admin] PATH_INFO: `/v3/services` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:18.565926 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1391cb-b8ce-4eec-8984-927e750f1b6a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:18.566231 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1391cb-b8ce-4eec-8984-927e750f1b6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:18.567755 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1391cb-b8ce-4eec-8984-927e750f1b6a None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:18.573452 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 459/922] 10.222.0.60 () {56 vars in 1114 bytes} [Sat Sep 24 19:39:18 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:18.578794 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb269d4-1112-4f8c-a028-fe212e5eb32b None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:18.696471 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb269d4-1112-4f8c-a028-fe212e5eb32b None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:18.739260 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a12e0b-2e71-4961-aa75-dc2a510fcb85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:18.740261 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a12e0b-2e71-4961-aa75-dc2a510fcb85 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:18.740730 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a12e0b-2e71-4961-aa75-dc2a510fcb85 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:18.741208 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a12e0b-2e71-4961-aa75-dc2a510fcb85 None admin] PATH_INFO: `/v3/services` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:18.742365 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a12e0b-2e71-4961-aa75-dc2a510fcb85 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:18.742861 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a12e0b-2e71-4961-aa75-dc2a510fcb85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:18.744304 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a12e0b-2e71-4961-aa75-dc2a510fcb85 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:18.750334 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 464/923] 10.222.0.60 () {56 vars in 1114 bytes} [Sat Sep 24 19:39:18 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:39:18.756546 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1391cb-b8ce-4eec-8984-927e750f1b6a None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:18.881174 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1391cb-b8ce-4eec-8984-927e750f1b6a None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:18.919004 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a01fe8-1b79-460c-b3a5-3a5a38c35577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:18.919866 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a01fe8-1b79-460c-b3a5-3a5a38c35577 None admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:18.920294 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a01fe8-1b79-460c-b3a5-3a5a38c35577 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:18.920712 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a01fe8-1b79-460c-b3a5-3a5a38c35577 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:18.921571 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a01fe8-1b79-460c-b3a5-3a5a38c35577 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:18.923132 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a01fe8-1b79-460c-b3a5-3a5a38c35577 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:19.040701 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 460/924] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:39:18 2022] POST /identity/v3/endpoints => generated 346 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:39:19.387651 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a447a-51ec-45ce-82bc-1b55a42e1a04 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:19.388176 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a447a-51ec-45ce-82bc-1b55a42e1a04 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:19.388176 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a447a-51ec-45ce-82bc-1b55a42e1a04 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:19.389813 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 465/925] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:39:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:39:19.396230 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf7e41-303e-4649-8213-2ca025fc430d None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:19.396510 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf7e41-303e-4649-8213-2ca025fc430d None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:19.396788 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf7e41-303e-4649-8213-2ca025fc430d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:19.415917 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-5adf7e41-303e-4649-8213-2ca025fc430d None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:39:19.417122 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-5adf7e41-303e-4649-8213-2ca025fc430d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:39:19.426482 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:19.503446 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 461/926] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:39:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:39:19.734456 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8102257-3a26-46f0-833a-f82da6f1daff None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:19.734901 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8102257-3a26-46f0-833a-f82da6f1daff None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:19.735205 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8102257-3a26-46f0-833a-f82da6f1daff None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:19.736904 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 466/927] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:39:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:39:19.742466 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ce6a1-e8ce-4469-8162-a80408291356 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:19.742759 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ce6a1-e8ce-4469-8162-a80408291356 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:19.743037 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ce6a1-e8ce-4469-8162-a80408291356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:19.761893 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-640ce6a1-e8ce-4469-8162-a80408291356 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:39:19.763082 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-640ce6a1-e8ce-4469-8162-a80408291356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:39:19.775815 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c60ce9c-dcaf-4bc4-8c86-7ed4c218d81c None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:19.776122 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c60ce9c-dcaf-4bc4-8c86-7ed4c218d81c None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:19.776408 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c60ce9c-dcaf-4bc4-8c86-7ed4c218d81c None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:19.778077 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 467/928] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:39:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:39:19.778780 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c60ce9c-dcaf-4bc4-8c86-7ed4c218d81c None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:19.785825 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:19.853841 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 462/929] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:39:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:39:19.855087 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86ed8b-f47c-4aa4-83cb-e09bef5128da None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:19.855367 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86ed8b-f47c-4aa4-83cb-e09bef5128da None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:19.855794 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86ed8b-f47c-4aa4-83cb-e09bef5128da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:19.874801 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-cb86ed8b-f47c-4aa4-83cb-e09bef5128da None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:39:19.876850 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-cb86ed8b-f47c-4aa4-83cb-e09bef5128da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:39:19.920595 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c60ce9c-dcaf-4bc4-8c86-7ed4c218d81c None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:19.949544 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:19.955347 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 463/930] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:39:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:39:19.968576 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b9bf9-f567-4d54-bb99-6512bd82c886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:19.969611 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b9bf9-f567-4d54-bb99-6512bd82c886 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:19.970629 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b9bf9-f567-4d54-bb99-6512bd82c886 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:19.971100 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b9bf9-f567-4d54-bb99-6512bd82c886 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:19.983375 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013b9bf9-f567-4d54-bb99-6512bd82c886 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:39:19.989584 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-013b9bf9-f567-4d54-bb99-6512bd82c886 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 24 19:39:19.989584 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:19.989584 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:19.989584 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:19.989584 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:19.989584 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:19.989584 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:19.989584 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:19.989584 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:19.989584 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:19.989584 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:19.989584 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:19.989584 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:39:19.989584 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:39:19.989584 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:39:19.989584 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:39:19.990663 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:39:19.990663 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:39:19.990663 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:39:19.990663 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:39:19.990663 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:19.990663 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:19.990663 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:19.990663 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:19.990663 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:19.990663 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:19.990663 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:19.990663 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:19.990663 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:19.990663 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:19.990663 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:19.990663 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:19.991507 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:19.991507 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:19.991507 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:19.991507 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:19.991507 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:39:19.991507 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:39:19.991507 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:39:19.991507 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:39:19.991507 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:39:19.991507 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:39:19.991507 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 24 19:39:19.991507 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:19.994194 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 468/931] 10.222.0.60 () {56 vars in 1120 bytes} [Sat Sep 24 19:39:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:39:20.001818 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb86ed8b-f47c-4aa4-83cb-e09bef5128da None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:20.127888 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb86ed8b-f47c-4aa4-83cb-e09bef5128da None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:20.131417 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b9bf9-f567-4d54-bb99-6512bd82c886 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:20.182811 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f548b4-99a7-4c70-bc7a-e50ee7d456de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:20.183426 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f548b4-99a7-4c70-bc7a-e50ee7d456de None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:20.183759 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f548b4-99a7-4c70-bc7a-e50ee7d456de None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:20.184026 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f548b4-99a7-4c70-bc7a-e50ee7d456de None admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:20.184698 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f548b4-99a7-4c70-bc7a-e50ee7d456de None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:20.184997 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f548b4-99a7-4c70-bc7a-e50ee7d456de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:20.186475 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f548b4-99a7-4c70-bc7a-e50ee7d456de None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:20.196861 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 464/932] 10.222.0.60 () {56 vars in 1115 bytes} [Sat Sep 24 19:39:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:20.202676 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f548b4-99a7-4c70-bc7a-e50ee7d456de None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:20.210305 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:20.260667 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b9bf9-f567-4d54-bb99-6512bd82c886 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:20.279893 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:20.303553 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8659f519-f5f9-432c-b0f7-8431958d894c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:20.304342 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659f519-f5f9-432c-b0f7-8431958d894c None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:20.304615 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659f519-f5f9-432c-b0f7-8431958d894c None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:20.304878 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659f519-f5f9-432c-b0f7-8431958d894c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:20.305462 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8659f519-f5f9-432c-b0f7-8431958d894c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:20.306869 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8659f519-f5f9-432c-b0f7-8431958d894c None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:20.316099 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-8659f519-f5f9-432c-b0f7-8431958d894c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 24 19:39:20.316099 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:20.316099 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:39:20.316099 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:39:20.316099 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:39:20.316099 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:39:20.316099 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:39:20.316099 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:39:20.316099 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 24 19:39:20.316099 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:20.316099 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:39:20.316099 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:20.316099 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:20.316099 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:20.316099 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:20.316099 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:20.316099 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:20.317431 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:20.317431 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:20.317431 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:20.317431 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:20.317431 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:20.317431 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:20.317431 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:39:20.317431 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:39:20.317431 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:39:20.317431 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:39:20.317431 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:20.317431 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:20.317431 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:20.317431 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:20.317431 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:20.317431 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:20.318607 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:20.318607 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:20.318607 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:20.318607 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:20.318607 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:20.318607 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:20.318607 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:20.318607 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:20.318607 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:20.318607 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:20.318607 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:39:20.318607 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:39:20.318607 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 24 19:39:20.318607 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:20.318607 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 469/933] 10.222.0.60 () {56 vars in 1126 bytes} [Sat Sep 24 19:39:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:39:20.319420 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8659f519-f5f9-432c-b0f7-8431958d894c None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:20.335995 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f548b4-99a7-4c70-bc7a-e50ee7d456de None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:20.379492 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae38b4f-2698-4d72-9c3e-2ad4c81f184e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:20.380135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae38b4f-2698-4d72-9c3e-2ad4c81f184e None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:20.380419 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae38b4f-2698-4d72-9c3e-2ad4c81f184e None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:20.380691 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae38b4f-2698-4d72-9c3e-2ad4c81f184e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:20.394001 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae38b4f-2698-4d72-9c3e-2ad4c81f184e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:20.395515 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae38b4f-2698-4d72-9c3e-2ad4c81f184e None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:20.413004 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-6ae38b4f-2698-4d72-9c3e-2ad4c81f184e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:39:20.413004 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:20.413004 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:20.413004 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:20.413004 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:20.413004 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:20.413004 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:20.413004 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:20.413004 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:20.413004 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:20.413004 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:20.413004 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:20.413004 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:39:20.413004 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:39:20.413004 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:39:20.413004 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:39:20.414096 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:20.414096 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:20.414096 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:20.414096 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:20.414096 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:20.414096 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:20.414096 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:20.414096 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:20.414096 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:20.414096 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:20.414096 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:20.414096 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:20.414096 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:20.414096 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:20.414096 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:20.414096 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:20.414096 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:39:20.414987 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:39:20.414987 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:39:20.414987 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:39:20.414987 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 465/934] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:39:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:39:20.414987 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae38b4f-2698-4d72-9c3e-2ad4c81f184e None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:20.450713 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8659f519-f5f9-432c-b0f7-8431958d894c None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:20.484732 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:20.493570 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155039a4-a001-407f-84a3-fbabd9c40c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:20.494209 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155039a4-a001-407f-84a3-fbabd9c40c77 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:20.494484 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155039a4-a001-407f-84a3-fbabd9c40c77 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:20.494754 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155039a4-a001-407f-84a3-fbabd9c40c77 None admin] PATH_INFO: `/v3/services/compute` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:20.495329 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155039a4-a001-407f-84a3-fbabd9c40c77 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:20.497839 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155039a4-a001-407f-84a3-fbabd9c40c77 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:20.514635 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-155039a4-a001-407f-84a3-fbabd9c40c77 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 24 19:39:20.514635 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:20.514635 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:39:20.514635 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:39:20.514635 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:39:20.514635 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:39:20.514635 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:39:20.514635 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:39:20.514635 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 24 19:39:20.514635 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:20.514635 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:39:20.514635 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:20.514635 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:20.514635 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:20.514635 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:20.514635 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:20.514635 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:20.515750 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:20.515750 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:20.515750 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:20.515750 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:20.515750 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:20.515750 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:20.515750 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:39:20.515750 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:39:20.515750 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:39:20.515750 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:39:20.515750 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:20.515750 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:20.515750 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:20.515750 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:20.515750 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:20.515750 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:20.516600 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:20.516600 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:20.516600 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:20.516600 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:20.516600 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:20.516600 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:20.516600 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:20.516600 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:20.516600 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:20.516600 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:20.516600 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:39:20.516600 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:39:20.516600 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 24 19:39:20.516600 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:20.516600 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 470/935] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Sep 24 19:39:20 2022] GET /identity/v3/services/compute => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:39:20.518217 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155039a4-a001-407f-84a3-fbabd9c40c77 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:20.541545 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae38b4f-2698-4d72-9c3e-2ad4c81f184e None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:20.556488 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:20.578762 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05e26c-ea06-4feb-a328-8ebfe4669132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:20.580085 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05e26c-ea06-4feb-a328-8ebfe4669132 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:20.580312 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05e26c-ea06-4feb-a328-8ebfe4669132 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:20.580597 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05e26c-ea06-4feb-a328-8ebfe4669132 None admin] PATH_INFO: `/v3/services` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:20.581231 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf05e26c-ea06-4feb-a328-8ebfe4669132 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:20.581565 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf05e26c-ea06-4feb-a328-8ebfe4669132 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:20.583107 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf05e26c-ea06-4feb-a328-8ebfe4669132 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:20.588186 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 466/936] 10.222.0.60 () {56 vars in 1122 bytes} [Sat Sep 24 19:39:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:20.589011 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05e26c-ea06-4feb-a328-8ebfe4669132 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:20.643999 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155039a4-a001-407f-84a3-fbabd9c40c77 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:20.694705 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a3c0c-9d68-44c6-be38-ecd337ea2e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:20.695322 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a3c0c-9d68-44c6-be38-ecd337ea2e6a None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:20.695598 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a3c0c-9d68-44c6-be38-ecd337ea2e6a None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:20.695865 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a3c0c-9d68-44c6-be38-ecd337ea2e6a None admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:20.696619 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744a3c0c-9d68-44c6-be38-ecd337ea2e6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:20.696924 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744a3c0c-9d68-44c6-be38-ecd337ea2e6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:20.698336 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744a3c0c-9d68-44c6-be38-ecd337ea2e6a None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:20.711340 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 471/937] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:39:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:20.716554 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a3c0c-9d68-44c6-be38-ecd337ea2e6a None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:20.720735 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05e26c-ea06-4feb-a328-8ebfe4669132 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:20.756247 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca027c-3542-45d1-9e17-49e672b7b2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:20.756781 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca027c-3542-45d1-9e17-49e672b7b2eb None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:20.757066 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca027c-3542-45d1-9e17-49e672b7b2eb None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:20.757342 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca027c-3542-45d1-9e17-49e672b7b2eb None admin] PATH_INFO: `/v3/services` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:20.758004 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ca027c-3542-45d1-9e17-49e672b7b2eb None admin] RBAC: Adding query filter params (name=compute) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:20.758311 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ca027c-3542-45d1-9e17-49e672b7b2eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:20.759663 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ca027c-3542-45d1-9e17-49e672b7b2eb None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:20.764714 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 467/938] 10.222.0.60 () {56 vars in 1112 bytes} [Sat Sep 24 19:39:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:20.766568 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca027c-3542-45d1-9e17-49e672b7b2eb None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:20.779687 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:20.818731 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:20.838103 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a3c0c-9d68-44c6-be38-ecd337ea2e6a None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:20.885900 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca027c-3542-45d1-9e17-49e672b7b2eb None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:20.886590 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a873e89c-d7b9-43f6-af24-d2e186477967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:20.887283 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873e89c-d7b9-43f6-af24-d2e186477967 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:20.887571 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873e89c-d7b9-43f6-af24-d2e186477967 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:20.887837 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873e89c-d7b9-43f6-af24-d2e186477967 None admin] PATH_INFO: `/v3/services` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:20.888476 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a873e89c-d7b9-43f6-af24-d2e186477967 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:20.888778 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a873e89c-d7b9-43f6-af24-d2e186477967 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:20.890229 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a873e89c-d7b9-43f6-af24-d2e186477967 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:20.896267 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 472/939] 10.222.0.60 () {56 vars in 1122 bytes} [Sat Sep 24 19:39:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:20.897074 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a873e89c-d7b9-43f6-af24-d2e186477967 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:20.930451 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4fa5e-5277-438c-8a16-d8c6100932ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:20.931095 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4fa5e-5277-438c-8a16-d8c6100932ad None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:20.931378 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4fa5e-5277-438c-8a16-d8c6100932ad None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:20.931650 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4fa5e-5277-438c-8a16-d8c6100932ad None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:20.943148 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf4fa5e-5277-438c-8a16-d8c6100932ad None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:20.945018 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf4fa5e-5277-438c-8a16-d8c6100932ad None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:20.958209 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-5cf4fa5e-5277-438c-8a16-d8c6100932ad None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 24 19:39:20.958209 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:20.958209 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:20.958209 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:20.958209 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:20.958209 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:20.958209 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:20.958209 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:20.958209 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:20.958209 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:20.958209 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:20.958209 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:20.958209 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:39:20.958209 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:39:20.958209 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:39:20.958209 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:39:20.959235 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:20.959235 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:20.959235 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:39:20.959235 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:39:20.959235 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:39:20.959235 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:39:20.959235 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:20.959235 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:20.959235 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:20.959235 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:20.959235 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:20.959235 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:20.959235 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:20.959235 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:20.959235 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:20.959235 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:20.959235 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:20.959235 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:20.960159 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:20.960159 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:20.960159 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:39:20.960159 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:39:20.960159 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:39:20.960159 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:39:20.960159 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:39:20.960159 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:39:20.960159 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 24 19:39:20.960159 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:39:20.960159 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 468/940] 10.222.0.60 () {56 vars in 1117 bytes} [Sat Sep 24 19:39:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:39:20.960159 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4fa5e-5277-438c-8a16-d8c6100932ad None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:21.021561 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a873e89c-d7b9-43f6-af24-d2e186477967 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:21.039972 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:21.065412 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa675a2-ad6a-46d4-8812-d3731ee6d893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:21.066371 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa675a2-ad6a-46d4-8812-d3731ee6d893 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:21.066652 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa675a2-ad6a-46d4-8812-d3731ee6d893 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:21.066923 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa675a2-ad6a-46d4-8812-d3731ee6d893 None admin] PATH_INFO: `/v3/services` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:21.067758 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa675a2-ad6a-46d4-8812-d3731ee6d893 None admin] RBAC: Adding query filter params (type=compute) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:21.068068 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa675a2-ad6a-46d4-8812-d3731ee6d893 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:21.070253 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa675a2-ad6a-46d4-8812-d3731ee6d893 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:21.086446 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 473/941] 10.222.0.60 () {56 vars in 1112 bytes} [Sat Sep 24 19:39:20 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:21.087135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:21.088255 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa675a2-ad6a-46d4-8812-d3731ee6d893 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:21.091118 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4fa5e-5277-438c-8a16-d8c6100932ad None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:21.161108 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549c3249-4948-4fe7-8f56-25ce354b6ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:21.163330 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c3249-4948-4fe7-8f56-25ce354b6ab1 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:21.163814 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c3249-4948-4fe7-8f56-25ce354b6ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:21.164294 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c3249-4948-4fe7-8f56-25ce354b6ab1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:21.165183 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549c3249-4948-4fe7-8f56-25ce354b6ab1 None admin] RBAC: Adding query filter params (interface=public, service_id=ef0a4a43b5524190ad736085da85af2e, region_id=RegionOne) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:21.165673 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549c3249-4948-4fe7-8f56-25ce354b6ab1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:21.168242 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549c3249-4948-4fe7-8f56-25ce354b6ab1 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:21.182448 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 469/942] 10.222.0.60 () {56 vars in 1251 bytes} [Sat Sep 24 19:39:20 2022] GET /identity/v3/endpoints?service_id=ef0a4a43b5524190ad736085da85af2e&interface=public®ion_id=RegionOne => generated 194 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:21.183849 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549c3249-4948-4fe7-8f56-25ce354b6ab1 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:21.245819 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa675a2-ad6a-46d4-8812-d3731ee6d893 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:21.302935 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e070f-9ede-4da7-a2ea-eb365fa7ac07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:21.303557 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e070f-9ede-4da7-a2ea-eb365fa7ac07 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:21.303831 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e070f-9ede-4da7-a2ea-eb365fa7ac07 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:21.304099 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e070f-9ede-4da7-a2ea-eb365fa7ac07 None admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:21.304827 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473e070f-9ede-4da7-a2ea-eb365fa7ac07 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:21.305127 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473e070f-9ede-4da7-a2ea-eb365fa7ac07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:21.307209 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473e070f-9ede-4da7-a2ea-eb365fa7ac07 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:21.327449 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549c3249-4948-4fe7-8f56-25ce354b6ab1 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:21.333069 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 474/943] 10.222.0.60 () {56 vars in 1149 bytes} [Sat Sep 24 19:39:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:21.338810 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e070f-9ede-4da7-a2ea-eb365fa7ac07 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:21.370674 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d3ed3b-addd-421c-84e8-281cec8db9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:21.371407 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3ed3b-addd-421c-84e8-281cec8db9ed None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:21.371680 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3ed3b-addd-421c-84e8-281cec8db9ed None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:21.371953 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3ed3b-addd-421c-84e8-281cec8db9ed None admin] PATH_INFO: `/v3/services` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:21.372561 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d3ed3b-addd-421c-84e8-281cec8db9ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:21.373970 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d3ed3b-addd-421c-84e8-281cec8db9ed None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:21.381558 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 470/944] 10.222.0.60 () {56 vars in 1087 bytes} [Sat Sep 24 19:39:21 2022] GET /identity/v3/services => generated 1497 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:39:21.382858 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b54fa-dba2-432e-99b2-12fab21e0fb9 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:21.383141 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b54fa-dba2-432e-99b2-12fab21e0fb9 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:21.383415 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b54fa-dba2-432e-99b2-12fab21e0fb9 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:21.384897 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 471/945] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:39:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:39:21.390775 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc182367-9079-4e0d-81d6-1aba2d26df52 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:21.391083 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc182367-9079-4e0d-81d6-1aba2d26df52 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:21.391423 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc182367-9079-4e0d-81d6-1aba2d26df52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:21.395281 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:21.418835 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-cc182367-9079-4e0d-81d6-1aba2d26df52 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:39:21.420299 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-cc182367-9079-4e0d-81d6-1aba2d26df52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:39:21.453474 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:21.488134 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e070f-9ede-4da7-a2ea-eb365fa7ac07 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:21.527529 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 472/946] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:39:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 19:39:21.541844 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f8116f-ef85-41f6-9ebf-76185a42050d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:21.542881 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f8116f-ef85-41f6-9ebf-76185a42050d None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:21.543362 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f8116f-ef85-41f6-9ebf-76185a42050d None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:21.543860 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f8116f-ef85-41f6-9ebf-76185a42050d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:21.556965 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f8116f-ef85-41f6-9ebf-76185a42050d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:21.558888 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f8116f-ef85-41f6-9ebf-76185a42050d None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:21.575617 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-69f8116f-ef85-41f6-9ebf-76185a42050d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:39:21.575617 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:21.575617 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:21.575617 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:21.575617 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:21.575617 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:21.575617 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:21.575617 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:21.575617 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:21.575617 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:21.575617 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:21.575617 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:21.575617 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:39:21.575617 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:39:21.575617 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:39:21.575617 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:39:21.576616 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:21.576616 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:21.576616 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:21.576616 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:21.576616 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:21.576616 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:21.576616 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:21.576616 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:21.576616 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:21.576616 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:21.576616 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:21.576616 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:21.576616 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:21.576616 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:21.576616 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:21.576616 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:21.576616 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:39:21.577486 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:39:21.577486 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:39:21.577486 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:21.581549 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 475/947] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:39:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:39:21.589140 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc182367-9079-4e0d-81d6-1aba2d26df52 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:21.710868 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc182367-9079-4e0d-81d6-1aba2d26df52 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:21.750732 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5545d82-3906-4cf3-bbc8-6dd9fdc21145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:21.751418 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5545d82-3906-4cf3-bbc8-6dd9fdc21145 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:21.751698 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5545d82-3906-4cf3-bbc8-6dd9fdc21145 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:21.751971 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5545d82-3906-4cf3-bbc8-6dd9fdc21145 None admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:21.752622 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5545d82-3906-4cf3-bbc8-6dd9fdc21145 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:21.752927 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5545d82-3906-4cf3-bbc8-6dd9fdc21145 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:21.754579 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5545d82-3906-4cf3-bbc8-6dd9fdc21145 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:21.768721 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 473/948] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:21.774380 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f8116f-ef85-41f6-9ebf-76185a42050d None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:21.834651 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5545d82-3906-4cf3-bbc8-6dd9fdc21145 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:21.860946 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:21.886451 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:21.902465 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f8116f-ef85-41f6-9ebf-76185a42050d None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:21.952474 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089f70d3-bbbd-48f7-8d62-6abe5ec8d640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:21.953677 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f70d3-bbbd-48f7-8d62-6abe5ec8d640 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:21.954115 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f70d3-bbbd-48f7-8d62-6abe5ec8d640 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:21.955008 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f70d3-bbbd-48f7-8d62-6abe5ec8d640 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:21.966923 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089f70d3-bbbd-48f7-8d62-6abe5ec8d640 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:21.969736 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089f70d3-bbbd-48f7-8d62-6abe5ec8d640 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:21.985217 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5545d82-3906-4cf3-bbc8-6dd9fdc21145 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:21.986759 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-089f70d3-bbbd-48f7-8d62-6abe5ec8d640 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:39:21.986759 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:21.986759 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:21.986759 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:21.986759 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:21.986759 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:21.986759 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:21.986759 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:21.986759 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:21.986759 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:21.986759 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:21.986759 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:21.986759 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:39:21.986759 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:39:21.986759 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:39:21.987633 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:39:21.987633 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:21.987633 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:21.987633 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:21.987633 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:21.987633 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:21.987633 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:21.987633 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:21.987633 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:21.987633 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:21.987633 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:21.987633 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:21.987633 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:21.987633 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:21.987633 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:21.987633 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:21.987633 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:21.988533 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:39:21.988533 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:39:21.988533 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:39:21.988533 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:39:21.988533 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:39:21.988533 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:39:21.988533 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:39:21.988533 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:21.993056 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 476/949] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Sep 24 19:39:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:39:21.994289 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089f70d3-bbbd-48f7-8d62-6abe5ec8d640 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:22.042509 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aece83e-3d76-4e4e-81ea-6229cecf9f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:22.043142 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aece83e-3d76-4e4e-81ea-6229cecf9f15 None admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:22.043420 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aece83e-3d76-4e4e-81ea-6229cecf9f15 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:22.043691 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aece83e-3d76-4e4e-81ea-6229cecf9f15 None admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:22.044345 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aece83e-3d76-4e4e-81ea-6229cecf9f15 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:22.045813 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aece83e-3d76-4e4e-81ea-6229cecf9f15 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:22.049299 dv-cinder-859191-1-smb devstack@keystone.service[93400]: WARNING keystone.server.flask.common [None req-2aece83e-3d76-4e4e-81ea-6229cecf9f15 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 24 19:39:22.096097 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.sql.core [None req-2aece83e-3d76-4e4e-81ea-6229cecf9f15 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 24 19:39:22.096097 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 24 19:39:22.096097 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [parameters: {'id': 'e09a86c483e84ad293782d7eb15c4353', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 24 19:39:22.096097 dv-cinder-859191-1-smb devstack@keystone.service[93400]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93400) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 24 19:39:22.118282 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-2aece83e-3d76-4e4e-81ea-6229cecf9f15 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e09a86c483e84ad293782d7eb15c4353.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e09a86c483e84ad293782d7eb15c4353. Sep 24 19:39:22.118282 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:22.118282 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 24 19:39:22.118282 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 24 19:39:22.118282 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 24 19:39:22.118282 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 24 19:39:22.118282 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 24 19:39:22.118282 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application result = self._query(query) Sep 24 19:39:22.118282 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 24 19:39:22.118282 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application conn.query(q) Sep 24 19:39:22.118282 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 24 19:39:22.118282 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 24 19:39:22.118282 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 24 19:39:22.119170 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application result.read() Sep 24 19:39:22.119170 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 24 19:39:22.119170 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 24 19:39:22.119170 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 24 19:39:22.119170 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 24 19:39:22.119170 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 24 19:39:22.119170 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 24 19:39:22.119170 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 24 19:39:22.119170 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 24 19:39:22.119170 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 24 19:39:22.119170 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:39:22.119170 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 24 19:39:22.119170 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:39:22.119170 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:22.119170 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 24 19:39:22.119170 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 24 19:39:22.119170 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 24 19:39:22.119170 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 24 19:39:22.120110 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 24 19:39:22.120110 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application next(self.gen) Sep 24 19:39:22.120110 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 24 19:39:22.120110 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application yield resource Sep 24 19:39:22.120110 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 24 19:39:22.120110 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application next(self.gen) Sep 24 19:39:22.120110 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 24 19:39:22.120110 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application self.session.rollback() Sep 24 19:39:22.120110 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 24 19:39:22.120110 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application self.force_reraise() Sep 24 19:39:22.120110 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 24 19:39:22.120110 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise self.value Sep 24 19:39:22.120110 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 24 19:39:22.120110 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 24 19:39:22.120110 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 24 19:39:22.120110 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application session.commit() Sep 24 19:39:22.120110 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 24 19:39:22.121017 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 24 19:39:22.121017 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 24 19:39:22.121017 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application self._prepare_impl() Sep 24 19:39:22.121017 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 24 19:39:22.121017 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application self.session.flush() Sep 24 19:39:22.121017 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 24 19:39:22.121017 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application self._flush(objects) Sep 24 19:39:22.121017 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 24 19:39:22.121017 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 24 19:39:22.121017 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 24 19:39:22.121017 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application compat.raise_( Sep 24 19:39:22.121017 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 24 19:39:22.121017 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception Sep 24 19:39:22.121017 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 24 19:39:22.121017 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application flush_context.execute() Sep 24 19:39:22.121017 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 24 19:39:22.121017 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rec.execute(self) Sep 24 19:39:22.121958 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 24 19:39:22.121958 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 24 19:39:22.121958 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 24 19:39:22.121958 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 24 19:39:22.121958 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 24 19:39:22.121958 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 24 19:39:22.121958 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 24 19:39:22.121958 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 24 19:39:22.121958 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 24 19:39:22.121958 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 24 19:39:22.121958 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 24 19:39:22.121958 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 24 19:39:22.121958 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 24 19:39:22.121958 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 24 19:39:22.121958 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 24 19:39:22.122757 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 24 19:39:22.122757 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 24 19:39:22.122757 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception Sep 24 19:39:22.122757 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 24 19:39:22.122757 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 24 19:39:22.122757 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 24 19:39:22.122757 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 24 19:39:22.122757 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 24 19:39:22.122757 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application result = self._query(query) Sep 24 19:39:22.122757 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 24 19:39:22.122757 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application conn.query(q) Sep 24 19:39:22.122757 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 24 19:39:22.122757 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 24 19:39:22.122757 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 24 19:39:22.122757 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application result.read() Sep 24 19:39:22.122757 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 24 19:39:22.122757 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 24 19:39:22.123616 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 24 19:39:22.123616 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 24 19:39:22.123616 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 24 19:39:22.123616 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 24 19:39:22.123616 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 24 19:39:22.123616 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 24 19:39:22.123616 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 24 19:39:22.123616 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 24 19:39:22.123616 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [parameters: {'id': 'e09a86c483e84ad293782d7eb15c4353', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 24 19:39:22.123616 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 24 19:39:22.123616 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:39:22.123616 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:39:22.123616 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:39:22.123616 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:22.123616 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 24 19:39:22.124392 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 24 19:39:22.124392 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 24 19:39:22.124392 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 24 19:39:22.124392 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 24 19:39:22.124392 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:39:22.124392 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:39:22.124392 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:39:22.124392 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:22.124392 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:22.124392 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:22.124392 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:22.124392 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:22.124392 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:22.124392 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:22.124392 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:22.124392 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:22.124392 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:22.125464 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:22.125464 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 24 19:39:22.125464 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 24 19:39:22.125464 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:22.125464 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:22.125464 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 24 19:39:22.125464 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 24 19:39:22.125464 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e09a86c483e84ad293782d7eb15c4353. Sep 24 19:39:22.125464 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:39:22.125464 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 474/950] 10.222.0.60 () {60 vars in 1140 bytes} [Sat Sep 24 19:39:21 2022] POST /identity/v3/projects => generated 262 bytes in 288 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:39:22.131315 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aece83e-3d76-4e4e-81ea-6229cecf9f15 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:22.134350 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089f70d3-bbbd-48f7-8d62-6abe5ec8d640 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:22.176602 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd90f0-d9e7-43cc-8c3c-3bb81351abac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:22.177422 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd90f0-d9e7-43cc-8c3c-3bb81351abac None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:22.177824 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd90f0-d9e7-43cc-8c3c-3bb81351abac None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:22.178263 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd90f0-d9e7-43cc-8c3c-3bb81351abac None admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:22.179104 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dd90f0-d9e7-43cc-8c3c-3bb81351abac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:22.179514 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dd90f0-d9e7-43cc-8c3c-3bb81351abac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:22.181320 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dd90f0-d9e7-43cc-8c3c-3bb81351abac None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:22.197541 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 477/951] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Sep 24 19:39:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:22.201969 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd90f0-d9e7-43cc-8c3c-3bb81351abac None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:22.217150 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:22.243940 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:22.275603 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aece83e-3d76-4e4e-81ea-6229cecf9f15 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:22.315547 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136aefe6-80c2-4cb5-beb9-a1f57a78ffbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:22.316204 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136aefe6-80c2-4cb5-beb9-a1f57a78ffbc None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:22.316489 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136aefe6-80c2-4cb5-beb9-a1f57a78ffbc None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:22.316831 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136aefe6-80c2-4cb5-beb9-a1f57a78ffbc None admin] PATH_INFO: `/v3/projects/service` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:22.325467 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136aefe6-80c2-4cb5-beb9-a1f57a78ffbc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:22.325849 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd90f0-d9e7-43cc-8c3c-3bb81351abac None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:22.327232 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136aefe6-80c2-4cb5-beb9-a1f57a78ffbc None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:22.341402 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-136aefe6-80c2-4cb5-beb9-a1f57a78ffbc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:39:22.341402 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:22.341402 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:22.341402 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:22.341402 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:22.341402 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:22.341402 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:22.341402 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:22.341402 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:22.341402 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:22.341402 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:22.341402 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:22.341402 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:39:22.341402 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:39:22.341402 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:39:22.342456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:39:22.342456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:22.342456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:22.342456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:22.342456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:22.342456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:22.342456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:22.342456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:22.342456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:22.342456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:22.342456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:22.342456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:22.342456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:22.342456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:22.342456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:22.342456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:22.342456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:22.343477 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:39:22.343477 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:39:22.343477 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:39:22.343477 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:39:22.343477 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:39:22.343477 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:39:22.343477 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:39:22.343477 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:39:22.348299 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 475/952] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Sep 24 19:39:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:39:22.349294 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136aefe6-80c2-4cb5-beb9-a1f57a78ffbc None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:22.371575 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d20fb-21a2-486a-820a-f125085299c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:22.372604 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d20fb-21a2-486a-820a-f125085299c2 None admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:22.373069 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d20fb-21a2-486a-820a-f125085299c2 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:22.373527 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d20fb-21a2-486a-820a-f125085299c2 None admin] PATH_INFO: `/v3/projects/5c2da88af5714e619238772bde676a42/users/fd597f74abdf49288ea0d92642c6a5a2/roles/ccbad8fea592451d9078a68926df4aca` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:22.376943 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168d20fb-21a2-486a-820a-f125085299c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=5c2da88af5714e619238772bde676a42, user_id=fd597f74abdf49288ea0d92642c6a5a2, role_id=ccbad8fea592451d9078a68926df4aca)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:22.379318 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168d20fb-21a2-486a-820a-f125085299c2 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:22.448252 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 478/953] 10.222.0.60 () {58 vars in 1439 bytes} [Sat Sep 24 19:39:22 2022] PUT /identity/v3/projects/5c2da88af5714e619238772bde676a42/users/fd597f74abdf49288ea0d92642c6a5a2/roles/ccbad8fea592451d9078a68926df4aca => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:39:22.481261 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136aefe6-80c2-4cb5-beb9-a1f57a78ffbc None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:22.527524 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d758f4f4-df68-4653-b0cb-71fd43d73d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:22.528445 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758f4f4-df68-4653-b0cb-71fd43d73d35 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:22.528867 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758f4f4-df68-4653-b0cb-71fd43d73d35 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:22.529315 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758f4f4-df68-4653-b0cb-71fd43d73d35 None admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:22.530385 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d758f4f4-df68-4653-b0cb-71fd43d73d35 None admin] RBAC: Adding query filter params (name=service) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:22.530844 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d758f4f4-df68-4653-b0cb-71fd43d73d35 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:22.533280 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d758f4f4-df68-4653-b0cb-71fd43d73d35 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:22.536587 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:22.560912 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 476/954] 10.222.0.60 () {56 vars in 1112 bytes} [Sat Sep 24 19:39:22 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:23.414077 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a779e-bb19-48d4-bd55-0945f7253916 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:23.414619 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a779e-bb19-48d4-bd55-0945f7253916 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:23.414619 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a779e-bb19-48d4-bd55-0945f7253916 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:23.416325 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 479/955] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:39:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:39:23.422722 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee75e63-0d12-415a-80ce-c151a4efbda1 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:23.423999 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee75e63-0d12-415a-80ce-c151a4efbda1 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:23.424299 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee75e63-0d12-415a-80ce-c151a4efbda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:23.445151 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-8ee75e63-0d12-415a-80ce-c151a4efbda1 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:39:23.446722 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-8ee75e63-0d12-415a-80ce-c151a4efbda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:39:23.525660 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 477/956] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:39:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 19:39:23.715866 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef664f65-4ca3-476e-aebe-6fcc1bdbafa7 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:23.716301 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef664f65-4ca3-476e-aebe-6fcc1bdbafa7 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:23.716464 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef664f65-4ca3-476e-aebe-6fcc1bdbafa7 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:23.718059 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 480/957] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:39:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:39:23.724370 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f0429-c16a-44b4-9225-a7eddce013c9 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:23.724910 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f0429-c16a-44b4-9225-a7eddce013c9 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:23.725397 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f0429-c16a-44b4-9225-a7eddce013c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:23.745606 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-568f0429-c16a-44b4-9225-a7eddce013c9 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:39:23.747195 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-568f0429-c16a-44b4-9225-a7eddce013c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:39:23.803900 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef664f65-4ca3-476e-aebe-6fcc1bdbafa7 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:23.825670 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 478/958] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:39:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:39:23.883632 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:23.920972 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef664f65-4ca3-476e-aebe-6fcc1bdbafa7 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:23.961028 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243aeea8-4952-44e9-8d72-7c206a8f93cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:23.961592 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243aeea8-4952-44e9-8d72-7c206a8f93cf None admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:23.961876 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243aeea8-4952-44e9-8d72-7c206a8f93cf None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:23.962147 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243aeea8-4952-44e9-8d72-7c206a8f93cf None admin] PATH_INFO: `/v3/services` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:23.962867 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243aeea8-4952-44e9-8d72-7c206a8f93cf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:23.964318 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243aeea8-4952-44e9-8d72-7c206a8f93cf None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:24.034674 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 481/959] 10.222.0.60 () {60 vars in 1141 bytes} [Sat Sep 24 19:39:23 2022] POST /identity/v3/services => generated 242 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:39:24.103131 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f0429-c16a-44b4-9225-a7eddce013c9 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:24.177828 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:24.242633 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f0429-c16a-44b4-9225-a7eddce013c9 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:24.287592 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614b58d-9bd1-4046-98b2-e2ceb1b5a620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:24.288228 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614b58d-9bd1-4046-98b2-e2ceb1b5a620 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:24.288504 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614b58d-9bd1-4046-98b2-e2ceb1b5a620 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:24.288774 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614b58d-9bd1-4046-98b2-e2ceb1b5a620 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:24.289361 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a614b58d-9bd1-4046-98b2-e2ceb1b5a620 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:24.290751 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a614b58d-9bd1-4046-98b2-e2ceb1b5a620 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:24.300475 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-a614b58d-9bd1-4046-98b2-e2ceb1b5a620 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 24 19:39:24.300475 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:24.300475 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:39:24.300475 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:39:24.300475 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:39:24.300475 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:39:24.300475 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:39:24.300475 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:39:24.300475 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 24 19:39:24.300475 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:39:24.300475 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:39:24.300475 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:39:24.300475 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:24.300475 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:24.300475 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:24.300475 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:24.300475 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:24.301668 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:24.301668 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:24.301668 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:24.301668 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:24.301668 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:24.301668 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:24.301668 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:39:24.301668 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:39:24.301668 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:39:24.301668 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:39:24.301668 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:24.301668 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:24.301668 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:24.301668 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:24.301668 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:24.301668 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:24.302532 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:24.302532 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:24.302532 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:24.302532 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:24.302532 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:24.302532 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:24.302532 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:24.302532 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:24.302532 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:24.302532 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:24.302532 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:39:24.302532 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:39:24.302532 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 24 19:39:24.302532 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:39:24.302532 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 479/960] 10.222.0.60 () {56 vars in 1126 bytes} [Sat Sep 24 19:39:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:39:24.310931 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243aeea8-4952-44e9-8d72-7c206a8f93cf None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:24.442159 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243aeea8-4952-44e9-8d72-7c206a8f93cf None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:24.474203 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:24.480997 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8095140-5df1-4adb-989a-32aa201892b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:24.481644 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8095140-5df1-4adb-989a-32aa201892b2 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:24.481923 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8095140-5df1-4adb-989a-32aa201892b2 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:24.482174 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8095140-5df1-4adb-989a-32aa201892b2 None admin] PATH_INFO: `/v3/services` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:24.482810 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8095140-5df1-4adb-989a-32aa201892b2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:24.483108 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8095140-5df1-4adb-989a-32aa201892b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:24.489423 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8095140-5df1-4adb-989a-32aa201892b2 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:24.491027 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 482/961] 10.222.0.60 () {56 vars in 1122 bytes} [Sat Sep 24 19:39:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:24.497121 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614b58d-9bd1-4046-98b2-e2ceb1b5a620 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:24.610981 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614b58d-9bd1-4046-98b2-e2ceb1b5a620 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:24.627161 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:24.648377 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0df760-7c37-4d92-bc75-501bab8d2e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:24.649685 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0df760-7c37-4d92-bc75-501bab8d2e74 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:24.649685 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0df760-7c37-4d92-bc75-501bab8d2e74 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:24.649685 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0df760-7c37-4d92-bc75-501bab8d2e74 None admin] PATH_INFO: `/v3/services` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:24.650164 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0df760-7c37-4d92-bc75-501bab8d2e74 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:24.650468 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0df760-7c37-4d92-bc75-501bab8d2e74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:24.651832 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0df760-7c37-4d92-bc75-501bab8d2e74 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:24.658308 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 480/962] 10.222.0.60 () {56 vars in 1122 bytes} [Sat Sep 24 19:39:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:24.664057 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8095140-5df1-4adb-989a-32aa201892b2 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:24.785794 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8095140-5df1-4adb-989a-32aa201892b2 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:24.824086 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c927d4-70ac-4c30-9649-2494a22c304d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:24.824706 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c927d4-70ac-4c30-9649-2494a22c304d None admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:24.824996 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c927d4-70ac-4c30-9649-2494a22c304d None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:24.825268 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c927d4-70ac-4c30-9649-2494a22c304d None admin] PATH_INFO: `/v3/endpoints` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:24.825995 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c927d4-70ac-4c30-9649-2494a22c304d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:24.827375 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c927d4-70ac-4c30-9649-2494a22c304d None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:24.844204 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f201a7-5d4e-42c5-bb0d-4fa33c5135fe None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:24.844490 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f201a7-5d4e-42c5-bb0d-4fa33c5135fe None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:24.844833 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f201a7-5d4e-42c5-bb0d-4fa33c5135fe None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:24.846334 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 481/963] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:39:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:39:24.852242 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e1578-e043-4d02-9c32-9a64010ccbaa None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:24.852242 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e1578-e043-4d02-9c32-9a64010ccbaa None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:24.852242 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e1578-e043-4d02-9c32-9a64010ccbaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:24.872541 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-875e1578-e043-4d02-9c32-9a64010ccbaa None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:39:24.873837 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-875e1578-e043-4d02-9c32-9a64010ccbaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:39:24.924134 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 483/964] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:39:24 2022] POST /identity/v3/endpoints => generated 349 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:39:24.972822 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 482/965] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:39:24 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:39:25.011706 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f15d4-c821-4d21-9ab4-905075196a1e None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:25.012049 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f15d4-c821-4d21-9ab4-905075196a1e None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:25.012259 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f15d4-c821-4d21-9ab4-905075196a1e None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:25.014160 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 484/966] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:39:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:39:25.021068 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524a964-e1b7-420e-a2b9-df825a9434d8 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:25.021397 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524a964-e1b7-420e-a2b9-df825a9434d8 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:25.021680 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524a964-e1b7-420e-a2b9-df825a9434d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:25.043121 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-a524a964-e1b7-420e-a2b9-df825a9434d8 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:39:25.044430 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-a524a964-e1b7-420e-a2b9-df825a9434d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:39:25.132165 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 483/967] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:39:25 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:39:25.261974 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f15d4-c821-4d21-9ab4-905075196a1e None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:25.319937 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:25.374945 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f15d4-c821-4d21-9ab4-905075196a1e None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:25.416251 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8842377-fa4e-4fec-bc11-08d1bc163395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:25.416934 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8842377-fa4e-4fec-bc11-08d1bc163395 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:25.417227 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8842377-fa4e-4fec-bc11-08d1bc163395 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:25.417537 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8842377-fa4e-4fec-bc11-08d1bc163395 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:25.417638 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a524a964-e1b7-420e-a2b9-df825a9434d8 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:25.429441 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8842377-fa4e-4fec-bc11-08d1bc163395 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:39:25.435085 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-f8842377-fa4e-4fec-bc11-08d1bc163395 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 24 19:39:25.435085 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:25.435085 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:25.435085 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:25.435085 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:25.435085 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:25.435085 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:25.435085 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:25.435085 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:25.435085 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:25.435085 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:25.435085 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:25.435085 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:39:25.435085 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:39:25.435085 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:39:25.435085 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:39:25.436075 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:39:25.436075 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:39:25.436075 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:39:25.436075 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:39:25.436075 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:25.436075 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:25.436075 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:25.436075 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:25.436075 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:25.436075 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:25.436075 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:25.436075 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:25.436075 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:25.436075 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:25.436075 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:25.436075 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:25.437693 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:25.437693 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:25.437693 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:25.437693 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:25.437693 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:39:25.437693 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:39:25.437693 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:39:25.437693 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:39:25.437693 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:39:25.437693 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:39:25.437693 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 24 19:39:25.437693 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:25.437693 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 485/968] 10.222.0.60 () {56 vars in 1120 bytes} [Sat Sep 24 19:39:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:39:25.446841 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8842377-fa4e-4fec-bc11-08d1bc163395 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:25.463178 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:25.558600 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a524a964-e1b7-420e-a2b9-df825a9434d8 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:25.581586 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8842377-fa4e-4fec-bc11-08d1bc163395 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:25.592825 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:25.602218 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9d89f-97dc-47c6-9a55-aa7f32b2d98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:25.603083 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9d89f-97dc-47c6-9a55-aa7f32b2d98b None admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:25.603512 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9d89f-97dc-47c6-9a55-aa7f32b2d98b None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:25.603958 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9d89f-97dc-47c6-9a55-aa7f32b2d98b None admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:25.604748 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a9d89f-97dc-47c6-9a55-aa7f32b2d98b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:25.606356 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a9d89f-97dc-47c6-9a55-aa7f32b2d98b None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:25.621145 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa7b36-3d4d-4f85-b2f4-74416400ee41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:25.622288 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa7b36-3d4d-4f85-b2f4-74416400ee41 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:25.625528 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa7b36-3d4d-4f85-b2f4-74416400ee41 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:25.626519 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa7b36-3d4d-4f85-b2f4-74416400ee41 None admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:25.627480 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aa7b36-3d4d-4f85-b2f4-74416400ee41 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:25.627858 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aa7b36-3d4d-4f85-b2f4-74416400ee41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:25.629714 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aa7b36-3d4d-4f85-b2f4-74416400ee41 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:25.644352 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 486/969] 10.222.0.60 () {56 vars in 1115 bytes} [Sat Sep 24 19:39:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:39:25.645781 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa7b36-3d4d-4f85-b2f4-74416400ee41 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:25.651235 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.sql.core [None req-13a9d89f-97dc-47c6-9a55-aa7f32b2d98b None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 24 19:39:25.651235 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 24 19:39:25.651235 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [parameters: {'user_id': '8aba5eef0a6e46c0a4ee2b36e149054d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 24 19:39:25.651235 dv-cinder-859191-1-smb devstack@keystone.service[93400]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93400) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 24 19:39:25.660413 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-13a9d89f-97dc-47c6-9a55-aa7f32b2d98b None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 24 19:39:25.660413 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:25.660413 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 24 19:39:25.660413 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 24 19:39:25.660413 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 24 19:39:25.660413 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 24 19:39:25.660413 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 24 19:39:25.660413 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application result = self._query(query) Sep 24 19:39:25.660413 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 24 19:39:25.660413 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application conn.query(q) Sep 24 19:39:25.660413 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 24 19:39:25.660413 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 24 19:39:25.660413 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 24 19:39:25.660413 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application result.read() Sep 24 19:39:25.660413 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 24 19:39:25.661551 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 24 19:39:25.661551 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 24 19:39:25.661551 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 24 19:39:25.661551 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 24 19:39:25.661551 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 24 19:39:25.661551 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 24 19:39:25.661551 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 24 19:39:25.661551 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 24 19:39:25.661551 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:39:25.661551 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 24 19:39:25.661551 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:39:25.661551 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:25.661551 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 24 19:39:25.661551 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 24 19:39:25.661551 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 24 19:39:25.661551 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 24 19:39:25.661551 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 24 19:39:25.661551 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application next(self.gen) Sep 24 19:39:25.662539 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 24 19:39:25.662539 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application yield resource Sep 24 19:39:25.662539 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 24 19:39:25.662539 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application next(self.gen) Sep 24 19:39:25.662539 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 24 19:39:25.662539 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application self.session.rollback() Sep 24 19:39:25.662539 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 24 19:39:25.662539 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application self.force_reraise() Sep 24 19:39:25.662539 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 24 19:39:25.662539 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise self.value Sep 24 19:39:25.662539 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 24 19:39:25.662539 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 24 19:39:25.662539 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 24 19:39:25.662539 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application session.commit() Sep 24 19:39:25.662539 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 24 19:39:25.662539 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 24 19:39:25.662539 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 24 19:39:25.663460 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application self._prepare_impl() Sep 24 19:39:25.663460 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 24 19:39:25.663460 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application self.session.flush() Sep 24 19:39:25.663460 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 24 19:39:25.663460 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application self._flush(objects) Sep 24 19:39:25.663460 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 24 19:39:25.663460 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 24 19:39:25.663460 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 24 19:39:25.663460 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application compat.raise_( Sep 24 19:39:25.663460 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 24 19:39:25.663460 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception Sep 24 19:39:25.663460 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 24 19:39:25.663460 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application flush_context.execute() Sep 24 19:39:25.663460 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 24 19:39:25.663460 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rec.execute(self) Sep 24 19:39:25.663460 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 24 19:39:25.663460 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 24 19:39:25.665054 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 24 19:39:25.665054 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 24 19:39:25.665054 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 24 19:39:25.665054 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 24 19:39:25.665054 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 24 19:39:25.665054 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 24 19:39:25.665054 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 24 19:39:25.665054 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 24 19:39:25.665054 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 24 19:39:25.665054 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 24 19:39:25.665054 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 24 19:39:25.665054 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 24 19:39:25.665054 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 24 19:39:25.665054 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 24 19:39:25.665054 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 24 19:39:25.665054 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception Sep 24 19:39:25.666195 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 24 19:39:25.666195 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 24 19:39:25.666195 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 24 19:39:25.666195 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 24 19:39:25.666195 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 24 19:39:25.666195 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application result = self._query(query) Sep 24 19:39:25.666195 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 24 19:39:25.666195 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application conn.query(q) Sep 24 19:39:25.666195 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 24 19:39:25.666195 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 24 19:39:25.666195 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 24 19:39:25.666195 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application result.read() Sep 24 19:39:25.666195 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 24 19:39:25.666195 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 24 19:39:25.666195 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 24 19:39:25.666195 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 24 19:39:25.667131 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 24 19:39:25.667131 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 24 19:39:25.667131 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 24 19:39:25.667131 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 24 19:39:25.667131 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 24 19:39:25.667131 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 24 19:39:25.667131 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [parameters: {'user_id': '8aba5eef0a6e46c0a4ee2b36e149054d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 24 19:39:25.667131 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 24 19:39:25.667131 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:39:25.667131 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:39:25.667131 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:39:25.667131 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:25.667131 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:25.667131 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:25.667131 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:25.667955 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:25.667955 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:25.667955 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:25.667955 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:25.667955 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:25.667955 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:25.667955 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:25.667955 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 24 19:39:25.667955 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 24 19:39:25.667955 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:25.667955 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:25.667955 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:39:25.667955 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:39:25.667955 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:39:25.667955 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:39:25.667955 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 24 19:39:25.667955 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 24 19:39:25.669196 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 24 19:39:25.669196 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 24 19:39:25.669196 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 24 19:39:25.669196 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 24 19:39:25.669196 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 24 19:39:25.669196 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:39:25.669196 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 484/970] 10.222.0.60 () {60 vars in 1131 bytes} [Sat Sep 24 19:39:25 2022] POST /identity/v3/users => generated 160 bytes in 245 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:39:25.672297 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9d89f-97dc-47c6-9a55-aa7f32b2d98b None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:25.800398 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa7b36-3d4d-4f85-b2f4-74416400ee41 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:25.806144 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:25.814254 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9d89f-97dc-47c6-9a55-aa7f32b2d98b None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:25.841220 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433dee0-ef03-44a6-978c-11e7d0052cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:25.841992 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433dee0-ef03-44a6-978c-11e7d0052cae None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:25.842499 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433dee0-ef03-44a6-978c-11e7d0052cae None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:25.842936 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433dee0-ef03-44a6-978c-11e7d0052cae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:25.855351 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6433dee0-ef03-44a6-978c-11e7d0052cae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:25.855594 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dcf002-a7ac-4c03-8656-c266159b71c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:25.856380 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dcf002-a7ac-4c03-8656-c266159b71c6 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:25.856798 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dcf002-a7ac-4c03-8656-c266159b71c6 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:25.857293 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6433dee0-ef03-44a6-978c-11e7d0052cae None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:25.857671 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dcf002-a7ac-4c03-8656-c266159b71c6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:25.866339 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dcf002-a7ac-4c03-8656-c266159b71c6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:25.868268 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dcf002-a7ac-4c03-8656-c266159b71c6 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:25.874753 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-6433dee0-ef03-44a6-978c-11e7d0052cae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:39:25.874753 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:25.874753 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:25.874753 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:25.874753 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:25.874753 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:25.874753 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:25.874753 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:25.874753 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:25.874753 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:25.874753 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:25.874753 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:25.874753 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:39:25.874753 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:39:25.874753 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:39:25.874753 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:39:25.875930 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:25.875930 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:25.875930 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:25.875930 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:25.875930 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:25.875930 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:25.875930 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:25.875930 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:25.875930 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:25.875930 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:25.875930 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:25.875930 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:25.875930 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:25.875930 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:25.875930 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:25.875930 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:25.875930 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:39:25.877101 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:39:25.877101 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:39:25.877101 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:25.883427 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 487/971] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:39:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:39:25.884630 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433dee0-ef03-44a6-978c-11e7d0052cae None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:25.893342 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-24dcf002-a7ac-4c03-8656-c266159b71c6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 24 19:39:25.893342 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:25.893342 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:25.893342 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:25.893342 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:25.893342 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:25.893342 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:25.893342 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:25.893342 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:25.893342 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:25.893342 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:25.893342 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:25.893342 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:39:25.893342 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:39:25.893342 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:39:25.893342 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:39:25.894566 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:25.894566 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:25.894566 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:39:25.894566 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:39:25.894566 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:39:25.894566 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:39:25.894566 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:25.894566 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:25.894566 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:25.894566 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:25.894566 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:25.894566 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:25.894566 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:25.894566 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:25.894566 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:25.894566 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:25.894566 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:25.894566 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:25.895499 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:25.895499 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:25.895499 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:39:25.895499 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:39:25.895499 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:39:25.895499 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:39:25.895499 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:39:25.895499 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:39:25.895499 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 24 19:39:25.895499 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:39:25.899736 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 485/972] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Sep 24 19:39:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:39:25.902065 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dcf002-a7ac-4c03-8656-c266159b71c6 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:25.926583 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:26.038113 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433dee0-ef03-44a6-978c-11e7d0052cae None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:26.046505 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dcf002-a7ac-4c03-8656-c266159b71c6 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:26.085291 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5740d-6deb-4625-a250-7692f41fef93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:26.086173 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5740d-6deb-4625-a250-7692f41fef93 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:26.086527 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5740d-6deb-4625-a250-7692f41fef93 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:26.086845 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b792d854-8a7b-463f-8df9-fe599a22c988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:26.086979 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5740d-6deb-4625-a250-7692f41fef93 None admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:26.087660 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a5740d-6deb-4625-a250-7692f41fef93 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:26.087947 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792d854-8a7b-463f-8df9-fe599a22c988 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:26.088050 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a5740d-6deb-4625-a250-7692f41fef93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:26.088606 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792d854-8a7b-463f-8df9-fe599a22c988 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:26.089113 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792d854-8a7b-463f-8df9-fe599a22c988 None admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:26.090027 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b792d854-8a7b-463f-8df9-fe599a22c988 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:26.090405 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a5740d-6deb-4625-a250-7692f41fef93 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:26.090743 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b792d854-8a7b-463f-8df9-fe599a22c988 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:26.092812 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b792d854-8a7b-463f-8df9-fe599a22c988 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:26.115653 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 488/973] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:39:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:26.118230 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b792d854-8a7b-463f-8df9-fe599a22c988 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:26.153702 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 486/974] 10.222.0.60 () {56 vars in 1101 bytes} [Sat Sep 24 19:39:25 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:26.229945 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:26.247801 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b792d854-8a7b-463f-8df9-fe599a22c988 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:26.287255 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9accb2a6-c5ec-4856-bf5a-7ea9ba79a17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:26.287910 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9accb2a6-c5ec-4856-bf5a-7ea9ba79a17e None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:26.288187 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9accb2a6-c5ec-4856-bf5a-7ea9ba79a17e None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:26.288461 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9accb2a6-c5ec-4856-bf5a-7ea9ba79a17e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:26.297239 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9accb2a6-c5ec-4856-bf5a-7ea9ba79a17e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:26.299209 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9accb2a6-c5ec-4856-bf5a-7ea9ba79a17e None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:26.311834 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-9accb2a6-c5ec-4856-bf5a-7ea9ba79a17e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 24 19:39:26.311834 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:26.311834 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:26.311834 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:26.311834 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:26.311834 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:26.311834 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:26.311834 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:26.311834 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:26.311834 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:26.311834 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:26.311834 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:26.311834 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:39:26.311834 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:39:26.311834 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:39:26.311834 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:39:26.312867 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:26.312867 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:26.312867 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:39:26.312867 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:39:26.312867 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:39:26.312867 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:39:26.312867 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:26.312867 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:26.312867 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:26.312867 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:26.312867 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:26.312867 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:26.312867 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:26.312867 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:26.312867 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:26.312867 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:26.312867 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:26.312867 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:26.314349 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:26.314349 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:26.314349 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:39:26.314349 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:39:26.314349 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:39:26.314349 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:39:26.314349 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:39:26.314349 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:39:26.314349 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 24 19:39:26.314349 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:26.314349 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 489/975] 10.222.0.60 () {56 vars in 1117 bytes} [Sat Sep 24 19:39:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:39:26.319655 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5740d-6deb-4625-a250-7692f41fef93 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:26.343269 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:26.456019 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5740d-6deb-4625-a250-7692f41fef93 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:26.475778 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ff3fe-298d-4fc4-8d7d-6fefffdfa42d None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:26.476331 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ff3fe-298d-4fc4-8d7d-6fefffdfa42d None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:26.476331 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ff3fe-298d-4fc4-8d7d-6fefffdfa42d None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:26.477962 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 490/976] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:39:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:39:26.487768 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c1020-46f1-420c-89eb-8a0e822b7c03 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:26.488065 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c1020-46f1-420c-89eb-8a0e822b7c03 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:26.488417 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c1020-46f1-420c-89eb-8a0e822b7c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:26.509376 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dba8cd-19ae-42ca-933e-e4a3123d4a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:26.510066 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dba8cd-19ae-42ca-933e-e4a3123d4a79 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:26.510348 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dba8cd-19ae-42ca-933e-e4a3123d4a79 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:26.510748 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dba8cd-19ae-42ca-933e-e4a3123d4a79 None admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:26.512473 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dba8cd-19ae-42ca-933e-e4a3123d4a79 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:26.512787 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dba8cd-19ae-42ca-933e-e4a3123d4a79 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:26.514275 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dba8cd-19ae-42ca-933e-e4a3123d4a79 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:26.514472 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-c85c1020-46f1-420c-89eb-8a0e822b7c03 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:39:26.515632 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-c85c1020-46f1-420c-89eb-8a0e822b7c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:39:26.538960 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 487/977] 10.222.0.60 () {56 vars in 1149 bytes} [Sat Sep 24 19:39:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:26.544435 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dba8cd-19ae-42ca-933e-e4a3123d4a79 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:26.597812 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 491/978] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:39:26 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:39:26.635690 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:26.669378 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dba8cd-19ae-42ca-933e-e4a3123d4a79 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:26.708730 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d922f91-e52b-4f18-a71d-c27f69c49e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:26.709359 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d922f91-e52b-4f18-a71d-c27f69c49e04 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:26.709677 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d922f91-e52b-4f18-a71d-c27f69c49e04 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:26.709953 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d922f91-e52b-4f18-a71d-c27f69c49e04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:26.784749 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d922f91-e52b-4f18-a71d-c27f69c49e04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:26.786235 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d922f91-e52b-4f18-a71d-c27f69c49e04 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:26.866802 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:26.884493 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c1020-46f1-420c-89eb-8a0e822b7c03 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:26.907669 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 488/979] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Sep 24 19:39:26 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 24 19:39:26.909412 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d922f91-e52b-4f18-a71d-c27f69c49e04 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:26.973351 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:26.999994 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c1020-46f1-420c-89eb-8a0e822b7c03 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:27.036421 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d922f91-e52b-4f18-a71d-c27f69c49e04 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:27.037424 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248acd23-fd14-4fe0-8468-5427f9dc33e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:27.038107 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248acd23-fd14-4fe0-8468-5427f9dc33e7 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:27.038384 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248acd23-fd14-4fe0-8468-5427f9dc33e7 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:27.038658 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248acd23-fd14-4fe0-8468-5427f9dc33e7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:27.039242 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248acd23-fd14-4fe0-8468-5427f9dc33e7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:27.040609 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248acd23-fd14-4fe0-8468-5427f9dc33e7 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:27.050496 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-248acd23-fd14-4fe0-8468-5427f9dc33e7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 24 19:39:27.050496 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:27.050496 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:39:27.050496 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:39:27.050496 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:39:27.050496 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:39:27.050496 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:39:27.050496 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:39:27.050496 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 24 19:39:27.050496 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:27.050496 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:39:27.050496 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:27.050496 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:27.050496 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:27.050496 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:27.050496 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:27.050496 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:27.051548 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:27.051548 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:27.051548 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:27.051548 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:27.051548 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:27.051548 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:27.051548 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:39:27.051548 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:39:27.051548 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:39:27.051548 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:39:27.051548 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:27.051548 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:27.051548 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:27.051548 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:27.051548 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:27.051548 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:27.052398 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:27.052398 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:27.052398 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:27.052398 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:27.052398 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:27.052398 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:27.052398 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:27.052398 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:27.052398 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:27.052398 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:27.052398 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:39:27.052398 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:39:27.052398 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 24 19:39:27.052398 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:27.056708 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 492/980] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Sep 24 19:39:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:39:27.057430 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248acd23-fd14-4fe0-8468-5427f9dc33e7 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:27.080066 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6520075-27cb-4c10-8c67-f6272f805074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:27.081218 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6520075-27cb-4c10-8c67-f6272f805074 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:27.081527 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6520075-27cb-4c10-8c67-f6272f805074 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:27.082095 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6520075-27cb-4c10-8c67-f6272f805074 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:27.093616 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6520075-27cb-4c10-8c67-f6272f805074 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:27.096137 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6520075-27cb-4c10-8c67-f6272f805074 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:27.116538 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-f6520075-27cb-4c10-8c67-f6272f805074 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:39:27.116538 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:27.116538 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:27.116538 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:27.116538 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:27.116538 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:27.116538 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:27.116538 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:27.116538 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:27.116538 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:27.116538 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:27.116538 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:27.116538 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:39:27.116538 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:39:27.116538 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:39:27.116538 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:39:27.117633 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:27.117633 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:27.117633 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:27.117633 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:27.117633 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:27.117633 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:27.117633 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:27.117633 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:27.117633 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:27.117633 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:27.117633 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:27.117633 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:27.117633 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:27.117633 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:27.117633 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:27.117633 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:27.117633 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:39:27.118546 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:39:27.118546 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:39:27.118546 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:39:27.118546 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 489/981] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:39:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:39:27.124299 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6520075-27cb-4c10-8c67-f6272f805074 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:27.157067 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:27.180848 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248acd23-fd14-4fe0-8468-5427f9dc33e7 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:27.220429 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babab25f-5f2d-4f07-bd93-33b599b34919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:27.221401 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babab25f-5f2d-4f07-bd93-33b599b34919 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:27.222021 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babab25f-5f2d-4f07-bd93-33b599b34919 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:27.222498 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babab25f-5f2d-4f07-bd93-33b599b34919 None admin] PATH_INFO: `/v3/services` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:27.223661 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babab25f-5f2d-4f07-bd93-33b599b34919 None admin] RBAC: Adding query filter params (name=compute) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:27.224197 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babab25f-5f2d-4f07-bd93-33b599b34919 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:27.226816 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babab25f-5f2d-4f07-bd93-33b599b34919 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:27.232573 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 493/982] 10.222.0.60 () {56 vars in 1112 bytes} [Sat Sep 24 19:39:27 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:27.239285 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babab25f-5f2d-4f07-bd93-33b599b34919 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:27.243381 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:27.265703 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6520075-27cb-4c10-8c67-f6272f805074 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:27.317210 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a322da-f591-4550-a9f2-e23b707a9614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:27.317811 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a322da-f591-4550-a9f2-e23b707a9614 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:27.318092 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a322da-f591-4550-a9f2-e23b707a9614 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:27.318359 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a322da-f591-4550-a9f2-e23b707a9614 None admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:27.318989 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a322da-f591-4550-a9f2-e23b707a9614 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:27.319285 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a322da-f591-4550-a9f2-e23b707a9614 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:27.320622 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a322da-f591-4550-a9f2-e23b707a9614 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:27.332711 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 490/983] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:39:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:39:27.334175 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9dbc64-80e5-4f2c-871e-d7259d02ea70 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:27.334557 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9dbc64-80e5-4f2c-871e-d7259d02ea70 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:27.334909 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9dbc64-80e5-4f2c-871e-d7259d02ea70 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:27.336165 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 491/984] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:39:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:39:27.340109 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9dbc64-80e5-4f2c-871e-d7259d02ea70 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:27.371326 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babab25f-5f2d-4f07-bd93-33b599b34919 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:27.409975 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ce030-59b5-4486-98f7-618647f64f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:27.410663 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ce030-59b5-4486-98f7-618647f64f96 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:27.410879 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ce030-59b5-4486-98f7-618647f64f96 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:27.411147 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ce030-59b5-4486-98f7-618647f64f96 None admin] PATH_INFO: `/v3/services` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:27.411788 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039ce030-59b5-4486-98f7-618647f64f96 None admin] RBAC: Adding query filter params (type=compute) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:27.412091 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039ce030-59b5-4486-98f7-618647f64f96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:27.413460 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039ce030-59b5-4486-98f7-618647f64f96 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:27.418651 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 494/985] 10.222.0.60 () {56 vars in 1112 bytes} [Sat Sep 24 19:39:27 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:39:27.420024 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aee4c3-1f42-4bf4-8915-44e97b167be8 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:27.420315 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aee4c3-1f42-4bf4-8915-44e97b167be8 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:27.420586 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aee4c3-1f42-4bf4-8915-44e97b167be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:27.436000 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:27.439369 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-f9aee4c3-1f42-4bf4-8915-44e97b167be8 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:39:27.440594 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-f9aee4c3-1f42-4bf4-8915-44e97b167be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:39:27.454394 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9dbc64-80e5-4f2c-871e-d7259d02ea70 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:27.492293 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7061d90-d89a-4161-9db0-d59867bcea06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:27.492938 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7061d90-d89a-4161-9db0-d59867bcea06 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:27.493219 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7061d90-d89a-4161-9db0-d59867bcea06 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:27.493519 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7061d90-d89a-4161-9db0-d59867bcea06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:27.501074 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7061d90-d89a-4161-9db0-d59867bcea06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:27.502687 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7061d90-d89a-4161-9db0-d59867bcea06 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:27.506128 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:27.513863 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 495/986] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:39:27 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:39:27.514794 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aee4c3-1f42-4bf4-8915-44e97b167be8 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:27.522849 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-f7061d90-d89a-4161-9db0-d59867bcea06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:39:27.522849 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:27.522849 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:27.522849 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:27.522849 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:27.522849 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:27.522849 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:27.522849 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:27.522849 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:27.522849 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:27.522849 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:27.522849 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:27.522849 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:39:27.522849 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:39:27.522849 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:39:27.524508 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:39:27.524508 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:27.524508 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:27.524508 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:27.524508 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:27.524508 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:27.524508 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:27.524508 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:27.524508 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:27.524508 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:27.524508 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:27.524508 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:27.524508 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:27.524508 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:27.524508 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:27.524508 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:27.524508 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:27.525640 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:39:27.525640 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:39:27.525640 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:39:27.525640 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:39:27.525640 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:39:27.525640 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:39:27.525640 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:39:27.525640 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:39:27.525640 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 492/987] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Sep 24 19:39:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:39:27.531851 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7061d90-d89a-4161-9db0-d59867bcea06 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:27.649609 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aee4c3-1f42-4bf4-8915-44e97b167be8 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:27.661531 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7061d90-d89a-4161-9db0-d59867bcea06 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:27.697040 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d566451-8abe-4822-bdba-99c85f63e99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:27.697392 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6270a6a-3655-436f-a664-2671f0ea5956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:27.697869 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d566451-8abe-4822-bdba-99c85f63e99e None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:27.698146 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d566451-8abe-4822-bdba-99c85f63e99e None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:27.698414 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d566451-8abe-4822-bdba-99c85f63e99e None admin] PATH_INFO: `/v3/endpoints` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:27.698833 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6270a6a-3655-436f-a664-2671f0ea5956 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:27.699124 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d566451-8abe-4822-bdba-99c85f63e99e None admin] RBAC: Adding query filter params (interface=public, service_id=2713b188c8c04c00a3def51312c77c65, region_id=RegionOne) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:27.699280 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6270a6a-3655-436f-a664-2671f0ea5956 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:27.699424 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d566451-8abe-4822-bdba-99c85f63e99e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:27.699717 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6270a6a-3655-436f-a664-2671f0ea5956 None admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:27.700516 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6270a6a-3655-436f-a664-2671f0ea5956 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:27.700786 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d566451-8abe-4822-bdba-99c85f63e99e None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:27.701007 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6270a6a-3655-436f-a664-2671f0ea5956 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:27.702773 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6270a6a-3655-436f-a664-2671f0ea5956 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:27.712468 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 496/988] 10.222.0.60 () {56 vars in 1251 bytes} [Sat Sep 24 19:39:27 2022] GET /identity/v3/endpoints?service_id=2713b188c8c04c00a3def51312c77c65&interface=public®ion_id=RegionOne => generated 194 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:27.713978 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d566451-8abe-4822-bdba-99c85f63e99e None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:27.720131 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 493/989] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Sep 24 19:39:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:39:27.725863 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6270a6a-3655-436f-a664-2671f0ea5956 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:27.730716 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:27.804025 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:27.848327 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6270a6a-3655-436f-a664-2671f0ea5956 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:27.849539 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d566451-8abe-4822-bdba-99c85f63e99e None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:27.883786 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fbc0c5-7956-404b-9af5-d65c574142bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:27.884393 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fbc0c5-7956-404b-9af5-d65c574142bc None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:27.884668 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fbc0c5-7956-404b-9af5-d65c574142bc None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:27.884936 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fbc0c5-7956-404b-9af5-d65c574142bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:27.885689 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fbc0c5-7956-404b-9af5-d65c574142bc None admin] RBAC: Adding query filter params (role.id=ccbad8fea592451d9078a68926df4aca, scope.project.id=5c2da88af5714e619238772bde676a42, user.id=fd597f74abdf49288ea0d92642c6a5a2) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:27.885995 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fbc0c5-7956-404b-9af5-d65c574142bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:27.887280 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0056938-2b8c-444b-ae2c-6d4938b5f722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:27.887395 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fbc0c5-7956-404b-9af5-d65c574142bc None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:27.887913 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0056938-2b8c-444b-ae2c-6d4938b5f722 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:27.888189 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0056938-2b8c-444b-ae2c-6d4938b5f722 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:27.888460 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0056938-2b8c-444b-ae2c-6d4938b5f722 None admin] PATH_INFO: `/v3/services` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:27.889062 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0056938-2b8c-444b-ae2c-6d4938b5f722 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:27.890433 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0056938-2b8c-444b-ae2c-6d4938b5f722 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:27.894119 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 494/990] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Sep 24 19:39:27 2022] GET /identity/v3/role_assignments?user.id=fd597f74abdf49288ea0d92642c6a5a2&scope.project.id=5c2da88af5714e619238772bde676a42&role.id=ccbad8fea592451d9078a68926df4aca => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:27.895018 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fbc0c5-7956-404b-9af5-d65c574142bc None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:27.908411 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 497/991] 10.222.0.60 () {56 vars in 1087 bytes} [Sat Sep 24 19:39:27 2022] GET /identity/v3/services => generated 1727 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:39:27.981162 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:28.028675 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fbc0c5-7956-404b-9af5-d65c574142bc None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:28.076667 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d6dc7a-d372-4141-99c0-c9056082f1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:28.077800 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6dc7a-d372-4141-99c0-c9056082f1c1 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:28.078085 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6dc7a-d372-4141-99c0-c9056082f1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:28.078361 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6dc7a-d372-4141-99c0-c9056082f1c1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:28.079079 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d6dc7a-d372-4141-99c0-c9056082f1c1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:28.080790 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d6dc7a-d372-4141-99c0-c9056082f1c1 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:28.091268 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-84d6dc7a-d372-4141-99c0-c9056082f1c1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 24 19:39:28.091268 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:28.091268 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:39:28.091268 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:39:28.091268 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:39:28.091268 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:39:28.091268 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:39:28.091268 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:39:28.091268 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 24 19:39:28.091268 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:39:28.091268 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:39:28.091268 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:39:28.091268 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:28.091268 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:28.091268 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:28.091268 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:28.091268 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:28.092341 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:28.092341 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:28.092341 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:28.092341 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:28.092341 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:28.092341 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:28.092341 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:39:28.092341 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:39:28.092341 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:39:28.092341 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:39:28.092341 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:28.092341 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:28.092341 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:28.092341 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:28.092341 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:28.092341 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:28.093181 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:28.093181 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:28.093181 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:28.093181 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:28.093181 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:28.093181 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:28.093181 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:28.093181 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:28.093181 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:28.093181 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:28.093181 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:39:28.093181 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:39:28.093181 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 24 19:39:28.093181 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:39:28.093181 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 495/992] 10.222.0.60 () {56 vars in 1126 bytes} [Sat Sep 24 19:39:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:39:28.099037 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0056938-2b8c-444b-ae2c-6d4938b5f722 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:28.216712 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0056938-2b8c-444b-ae2c-6d4938b5f722 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:28.242127 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:28.253633 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1526d0-2d9f-403b-90ff-4faa7833750f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:28.254517 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1526d0-2d9f-403b-90ff-4faa7833750f None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:28.254782 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1526d0-2d9f-403b-90ff-4faa7833750f None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:28.257681 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1526d0-2d9f-403b-90ff-4faa7833750f None admin] PATH_INFO: `/v3/services` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:28.257681 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1526d0-2d9f-403b-90ff-4faa7833750f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:28.257681 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1526d0-2d9f-403b-90ff-4faa7833750f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:28.257681 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1526d0-2d9f-403b-90ff-4faa7833750f None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:28.262222 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 498/993] 10.222.0.60 () {56 vars in 1122 bytes} [Sat Sep 24 19:39:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:28.267843 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d6dc7a-d372-4141-99c0-c9056082f1c1 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:28.377735 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d6dc7a-d372-4141-99c0-c9056082f1c1 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:28.412371 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:28.418035 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10628c-3175-49fc-bd81-b85eed35246e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:28.418659 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10628c-3175-49fc-bd81-b85eed35246e None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:28.419006 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10628c-3175-49fc-bd81-b85eed35246e None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:28.419286 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10628c-3175-49fc-bd81-b85eed35246e None admin] PATH_INFO: `/v3/services` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:28.419873 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e10628c-3175-49fc-bd81-b85eed35246e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:28.420178 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e10628c-3175-49fc-bd81-b85eed35246e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:28.421560 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e10628c-3175-49fc-bd81-b85eed35246e None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:28.427975 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 496/994] 10.222.0.60 () {56 vars in 1122 bytes} [Sat Sep 24 19:39:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:39:28.434011 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1526d0-2d9f-403b-90ff-4faa7833750f None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:28.540183 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1526d0-2d9f-403b-90ff-4faa7833750f None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:28.580702 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cfbc30-bbab-4c45-98a8-5c54ae4631d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:28.581312 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cfbc30-bbab-4c45-98a8-5c54ae4631d5 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:28.581619 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cfbc30-bbab-4c45-98a8-5c54ae4631d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:28.581902 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cfbc30-bbab-4c45-98a8-5c54ae4631d5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:28.582600 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cfbc30-bbab-4c45-98a8-5c54ae4631d5 None admin] RBAC: Adding query filter params (interface=admin, service_id=ef0a4a43b5524190ad736085da85af2e, region_id=RegionOne) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:28.582910 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cfbc30-bbab-4c45-98a8-5c54ae4631d5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:28.584281 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cfbc30-bbab-4c45-98a8-5c54ae4631d5 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:28.594129 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 499/995] 10.222.0.60 () {56 vars in 1249 bytes} [Sat Sep 24 19:39:28 2022] GET /identity/v3/endpoints?service_id=ef0a4a43b5524190ad736085da85af2e&interface=admin®ion_id=RegionOne => generated 193 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:28.595308 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10628c-3175-49fc-bd81-b85eed35246e None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:28.703164 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10628c-3175-49fc-bd81-b85eed35246e None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:28.739733 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e02220-6b0d-427b-a858-1d52ca17562c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:28.740339 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e02220-6b0d-427b-a858-1d52ca17562c None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:28.740613 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e02220-6b0d-427b-a858-1d52ca17562c None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:28.740880 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e02220-6b0d-427b-a858-1d52ca17562c None admin] PATH_INFO: `/v3/services` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:28.741482 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e02220-6b0d-427b-a858-1d52ca17562c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:28.742846 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e02220-6b0d-427b-a858-1d52ca17562c None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:28.749541 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 497/996] 10.222.0.60 () {56 vars in 1087 bytes} [Sat Sep 24 19:39:28 2022] GET /identity/v3/services => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 19:39:30.142033 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec3c81-602b-4bbd-915c-1cf68a55770a None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:30.142596 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec3c81-602b-4bbd-915c-1cf68a55770a None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:30.142596 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec3c81-602b-4bbd-915c-1cf68a55770a None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:30.144195 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 500/997] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:39:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:39:30.149571 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238652bd-83a1-4715-96d6-b7026ca33495 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:30.150026 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238652bd-83a1-4715-96d6-b7026ca33495 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:30.150124 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238652bd-83a1-4715-96d6-b7026ca33495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:30.170159 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-238652bd-83a1-4715-96d6-b7026ca33495 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:39:30.171800 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-238652bd-83a1-4715-96d6-b7026ca33495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:39:30.172320 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb2caa-8273-4dc5-a959-9e1feffa2a65 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:30.172637 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb2caa-8273-4dc5-a959-9e1feffa2a65 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:30.172910 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb2caa-8273-4dc5-a959-9e1feffa2a65 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:30.174410 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 501/998] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:39:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:39:30.179501 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d1112-8767-4009-a388-809e0170e627 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:30.179792 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d1112-8767-4009-a388-809e0170e627 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:30.180066 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d1112-8767-4009-a388-809e0170e627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:30.204231 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-774d1112-8767-4009-a388-809e0170e627 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:39:30.204231 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-774d1112-8767-4009-a388-809e0170e627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:39:30.245783 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:30.260912 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 498/999] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:39:30 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:39:30.265888 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:30.293191 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 502/1000] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:39:30 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:39:30.535229 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238652bd-83a1-4715-96d6-b7026ca33495 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:30.563651 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d1112-8767-4009-a388-809e0170e627 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:30.650117 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238652bd-83a1-4715-96d6-b7026ca33495 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:30.685295 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d1112-8767-4009-a388-809e0170e627 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:30.696110 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b23898c-82fa-4158-af07-9d3b7ba375e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:30.696750 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23898c-82fa-4158-af07-9d3b7ba375e6 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:30.697033 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23898c-82fa-4158-af07-9d3b7ba375e6 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:30.697309 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23898c-82fa-4158-af07-9d3b7ba375e6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:30.698320 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b23898c-82fa-4158-af07-9d3b7ba375e6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:30.700016 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b23898c-82fa-4158-af07-9d3b7ba375e6 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:30.710169 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-3b23898c-82fa-4158-af07-9d3b7ba375e6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 24 19:39:30.710169 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:30.710169 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:39:30.710169 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:39:30.710169 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:39:30.710169 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:39:30.710169 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:39:30.710169 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:39:30.710169 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 24 19:39:30.710169 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:39:30.710169 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:39:30.710169 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:39:30.710169 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:30.710169 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:30.710169 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:30.710169 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:30.710169 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:30.711309 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:30.711309 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:30.711309 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:30.711309 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:30.711309 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:30.711309 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:30.711309 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:39:30.711309 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:39:30.711309 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:39:30.711309 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:39:30.711309 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:30.711309 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:30.711309 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:30.711309 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:30.711309 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:30.711309 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:30.714866 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:30.714866 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:30.714866 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:30.714866 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:30.714866 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:30.714866 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:30.714866 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:30.714866 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:30.714866 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:30.714866 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:30.714866 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:39:30.714866 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:39:30.714866 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 24 19:39:30.714866 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:39:30.714866 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 499/1001] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Sep 24 19:39:30 2022] GET /identity/v3/services/compute => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:39:30.717136 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b23898c-82fa-4158-af07-9d3b7ba375e6 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:30.732511 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c5b68-c7f0-4856-ad2d-145c80d9d530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:30.733252 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c5b68-c7f0-4856-ad2d-145c80d9d530 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:30.733643 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c5b68-c7f0-4856-ad2d-145c80d9d530 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:30.733925 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c5b68-c7f0-4856-ad2d-145c80d9d530 None admin] PATH_INFO: `/v3/services/image` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:30.734521 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8c5b68-c7f0-4856-ad2d-145c80d9d530 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:30.736635 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8c5b68-c7f0-4856-ad2d-145c80d9d530 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:30.749487 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-3a8c5b68-c7f0-4856-ad2d-145c80d9d530 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 24 19:39:30.749487 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:30.749487 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:39:30.749487 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:39:30.749487 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:39:30.749487 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:39:30.749487 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:39:30.749487 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:39:30.749487 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 24 19:39:30.749487 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:30.749487 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:39:30.749487 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:30.749487 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:30.749487 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:30.749487 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:30.749487 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:30.749487 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:30.750633 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:30.750633 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:30.750633 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:30.750633 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:30.750633 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:30.750633 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:30.750633 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:39:30.750633 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:39:30.750633 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:39:30.750633 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:39:30.750633 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:30.750633 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:30.750633 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:30.750633 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:30.750633 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:30.750633 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:30.751488 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:30.751488 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:30.751488 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:30.751488 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:30.751488 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:30.751488 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:30.751488 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:30.751488 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:30.751488 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:30.751488 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:30.751488 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:39:30.751488 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:39:30.751488 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 24 19:39:30.751488 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:30.751488 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 503/1002] 10.222.0.60 () {56 vars in 1105 bytes} [Sat Sep 24 19:39:30 2022] GET /identity/v3/services/image => generated 86 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:39:30.756709 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c5b68-c7f0-4856-ad2d-145c80d9d530 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:30.785633 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:30.809407 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:30.837834 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b23898c-82fa-4158-af07-9d3b7ba375e6 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:30.867874 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c5b68-c7f0-4856-ad2d-145c80d9d530 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:30.878015 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f51d32-38a6-4fcc-b8d6-67662586b4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:30.879177 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f51d32-38a6-4fcc-b8d6-67662586b4fe None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:30.879473 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f51d32-38a6-4fcc-b8d6-67662586b4fe None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:30.879797 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f51d32-38a6-4fcc-b8d6-67662586b4fe None admin] PATH_INFO: `/v3/services` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:30.880377 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f51d32-38a6-4fcc-b8d6-67662586b4fe None admin] RBAC: Adding query filter params (name=compute) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:30.880682 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f51d32-38a6-4fcc-b8d6-67662586b4fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:30.882075 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f51d32-38a6-4fcc-b8d6-67662586b4fe None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:30.887288 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 500/1003] 10.222.0.60 () {56 vars in 1112 bytes} [Sat Sep 24 19:39:30 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:39:30.893813 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f51d32-38a6-4fcc-b8d6-67662586b4fe None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:30.903922 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd837df-1e39-41e3-8a82-2094da6112a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:30.904533 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd837df-1e39-41e3-8a82-2094da6112a9 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:30.904830 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd837df-1e39-41e3-8a82-2094da6112a9 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:30.905098 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd837df-1e39-41e3-8a82-2094da6112a9 None admin] PATH_INFO: `/v3/services` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:30.905762 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd837df-1e39-41e3-8a82-2094da6112a9 None admin] RBAC: Adding query filter params (name=image) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:30.906076 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd837df-1e39-41e3-8a82-2094da6112a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:30.908226 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd837df-1e39-41e3-8a82-2094da6112a9 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:30.917666 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 504/1004] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:39:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:39:30.919440 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd837df-1e39-41e3-8a82-2094da6112a9 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:30.999648 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f51d32-38a6-4fcc-b8d6-67662586b4fe None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:31.017177 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:31.021712 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd837df-1e39-41e3-8a82-2094da6112a9 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:31.032725 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:31.034253 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f337fb38-2179-4d6d-a47b-32ad55408db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:31.034866 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337fb38-2179-4d6d-a47b-32ad55408db0 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:31.035143 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337fb38-2179-4d6d-a47b-32ad55408db0 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:31.035411 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337fb38-2179-4d6d-a47b-32ad55408db0 None admin] PATH_INFO: `/v3/services` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:31.036088 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f337fb38-2179-4d6d-a47b-32ad55408db0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:31.036337 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f337fb38-2179-4d6d-a47b-32ad55408db0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:31.037959 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f337fb38-2179-4d6d-a47b-32ad55408db0 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:31.043004 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 501/1005] 10.222.0.60 () {56 vars in 1112 bytes} [Sat Sep 24 19:39:30 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:39:31.043985 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5214b33-0e9b-431d-9500-5e5b685fe8b3 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:31.044280 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5214b33-0e9b-431d-9500-5e5b685fe8b3 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:31.044559 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5214b33-0e9b-431d-9500-5e5b685fe8b3 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:31.045768 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 502/1006] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:39:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:39:31.049197 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5214b33-0e9b-431d-9500-5e5b685fe8b3 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:31.057174 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a4df5-956c-42d6-b8e4-5424f9d8325b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:31.057825 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a4df5-956c-42d6-b8e4-5424f9d8325b None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:31.058140 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a4df5-956c-42d6-b8e4-5424f9d8325b None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:31.058413 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a4df5-956c-42d6-b8e4-5424f9d8325b None admin] PATH_INFO: `/v3/services` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:31.059044 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a4df5-956c-42d6-b8e4-5424f9d8325b None admin] RBAC: Adding query filter params (type=image) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:31.059346 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a4df5-956c-42d6-b8e4-5424f9d8325b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:31.060772 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a4df5-956c-42d6-b8e4-5424f9d8325b None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:31.065270 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 505/1007] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:39:30 2022] GET /identity/v3/services?type=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:31.066461 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b77120-15d7-4b71-9a3d-d8009a99911e None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:31.066744 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b77120-15d7-4b71-9a3d-d8009a99911e None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:31.067019 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b77120-15d7-4b71-9a3d-d8009a99911e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:31.086625 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-00b77120-15d7-4b71-9a3d-d8009a99911e None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:39:31.087872 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-00b77120-15d7-4b71-9a3d-d8009a99911e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:39:31.175447 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 506/1008] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:39:31 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:39:31.182942 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5214b33-0e9b-431d-9500-5e5b685fe8b3 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:31.243958 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e182616-936c-4c01-bab0-65794f2da0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:31.244561 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e182616-936c-4c01-bab0-65794f2da0cb None admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:31.244840 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e182616-936c-4c01-bab0-65794f2da0cb None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:31.245107 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e182616-936c-4c01-bab0-65794f2da0cb None admin] PATH_INFO: `/v3/endpoints` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:31.245839 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e182616-936c-4c01-bab0-65794f2da0cb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:31.247186 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e182616-936c-4c01-bab0-65794f2da0cb None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:31.341901 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 503/1009] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:39:31 2022] POST /identity/v3/endpoints => generated 334 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 19:39:31.451410 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b77120-15d7-4b71-9a3d-d8009a99911e None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:31.562159 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b77120-15d7-4b71-9a3d-d8009a99911e None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:31.565264 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:31.606818 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b792b-7f9f-4d97-9e17-3ff659b65dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:31.607368 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b792b-7f9f-4d97-9e17-3ff659b65dcf None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:31.607702 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b792b-7f9f-4d97-9e17-3ff659b65dcf None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:31.607904 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b792b-7f9f-4d97-9e17-3ff659b65dcf None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:31.608483 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19b792b-7f9f-4d97-9e17-3ff659b65dcf None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:31.610731 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19b792b-7f9f-4d97-9e17-3ff659b65dcf None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:31.621317 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-e19b792b-7f9f-4d97-9e17-3ff659b65dcf None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 24 19:39:31.621317 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:31.621317 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:39:31.621317 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:39:31.621317 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:39:31.621317 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:39:31.621317 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:39:31.621317 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:39:31.621317 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 24 19:39:31.621317 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:31.621317 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:39:31.621317 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:31.621317 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:31.621317 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:31.621317 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:31.621317 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:31.621317 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:31.622464 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:31.622464 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:31.622464 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:31.622464 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:31.622464 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:31.622464 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:31.622464 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:39:31.622464 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:39:31.622464 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:39:31.622464 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:39:31.622464 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:31.622464 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:31.622464 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:31.622464 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:31.622464 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:31.622464 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:31.623323 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:31.623323 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:31.623323 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:31.623323 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:31.623323 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:31.623323 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:31.623323 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:31.623323 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:31.623323 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:31.623323 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:31.623323 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:39:31.623323 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:39:31.623323 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 24 19:39:31.623323 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:31.623323 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 507/1010] 10.222.0.60 () {56 vars in 1126 bytes} [Sat Sep 24 19:39:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:39:31.629224 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e182616-936c-4c01-bab0-65794f2da0cb None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:31.680067 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:31.738336 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e182616-936c-4c01-bab0-65794f2da0cb None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:31.775367 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee8e62-93b5-4ec6-b9ef-98a1c0b07b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:31.775978 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee8e62-93b5-4ec6-b9ef-98a1c0b07b76 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:31.776251 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee8e62-93b5-4ec6-b9ef-98a1c0b07b76 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:31.776517 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee8e62-93b5-4ec6-b9ef-98a1c0b07b76 None admin] PATH_INFO: `/v3/services` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:31.777154 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ee8e62-93b5-4ec6-b9ef-98a1c0b07b76 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:31.777453 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ee8e62-93b5-4ec6-b9ef-98a1c0b07b76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:31.778884 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ee8e62-93b5-4ec6-b9ef-98a1c0b07b76 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:31.785172 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 504/1011] 10.222.0.60 () {56 vars in 1122 bytes} [Sat Sep 24 19:39:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:31.791813 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b792b-7f9f-4d97-9e17-3ff659b65dcf None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:31.900047 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b792b-7f9f-4d97-9e17-3ff659b65dcf None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:31.945581 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b632fa4-7f08-46de-9d38-50baa4fc3ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:31.946247 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b632fa4-7f08-46de-9d38-50baa4fc3ac8 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:31.946524 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b632fa4-7f08-46de-9d38-50baa4fc3ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:31.946787 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b632fa4-7f08-46de-9d38-50baa4fc3ac8 None admin] PATH_INFO: `/v3/services` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:31.947429 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b632fa4-7f08-46de-9d38-50baa4fc3ac8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:31.947724 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b632fa4-7f08-46de-9d38-50baa4fc3ac8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:31.949062 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b632fa4-7f08-46de-9d38-50baa4fc3ac8 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:31.955313 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 508/1012] 10.222.0.60 () {56 vars in 1122 bytes} [Sat Sep 24 19:39:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:31.960753 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee8e62-93b5-4ec6-b9ef-98a1c0b07b76 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:32.068437 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee8e62-93b5-4ec6-b9ef-98a1c0b07b76 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:32.069955 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:32.102613 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11bf719-575a-4c8d-a1dc-267f13234296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:32.103798 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11bf719-575a-4c8d-a1dc-267f13234296 None admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:32.104075 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11bf719-575a-4c8d-a1dc-267f13234296 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:32.104344 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11bf719-575a-4c8d-a1dc-267f13234296 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:32.105016 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11bf719-575a-4c8d-a1dc-267f13234296 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:32.106394 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11bf719-575a-4c8d-a1dc-267f13234296 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:32.182086 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 505/1013] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:39:31 2022] POST /identity/v3/endpoints => generated 325 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:39:33.277912 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4f696-e023-49e1-9bf8-c009ae5b33eb None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:33.278436 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4f696-e023-49e1-9bf8-c009ae5b33eb None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:33.278436 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4f696-e023-49e1-9bf8-c009ae5b33eb None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:33.279910 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 509/1014] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:39:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:39:33.285178 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc2d10-4b58-404c-8511-11e6e043efdc None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:33.285663 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc2d10-4b58-404c-8511-11e6e043efdc None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:33.285762 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc2d10-4b58-404c-8511-11e6e043efdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:33.316549 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-6dcc2d10-4b58-404c-8511-11e6e043efdc None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:39:33.317768 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-6dcc2d10-4b58-404c-8511-11e6e043efdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:39:33.396658 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 506/1015] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:39:33 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:39:33.672617 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb4f696-e023-49e1-9bf8-c009ae5b33eb None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:33.699244 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3990bd4-3ad1-4e64-aafc-e539fb184827 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:33.699534 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3990bd4-3ad1-4e64-aafc-e539fb184827 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:33.699808 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3990bd4-3ad1-4e64-aafc-e539fb184827 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:33.701143 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 507/1016] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:39:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:39:33.704520 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:33.707410 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842e573-da65-45a9-a20e-e3551884b25c None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:33.707694 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842e573-da65-45a9-a20e-e3551884b25c None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:33.708138 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842e573-da65-45a9-a20e-e3551884b25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:33.726970 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-2842e573-da65-45a9-a20e-e3551884b25c None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:39:33.728138 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-2842e573-da65-45a9-a20e-e3551884b25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:39:33.784836 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb4f696-e023-49e1-9bf8-c009ae5b33eb None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:33.804622 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 508/1017] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:39:33 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 19:39:33.823268 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3830a839-0606-4ad3-982f-4235aff773ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:33.823881 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830a839-0606-4ad3-982f-4235aff773ce None admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:33.824154 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830a839-0606-4ad3-982f-4235aff773ce None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:33.824420 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830a839-0606-4ad3-982f-4235aff773ce None admin] PATH_INFO: `/v3/services` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:33.825076 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3830a839-0606-4ad3-982f-4235aff773ce None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:33.826472 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3830a839-0606-4ad3-982f-4235aff773ce None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:33.942196 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 510/1018] 10.222.0.60 () {60 vars in 1141 bytes} [Sat Sep 24 19:39:33 2022] POST /identity/v3/services => generated 242 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:39:34.083869 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2842e573-da65-45a9-a20e-e3551884b25c None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:34.104652 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:34.201710 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2842e573-da65-45a9-a20e-e3551884b25c None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:34.251076 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a143c57-90ef-45ef-abe1-b3c0daa7d265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:34.251741 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a143c57-90ef-45ef-abe1-b3c0daa7d265 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:34.252015 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a143c57-90ef-45ef-abe1-b3c0daa7d265 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:34.252281 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a143c57-90ef-45ef-abe1-b3c0daa7d265 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:34.264906 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a143c57-90ef-45ef-abe1-b3c0daa7d265 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:39:34.270226 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-7a143c57-90ef-45ef-abe1-b3c0daa7d265 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 24 19:39:34.270226 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:34.270226 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:34.270226 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:34.270226 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:34.270226 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:34.270226 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:34.270226 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:34.270226 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:34.270226 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:34.270226 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:34.270226 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:34.270226 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:39:34.270226 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:39:34.270226 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:39:34.270226 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:39:34.271334 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:39:34.271334 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:39:34.271334 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:39:34.271334 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:39:34.271334 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:34.271334 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:34.271334 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:34.271334 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:34.271334 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:34.271334 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:34.271334 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:34.271334 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:34.271334 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:34.271334 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:34.271334 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:34.271334 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:34.272245 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:34.272245 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:34.272245 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:34.272245 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:34.272245 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:39:34.272245 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:39:34.272245 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:39:34.272245 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:39:34.272245 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:39:34.272245 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:39:34.272245 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 24 19:39:34.272245 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:39:34.272245 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 509/1019] 10.222.0.60 () {56 vars in 1120 bytes} [Sat Sep 24 19:39:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:39:34.279221 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3830a839-0606-4ad3-982f-4235aff773ce None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:34.372928 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8b79d-0bc0-4afa-a9e6-b6daa77cad95 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:34.373537 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8b79d-0bc0-4afa-a9e6-b6daa77cad95 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:34.373537 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8b79d-0bc0-4afa-a9e6-b6daa77cad95 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:34.374853 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 510/1020] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:39:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:39:34.380632 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7dce4b-0c85-4a6b-99c1-74330dc9caf4 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:34.380907 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7dce4b-0c85-4a6b-99c1-74330dc9caf4 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:34.381182 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7dce4b-0c85-4a6b-99c1-74330dc9caf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:34.382832 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:34.398212 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3830a839-0606-4ad3-982f-4235aff773ce None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:34.400467 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-be7dce4b-0c85-4a6b-99c1-74330dc9caf4 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:39:34.401710 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-be7dce4b-0c85-4a6b-99c1-74330dc9caf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:39:34.439473 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc4a4ed-da9e-45d2-9f1f-41b403b17263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:34.440095 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4a4ed-da9e-45d2-9f1f-41b403b17263 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:34.440377 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4a4ed-da9e-45d2-9f1f-41b403b17263 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:34.440652 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4a4ed-da9e-45d2-9f1f-41b403b17263 None admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:34.441393 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc4a4ed-da9e-45d2-9f1f-41b403b17263 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:34.441725 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc4a4ed-da9e-45d2-9f1f-41b403b17263 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:34.443109 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc4a4ed-da9e-45d2-9f1f-41b403b17263 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:34.451892 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 511/1021] 10.222.0.60 () {56 vars in 1115 bytes} [Sat Sep 24 19:39:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:34.458440 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc4a4ed-da9e-45d2-9f1f-41b403b17263 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:34.493539 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 511/1022] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:39:34 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 19:39:34.565202 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc4a4ed-da9e-45d2-9f1f-41b403b17263 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:34.604669 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e4895e-9b2a-4921-946e-5933ebbbe890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:34.605303 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4895e-9b2a-4921-946e-5933ebbbe890 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:34.605603 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4895e-9b2a-4921-946e-5933ebbbe890 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:34.605870 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4895e-9b2a-4921-946e-5933ebbbe890 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:34.617380 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e4895e-9b2a-4921-946e-5933ebbbe890 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:34.618870 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e4895e-9b2a-4921-946e-5933ebbbe890 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:34.634254 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-71e4895e-9b2a-4921-946e-5933ebbbe890 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:39:34.634254 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:34.634254 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:34.634254 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:34.634254 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:34.634254 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:34.634254 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:34.634254 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:34.634254 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:34.634254 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:34.634254 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:34.634254 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:34.634254 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:39:34.634254 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:39:34.634254 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:39:34.634254 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:39:34.635407 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:34.635407 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:34.635407 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:34.635407 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:34.635407 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:34.635407 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:34.635407 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:34.635407 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:34.635407 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:34.635407 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:34.635407 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:34.635407 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:34.635407 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:34.635407 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:34.635407 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:34.635407 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:34.635407 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:39:34.636417 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:39:34.636417 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:39:34.636417 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:34.636417 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 512/1023] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:39:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:39:34.644248 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7dce4b-0c85-4a6b-99c1-74330dc9caf4 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:34.645774 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:34.760294 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7dce4b-0c85-4a6b-99c1-74330dc9caf4 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:34.767427 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e4895e-9b2a-4921-946e-5933ebbbe890 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:34.770538 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:34.801968 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2604a81-6fa6-4a43-b599-3da17c045f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:34.802581 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2604a81-6fa6-4a43-b599-3da17c045f6a None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:34.802861 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2604a81-6fa6-4a43-b599-3da17c045f6a None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:34.803124 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2604a81-6fa6-4a43-b599-3da17c045f6a None admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:34.803770 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2604a81-6fa6-4a43-b599-3da17c045f6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:34.804067 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2604a81-6fa6-4a43-b599-3da17c045f6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:34.805427 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2604a81-6fa6-4a43-b599-3da17c045f6a None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:34.821705 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 512/1024] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:39:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:34.824896 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2604a81-6fa6-4a43-b599-3da17c045f6a None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:34.883953 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e4895e-9b2a-4921-946e-5933ebbbe890 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:34.899521 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:34.940815 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57f2472-f18a-45f6-ac35-624ed8aebce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:34.941483 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f2472-f18a-45f6-ac35-624ed8aebce8 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:34.941973 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f2472-f18a-45f6-ac35-624ed8aebce8 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:34.942243 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f2472-f18a-45f6-ac35-624ed8aebce8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:34.943362 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57f2472-f18a-45f6-ac35-624ed8aebce8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:34.943674 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2604a81-6fa6-4a43-b599-3da17c045f6a None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:34.944793 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57f2472-f18a-45f6-ac35-624ed8aebce8 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:34.946452 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 513/1025] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:39:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:39:34.952812 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57f2472-f18a-45f6-ac35-624ed8aebce8 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:34.986626 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae5757e-2682-403f-b0db-d6c144f0c63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:34.987264 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5757e-2682-403f-b0db-d6c144f0c63d None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:34.987742 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5757e-2682-403f-b0db-d6c144f0c63d None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:34.988021 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5757e-2682-403f-b0db-d6c144f0c63d None admin] PATH_INFO: `/v3/users/nova` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:34.998028 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae5757e-2682-403f-b0db-d6c144f0c63d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:35.000191 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae5757e-2682-403f-b0db-d6c144f0c63d None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:35.016193 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-2ae5757e-2682-403f-b0db-d6c144f0c63d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 24 19:39:35.016193 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:35.016193 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:35.016193 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:35.016193 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:35.016193 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:35.016193 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:35.016193 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:35.016193 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:35.016193 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:35.016193 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:35.016193 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:35.016193 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:39:35.016193 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:39:35.016193 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:39:35.016193 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:39:35.017261 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:35.017261 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:35.017261 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:39:35.017261 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:39:35.017261 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:39:35.017261 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:39:35.017261 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:35.017261 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:35.017261 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:35.017261 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:35.017261 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:35.017261 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:35.017261 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:35.017261 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:35.017261 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:35.017261 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:35.017261 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:35.017261 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:35.018999 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:35.018999 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:35.018999 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:39:35.018999 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:39:35.018999 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:39:35.018999 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:39:35.018999 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:39:35.018999 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:39:35.018999 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 24 19:39:35.018999 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:39:35.018999 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 513/1026] 10.222.0.60 () {56 vars in 1093 bytes} [Sat Sep 24 19:39:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:39:35.023993 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae5757e-2682-403f-b0db-d6c144f0c63d None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:35.037778 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:35.072385 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57f2472-f18a-45f6-ac35-624ed8aebce8 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:35.110486 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63d7d2-c53e-4ce8-96a0-a1425107dc28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:35.111237 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63d7d2-c53e-4ce8-96a0-a1425107dc28 None admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:35.111550 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63d7d2-c53e-4ce8-96a0-a1425107dc28 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:35.111819 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63d7d2-c53e-4ce8-96a0-a1425107dc28 None admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:35.112472 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f63d7d2-c53e-4ce8-96a0-a1425107dc28 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:35.113959 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f63d7d2-c53e-4ce8-96a0-a1425107dc28 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:35.142164 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae5757e-2682-403f-b0db-d6c144f0c63d None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:35.168602 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:35.180208 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4b42c1-9cc7-49a9-b7ec-ba96062f833b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:35.180816 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b42c1-9cc7-49a9-b7ec-ba96062f833b None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:35.181158 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b42c1-9cc7-49a9-b7ec-ba96062f833b None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:35.181436 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b42c1-9cc7-49a9-b7ec-ba96062f833b None admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:35.182193 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4b42c1-9cc7-49a9-b7ec-ba96062f833b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:35.182498 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4b42c1-9cc7-49a9-b7ec-ba96062f833b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:35.183917 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4b42c1-9cc7-49a9-b7ec-ba96062f833b None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:35.201697 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 514/1027] 10.222.0.60 () {56 vars in 1133 bytes} [Sat Sep 24 19:39:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:35.208253 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4b42c1-9cc7-49a9-b7ec-ba96062f833b None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:35.211298 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 514/1028] 10.222.0.60 () {60 vars in 1141 bytes} [Sat Sep 24 19:39:34 2022] POST /identity/v3/projects => generated 311 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 19:39:35.332955 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4b42c1-9cc7-49a9-b7ec-ba96062f833b None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:35.375442 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09292afc-cc80-4ca8-b523-dd2b6a55951c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:35.376106 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09292afc-cc80-4ca8-b523-dd2b6a55951c None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:35.376352 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09292afc-cc80-4ca8-b523-dd2b6a55951c None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:35.376615 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09292afc-cc80-4ca8-b523-dd2b6a55951c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:35.438304 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:35.461527 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09292afc-cc80-4ca8-b523-dd2b6a55951c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:35.463307 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09292afc-cc80-4ca8-b523-dd2b6a55951c None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:35.572445 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 515/1029] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Sep 24 19:39:35 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 19:39:35.579035 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63d7d2-c53e-4ce8-96a0-a1425107dc28 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:35.701297 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63d7d2-c53e-4ce8-96a0-a1425107dc28 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:35.726953 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:35.739921 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eaaba4-33d6-4277-b434-7a7d2e7802af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:35.740601 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eaaba4-33d6-4277-b434-7a7d2e7802af None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:35.749649 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eaaba4-33d6-4277-b434-7a7d2e7802af None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:35.749649 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eaaba4-33d6-4277-b434-7a7d2e7802af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:35.754413 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eaaba4-33d6-4277-b434-7a7d2e7802af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:35.756122 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eaaba4-33d6-4277-b434-7a7d2e7802af None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:35.771729 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-32eaaba4-33d6-4277-b434-7a7d2e7802af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:39:35.771729 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:35.771729 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:35.771729 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:35.771729 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:35.771729 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:35.771729 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:35.771729 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:35.771729 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:35.771729 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:35.771729 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:35.771729 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:35.771729 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:39:35.771729 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:39:35.771729 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:39:35.771729 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:39:35.772816 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:35.772816 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:35.772816 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:35.772816 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:35.772816 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:35.772816 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:35.772816 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:35.772816 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:35.772816 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:35.772816 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:35.772816 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:35.772816 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:35.772816 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:35.772816 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:35.772816 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:35.772816 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:35.772816 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:39:35.776934 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:39:35.776934 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:39:35.776934 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:35.776934 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 515/1030] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:39:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:39:35.779397 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09292afc-cc80-4ca8-b523-dd2b6a55951c None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:35.869224 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:35.892477 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09292afc-cc80-4ca8-b523-dd2b6a55951c None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:35.935058 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a5bec-c93a-4256-af57-9c03e63504e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:35.935593 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a5bec-c93a-4256-af57-9c03e63504e2 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:35.935872 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a5bec-c93a-4256-af57-9c03e63504e2 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:35.936145 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a5bec-c93a-4256-af57-9c03e63504e2 None admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:35.936796 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39a5bec-c93a-4256-af57-9c03e63504e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:35.937096 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39a5bec-c93a-4256-af57-9c03e63504e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:35.939052 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39a5bec-c93a-4256-af57-9c03e63504e2 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:35.956311 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 516/1031] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:39:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:35.957690 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eaaba4-33d6-4277-b434-7a7d2e7802af None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:36.068294 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eaaba4-33d6-4277-b434-7a7d2e7802af None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:36.107054 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a1c29-9c65-4890-bd2a-87a595656bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:36.107703 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a1c29-9c65-4890-bd2a-87a595656bfc None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:36.107982 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a1c29-9c65-4890-bd2a-87a595656bfc None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:36.108254 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a1c29-9c65-4890-bd2a-87a595656bfc None admin] PATH_INFO: `/v3/projects/service` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:36.116318 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a1c29-9c65-4890-bd2a-87a595656bfc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:36.117870 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a1c29-9c65-4890-bd2a-87a595656bfc None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:36.130692 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-138a1c29-9c65-4890-bd2a-87a595656bfc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:39:36.130692 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:36.130692 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:36.130692 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:36.130692 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:36.130692 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:36.130692 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:36.130692 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:36.130692 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:36.130692 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:36.130692 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:36.130692 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:36.130692 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:39:36.130692 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:39:36.130692 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:39:36.131678 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:39:36.131678 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:36.131678 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:36.131678 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:36.131678 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:36.131678 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:36.131678 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:36.131678 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:36.131678 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:36.131678 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:36.131678 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:36.131678 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:36.131678 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:36.131678 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:36.131678 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:36.131678 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:36.131678 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:36.133205 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:39:36.133205 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:39:36.133205 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:39:36.133205 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:39:36.133205 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:39:36.133205 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:39:36.133205 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:39:36.133205 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:36.133205 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 516/1032] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Sep 24 19:39:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:39:36.140420 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a5bec-c93a-4256-af57-9c03e63504e2 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:36.260835 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a5bec-c93a-4256-af57-9c03e63504e2 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:36.296770 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc6885d-105f-4340-994c-69a60b8e4eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:36.297425 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6885d-105f-4340-994c-69a60b8e4eca None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:36.297740 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6885d-105f-4340-994c-69a60b8e4eca None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:36.298007 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6885d-105f-4340-994c-69a60b8e4eca None admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:36.298706 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc6885d-105f-4340-994c-69a60b8e4eca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:36.299009 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc6885d-105f-4340-994c-69a60b8e4eca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:36.300439 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc6885d-105f-4340-994c-69a60b8e4eca None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:36.312595 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a7760-5079-4791-817f-3e6f559687db None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:36.312971 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a7760-5079-4791-817f-3e6f559687db None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:36.313966 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a7760-5079-4791-817f-3e6f559687db None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:36.320386 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 517/1033] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:39:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:39:36.320567 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 517/1034] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Sep 24 19:39:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:36.321833 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b10ce5-b1ca-4be8-ac9f-0a13d9581ee8 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:36.322118 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b10ce5-b1ca-4be8-ac9f-0a13d9581ee8 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:36.322389 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b10ce5-b1ca-4be8-ac9f-0a13d9581ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:36.322555 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc6885d-105f-4340-994c-69a60b8e4eca None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:36.325401 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:36.344724 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-53b10ce5-b1ca-4be8-ac9f-0a13d9581ee8 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:39:36.347092 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-53b10ce5-b1ca-4be8-ac9f-0a13d9581ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:39:36.382604 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:36.433686 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 518/1035] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:39:36 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:39:36.437400 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc6885d-105f-4340-994c-69a60b8e4eca None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:36.478355 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d19a25-57b9-4612-aba4-6ac886acfdb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:36.479144 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d19a25-57b9-4612-aba4-6ac886acfdb5 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:36.479423 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d19a25-57b9-4612-aba4-6ac886acfdb5 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:36.479705 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d19a25-57b9-4612-aba4-6ac886acfdb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:36.480472 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d19a25-57b9-4612-aba4-6ac886acfdb5 None admin] RBAC: Adding query filter params (role.id=ccbad8fea592451d9078a68926df4aca, scope.project.id=5c2da88af5714e619238772bde676a42, user.id=f3b5047a59bc4547be643ffa78808a6d) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:36.480786 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d19a25-57b9-4612-aba4-6ac886acfdb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:36.482250 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d19a25-57b9-4612-aba4-6ac886acfdb5 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:36.501919 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 518/1036] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Sep 24 19:39:36 2022] GET /identity/v3/role_assignments?user.id=f3b5047a59bc4547be643ffa78808a6d&scope.project.id=5c2da88af5714e619238772bde676a42&role.id=ccbad8fea592451d9078a68926df4aca => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:36.710733 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b10ce5-b1ca-4be8-ac9f-0a13d9581ee8 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:36.829106 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b10ce5-b1ca-4be8-ac9f-0a13d9581ee8 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:36.870630 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2908fa87-504a-4228-8cb3-a65aae4e0c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:36.871273 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908fa87-504a-4228-8cb3-a65aae4e0c7c None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:36.871551 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908fa87-504a-4228-8cb3-a65aae4e0c7c None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:36.871818 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908fa87-504a-4228-8cb3-a65aae4e0c7c None admin] PATH_INFO: `/v3/services/image` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:36.872404 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2908fa87-504a-4228-8cb3-a65aae4e0c7c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:36.873828 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2908fa87-504a-4228-8cb3-a65aae4e0c7c None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:36.883915 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-2908fa87-504a-4228-8cb3-a65aae4e0c7c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 24 19:39:36.883915 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:36.883915 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:39:36.883915 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:39:36.883915 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:39:36.883915 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:39:36.883915 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:39:36.883915 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:39:36.883915 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 24 19:39:36.883915 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:36.883915 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:39:36.883915 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:36.883915 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:36.883915 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:36.883915 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:36.883915 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:36.883915 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:36.885031 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:36.885031 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:36.885031 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:36.885031 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:36.885031 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:36.885031 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:36.885031 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:39:36.885031 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:39:36.885031 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:39:36.885031 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:39:36.885031 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:36.885031 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:36.885031 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:36.885031 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:36.885031 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:36.885031 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:36.885950 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:36.885950 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:36.885950 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:36.885950 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:36.885950 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:36.885950 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:36.885950 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:36.885950 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:36.885950 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:36.885950 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:36.885950 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:39:36.885950 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:39:36.885950 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 24 19:39:36.885950 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:36.885950 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 519/1037] 10.222.0.60 () {56 vars in 1105 bytes} [Sat Sep 24 19:39:36 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:39:36.892283 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d19a25-57b9-4612-aba4-6ac886acfdb5 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:36.994493 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:37.055555 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d19a25-57b9-4612-aba4-6ac886acfdb5 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:37.115163 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efca6d37-f006-4ba1-b34d-300b0a556818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:37.115736 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca6d37-f006-4ba1-b34d-300b0a556818 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:37.116019 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca6d37-f006-4ba1-b34d-300b0a556818 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:37.116292 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca6d37-f006-4ba1-b34d-300b0a556818 None admin] PATH_INFO: `/v3/services` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:37.116933 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efca6d37-f006-4ba1-b34d-300b0a556818 None admin] RBAC: Adding query filter params (name=image) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:37.117241 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efca6d37-f006-4ba1-b34d-300b0a556818 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:37.118664 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efca6d37-f006-4ba1-b34d-300b0a556818 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:37.124334 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 519/1038] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:39:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:37.132055 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2908fa87-504a-4228-8cb3-a65aae4e0c7c None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:37.164419 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:37.249132 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2908fa87-504a-4228-8cb3-a65aae4e0c7c None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:37.289918 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5810c0-1855-47d9-8f93-e723b5c0bf7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:37.290526 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5810c0-1855-47d9-8f93-e723b5c0bf7f None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:37.290805 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5810c0-1855-47d9-8f93-e723b5c0bf7f None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:37.291076 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5810c0-1855-47d9-8f93-e723b5c0bf7f None admin] PATH_INFO: `/v3/services` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:37.291714 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5810c0-1855-47d9-8f93-e723b5c0bf7f None admin] RBAC: Adding query filter params (type=image) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:37.292013 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5810c0-1855-47d9-8f93-e723b5c0bf7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:37.293382 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5810c0-1855-47d9-8f93-e723b5c0bf7f None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:37.304486 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 520/1039] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:39:37 2022] GET /identity/v3/services?type=image => generated 350 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:37.310363 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efca6d37-f006-4ba1-b34d-300b0a556818 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:37.433464 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efca6d37-f006-4ba1-b34d-300b0a556818 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:37.467662 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:37.475372 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1104878-be96-4a14-984c-29a160a790e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:37.476087 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1104878-be96-4a14-984c-29a160a790e5 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:37.476339 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1104878-be96-4a14-984c-29a160a790e5 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:37.476617 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1104878-be96-4a14-984c-29a160a790e5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:37.477427 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1104878-be96-4a14-984c-29a160a790e5 None admin] RBAC: Adding query filter params (interface=public, service_id=d4b7c430613e4d0b9a187cb7a0a12fe4, region_id=RegionOne) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:37.477775 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1104878-be96-4a14-984c-29a160a790e5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:37.482047 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1104878-be96-4a14-984c-29a160a790e5 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:37.491840 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 520/1040] 10.222.0.60 () {56 vars in 1251 bytes} [Sat Sep 24 19:39:37 2022] GET /identity/v3/endpoints?service_id=d4b7c430613e4d0b9a187cb7a0a12fe4&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:37.492676 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5810c0-1855-47d9-8f93-e723b5c0bf7f None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:37.532639 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4123a0-8713-4594-9290-5d4d24bb8a86 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:37.532989 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4123a0-8713-4594-9290-5d4d24bb8a86 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:37.533224 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4123a0-8713-4594-9290-5d4d24bb8a86 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:37.535913 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 521/1041] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:39:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:39:37.541847 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48482b40-6b84-490d-84ed-5b14885381b8 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:37.542162 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48482b40-6b84-490d-84ed-5b14885381b8 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:37.542413 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48482b40-6b84-490d-84ed-5b14885381b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:37.568895 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-48482b40-6b84-490d-84ed-5b14885381b8 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:39:37.571481 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-48482b40-6b84-490d-84ed-5b14885381b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:39:37.618567 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:37.633198 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5810c0-1855-47d9-8f93-e723b5c0bf7f None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:37.675943 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8cab96-890a-494f-ba25-5735441fde59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:37.676564 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8cab96-890a-494f-ba25-5735441fde59 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:37.676839 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8cab96-890a-494f-ba25-5735441fde59 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:37.677106 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8cab96-890a-494f-ba25-5735441fde59 None admin] PATH_INFO: `/v3/services` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:37.677759 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8cab96-890a-494f-ba25-5735441fde59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:37.680732 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8cab96-890a-494f-ba25-5735441fde59 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:37.685936 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 522/1042] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:39:37 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 19:39:37.697793 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 521/1043] 10.222.0.60 () {56 vars in 1087 bytes} [Sat Sep 24 19:39:37 2022] GET /identity/v3/services => generated 1957 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:39:37.964232 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48482b40-6b84-490d-84ed-5b14885381b8 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:38.109219 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48482b40-6b84-490d-84ed-5b14885381b8 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:38.144477 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:38.160128 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e1fd69-71ca-4247-b2e3-960bcb949b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:38.160788 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1fd69-71ca-4247-b2e3-960bcb949b6d None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:38.161068 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1fd69-71ca-4247-b2e3-960bcb949b6d None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:38.161341 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1fd69-71ca-4247-b2e3-960bcb949b6d None admin] PATH_INFO: `/v3/domains/default` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:38.164072 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e1fd69-71ca-4247-b2e3-960bcb949b6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:38.164222 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e1fd69-71ca-4247-b2e3-960bcb949b6d None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:38.169556 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 523/1044] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:39:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:38.172273 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8cab96-890a-494f-ba25-5735441fde59 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:38.307574 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8cab96-890a-494f-ba25-5735441fde59 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:38.350479 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f90eb-c867-4576-9a3e-31ae64474b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:38.351473 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f90eb-c867-4576-9a3e-31ae64474b2c None admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:38.351971 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f90eb-c867-4576-9a3e-31ae64474b2c None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:38.352437 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f90eb-c867-4576-9a3e-31ae64474b2c None admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:38.353312 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282f90eb-c867-4576-9a3e-31ae64474b2c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:38.354984 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282f90eb-c867-4576-9a3e-31ae64474b2c None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:38.460778 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 522/1045] 10.222.0.60 () {60 vars in 1132 bytes} [Sat Sep 24 19:39:38 2022] POST /identity/v3/users => generated 285 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 19:39:38.806994 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52de770-14a4-4cdc-ad7a-f061dff21757 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:38.807551 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52de770-14a4-4cdc-ad7a-f061dff21757 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:38.807551 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52de770-14a4-4cdc-ad7a-f061dff21757 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:38.809023 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 524/1046] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:39:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:39:38.814752 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a82b23-38ec-40d7-bab4-a73bcc27ee43 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:38.815039 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a82b23-38ec-40d7-bab4-a73bcc27ee43 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:38.815309 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a82b23-38ec-40d7-bab4-a73bcc27ee43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:38.834437 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-03a82b23-38ec-40d7-bab4-a73bcc27ee43 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:39:38.835630 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-03a82b23-38ec-40d7-bab4-a73bcc27ee43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:39:38.844680 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:38.913591 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 523/1047] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:39:38 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:39:39.198276 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52de770-14a4-4cdc-ad7a-f061dff21757 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:39.331128 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52de770-14a4-4cdc-ad7a-f061dff21757 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:39.388610 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8bf9b6-3b6a-48c4-885a-62d0e711078e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:39.389665 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8bf9b6-3b6a-48c4-885a-62d0e711078e None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:39.390113 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8bf9b6-3b6a-48c4-885a-62d0e711078e None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:39.390581 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8bf9b6-3b6a-48c4-885a-62d0e711078e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:39.410141 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8bf9b6-3b6a-48c4-885a-62d0e711078e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:39:39.419377 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-6b8bf9b6-3b6a-48c4-885a-62d0e711078e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 24 19:39:39.419377 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:39.419377 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:39.419377 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:39.419377 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:39.419377 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:39.419377 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:39.419377 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:39.419377 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:39.419377 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:39.419377 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:39.419377 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:39.419377 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:39:39.419377 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:39:39.419377 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:39:39.419377 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:39:39.420340 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:39:39.420340 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:39:39.420340 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:39:39.420340 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:39:39.420340 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:39.420340 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:39.420340 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:39.420340 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:39.420340 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:39.420340 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:39.420340 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:39.420340 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:39.420340 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:39.420340 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:39.420340 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:39.420340 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:39.421186 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:39.421186 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:39.421186 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:39.421186 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:39.421186 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:39:39.421186 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:39:39.421186 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:39:39.421186 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:39:39.421186 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:39:39.421186 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:39:39.421186 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 24 19:39:39.421186 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:39:39.423164 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 525/1048] 10.222.0.60 () {56 vars in 1120 bytes} [Sat Sep 24 19:39:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:39:39.431681 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a82b23-38ec-40d7-bab4-a73bcc27ee43 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:39.600062 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a82b23-38ec-40d7-bab4-a73bcc27ee43 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:39.636374 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c187a07-1ca0-4f8a-921a-de19e67e1382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:39.636990 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c187a07-1ca0-4f8a-921a-de19e67e1382 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:39.637266 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c187a07-1ca0-4f8a-921a-de19e67e1382 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:39.637561 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c187a07-1ca0-4f8a-921a-de19e67e1382 None admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:39.638235 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c187a07-1ca0-4f8a-921a-de19e67e1382 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:39.638538 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c187a07-1ca0-4f8a-921a-de19e67e1382 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:39.640044 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c187a07-1ca0-4f8a-921a-de19e67e1382 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:39.654376 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 524/1049] 10.222.0.60 () {56 vars in 1115 bytes} [Sat Sep 24 19:39:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:39:39.655787 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8bf9b6-3b6a-48c4-885a-62d0e711078e None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:39.720717 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:39.781067 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8bf9b6-3b6a-48c4-885a-62d0e711078e None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:39.820619 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e45eb6-5dc5-4208-9e59-77a3ec5a450c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:39.821291 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e45eb6-5dc5-4208-9e59-77a3ec5a450c None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:39.821570 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e45eb6-5dc5-4208-9e59-77a3ec5a450c None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:39.821818 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e45eb6-5dc5-4208-9e59-77a3ec5a450c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:39.833807 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e45eb6-5dc5-4208-9e59-77a3ec5a450c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:39.835460 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e45eb6-5dc5-4208-9e59-77a3ec5a450c None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:39.853328 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-a5e45eb6-5dc5-4208-9e59-77a3ec5a450c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:39:39.853328 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:39.853328 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:39.853328 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:39.853328 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:39.853328 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:39.853328 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:39.853328 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:39.853328 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:39.853328 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:39.853328 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:39.853328 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:39.853328 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:39:39.853328 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:39:39.853328 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:39:39.853328 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:39:39.854486 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:39.854486 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:39.854486 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:39.854486 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:39.854486 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:39.854486 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:39.854486 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:39.854486 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:39.854486 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:39.854486 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:39.854486 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:39.854486 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:39.854486 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:39.854486 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:39.854486 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:39.854486 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:39.854486 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:39:39.855375 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:39:39.855375 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:39:39.855375 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:39:39.855375 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 526/1050] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:39:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:39:39.863232 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c187a07-1ca0-4f8a-921a-de19e67e1382 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:39.868322 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:39.997724 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c187a07-1ca0-4f8a-921a-de19e67e1382 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:40.020709 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0598217-0f22-41f2-9e05-24d40d4af25c None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:40.021025 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0598217-0f22-41f2-9e05-24d40d4af25c None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:40.021260 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0598217-0f22-41f2-9e05-24d40d4af25c None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:40.022653 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 527/1051] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:39:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:39:40.027833 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ea29e-b9b9-4921-81c0-363967f55821 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:40.028122 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ea29e-b9b9-4921-81c0-363967f55821 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:40.028402 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ea29e-b9b9-4921-81c0-363967f55821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:40.035804 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43985cd-7dac-4116-adad-95cf400b8f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:40.036496 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43985cd-7dac-4116-adad-95cf400b8f24 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:40.036729 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43985cd-7dac-4116-adad-95cf400b8f24 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:40.037001 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43985cd-7dac-4116-adad-95cf400b8f24 None admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:40.037690 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43985cd-7dac-4116-adad-95cf400b8f24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:40.037997 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43985cd-7dac-4116-adad-95cf400b8f24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:40.039382 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43985cd-7dac-4116-adad-95cf400b8f24 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:40.048804 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-344ea29e-b9b9-4921-81c0-363967f55821 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:39:40.050338 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-344ea29e-b9b9-4921-81c0-363967f55821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:39:40.053101 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 525/1052] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:39:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:40.058905 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43985cd-7dac-4116-adad-95cf400b8f24 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:40.135687 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 528/1053] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:39:40 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 19:39:40.135983 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:40.183166 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43985cd-7dac-4116-adad-95cf400b8f24 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:40.224387 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9120734d-a407-47a4-a011-9e293646e962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:40.225086 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120734d-a407-47a4-a011-9e293646e962 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:40.225466 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120734d-a407-47a4-a011-9e293646e962 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:40.225750 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120734d-a407-47a4-a011-9e293646e962 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:40.233853 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9120734d-a407-47a4-a011-9e293646e962 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:40.236041 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9120734d-a407-47a4-a011-9e293646e962 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:40.249085 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-9120734d-a407-47a4-a011-9e293646e962 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 24 19:39:40.249085 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:40.249085 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:40.249085 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:40.249085 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:40.249085 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:40.249085 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:40.249085 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:40.249085 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:40.249085 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:40.249085 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:40.249085 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:40.249085 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:39:40.249085 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:39:40.249085 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:39:40.249085 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:39:40.256313 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:40.256313 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:40.256313 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:39:40.256313 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:39:40.256313 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:39:40.256313 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:39:40.256313 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:40.256313 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:40.256313 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:40.256313 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:40.256313 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:40.256313 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:40.256313 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:40.256313 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:40.256313 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:40.256313 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:40.256313 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:40.256313 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:40.257547 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:40.257547 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:40.257547 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:39:40.257547 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:39:40.257547 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:39:40.257547 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:39:40.257547 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:39:40.257547 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:39:40.257547 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 24 19:39:40.257547 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:40.257547 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 526/1054] 10.222.0.60 () {56 vars in 1093 bytes} [Sat Sep 24 19:39:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:39:40.258169 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ea29e-b9b9-4921-81c0-363967f55821 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:40.301569 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:40.372624 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ea29e-b9b9-4921-81c0-363967f55821 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:40.409397 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4316f293-c573-4330-89ae-6b652af6dcf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:40.409973 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316f293-c573-4330-89ae-6b652af6dcf2 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:40.410322 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316f293-c573-4330-89ae-6b652af6dcf2 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:40.410587 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316f293-c573-4330-89ae-6b652af6dcf2 None admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:40.411273 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4316f293-c573-4330-89ae-6b652af6dcf2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:40.411580 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4316f293-c573-4330-89ae-6b652af6dcf2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:40.413005 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4316f293-c573-4330-89ae-6b652af6dcf2 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:40.435178 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 529/1055] 10.222.0.60 () {56 vars in 1133 bytes} [Sat Sep 24 19:39:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:40.441025 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9120734d-a407-47a4-a011-9e293646e962 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:40.441594 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4316f293-c573-4330-89ae-6b652af6dcf2 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:40.556094 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:40.565660 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4316f293-c573-4330-89ae-6b652af6dcf2 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:40.573196 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9120734d-a407-47a4-a011-9e293646e962 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:40.606550 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:40.622312 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323fa10-4f09-41f5-830b-cdc376b12c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:40.622966 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323fa10-4f09-41f5-830b-cdc376b12c41 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:40.623243 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323fa10-4f09-41f5-830b-cdc376b12c41 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:40.623339 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800a2094-18ef-4f1b-a2ed-66b35ffd1494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:40.623513 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323fa10-4f09-41f5-830b-cdc376b12c41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:40.623972 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a2094-18ef-4f1b-a2ed-66b35ffd1494 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:40.624249 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a2094-18ef-4f1b-a2ed-66b35ffd1494 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:40.624518 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a2094-18ef-4f1b-a2ed-66b35ffd1494 None admin] PATH_INFO: `/v3/services/image` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:40.625247 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800a2094-18ef-4f1b-a2ed-66b35ffd1494 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:40.628082 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800a2094-18ef-4f1b-a2ed-66b35ffd1494 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:40.635623 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3323fa10-4f09-41f5-830b-cdc376b12c41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:40.637165 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3323fa10-4f09-41f5-830b-cdc376b12c41 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:40.638999 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-800a2094-18ef-4f1b-a2ed-66b35ffd1494 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 24 19:39:40.638999 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:40.638999 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:39:40.638999 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:39:40.638999 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:39:40.638999 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:39:40.638999 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:39:40.638999 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:39:40.638999 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 24 19:39:40.638999 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:40.638999 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:39:40.638999 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:40.638999 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:40.638999 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:40.638999 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:40.638999 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:40.638999 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:40.639967 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:40.639967 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:40.639967 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:40.639967 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:40.639967 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:40.639967 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:40.639967 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:39:40.639967 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:39:40.639967 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:39:40.639967 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:39:40.639967 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:40.639967 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:40.639967 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:40.639967 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:40.639967 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:40.639967 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:40.641590 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:40.641590 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:40.641590 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:40.641590 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:40.641590 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:40.641590 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:40.641590 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:40.641590 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:40.641590 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:40.641590 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:40.641590 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:39:40.641590 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:39:40.641590 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 24 19:39:40.641590 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:40.641590 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 527/1056] 10.222.0.60 () {56 vars in 1105 bytes} [Sat Sep 24 19:39:40 2022] GET /identity/v3/services/image => generated 86 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:39:40.647310 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800a2094-18ef-4f1b-a2ed-66b35ffd1494 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:40.660930 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-3323fa10-4f09-41f5-830b-cdc376b12c41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:39:40.660930 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:40.660930 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:40.660930 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:40.660930 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:40.660930 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:40.660930 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:40.660930 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:40.660930 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:40.660930 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:40.660930 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:40.660930 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:40.660930 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:39:40.660930 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:39:40.660930 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:39:40.660930 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:39:40.661947 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:40.661947 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:40.661947 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:40.661947 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:40.661947 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:40.661947 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:40.661947 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:40.661947 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:40.661947 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:40.661947 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:40.661947 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:40.661947 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:40.661947 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:40.661947 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:40.661947 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:40.661947 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:40.661947 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:39:40.662879 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:39:40.662879 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:39:40.662879 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:39:40.664327 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 530/1057] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:39:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:39:40.669917 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323fa10-4f09-41f5-830b-cdc376b12c41 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:40.775835 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800a2094-18ef-4f1b-a2ed-66b35ffd1494 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:40.786516 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323fa10-4f09-41f5-830b-cdc376b12c41 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:40.821294 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5ba7a-953f-4864-9646-b69f8bea89b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:40.822042 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5ba7a-953f-4864-9646-b69f8bea89b2 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:40.822328 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5ba7a-953f-4864-9646-b69f8bea89b2 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:40.822599 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5ba7a-953f-4864-9646-b69f8bea89b2 None admin] PATH_INFO: `/v3/services` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:40.823234 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a5ba7a-953f-4864-9646-b69f8bea89b2 None admin] RBAC: Adding query filter params (name=image) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:40.823541 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a5ba7a-953f-4864-9646-b69f8bea89b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:40.824918 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a5ba7a-953f-4864-9646-b69f8bea89b2 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:40.826844 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89da9e27-7671-4391-81da-6ee683bee70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:40.827456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da9e27-7671-4391-81da-6ee683bee70d None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:40.830754 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da9e27-7671-4391-81da-6ee683bee70d None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:40.830754 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da9e27-7671-4391-81da-6ee683bee70d None admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:40.830754 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89da9e27-7671-4391-81da-6ee683bee70d None admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:40.830754 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89da9e27-7671-4391-81da-6ee683bee70d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:40.831109 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89da9e27-7671-4391-81da-6ee683bee70d None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:40.833220 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 528/1058] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:39:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:39:40.839064 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5ba7a-953f-4864-9646-b69f8bea89b2 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:40.851789 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 531/1059] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:39:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:39:40.852937 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89da9e27-7671-4391-81da-6ee683bee70d None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:40.856953 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:40.904892 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:40.958693 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5ba7a-953f-4864-9646-b69f8bea89b2 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:40.973891 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89da9e27-7671-4391-81da-6ee683bee70d None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:40.997564 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b84e3f-a5cd-41aa-9abc-b25e7d9f125a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:40.998181 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b84e3f-a5cd-41aa-9abc-b25e7d9f125a None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:40.998467 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b84e3f-a5cd-41aa-9abc-b25e7d9f125a None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:40.998744 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b84e3f-a5cd-41aa-9abc-b25e7d9f125a None admin] PATH_INFO: `/v3/services` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:40.999381 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b84e3f-a5cd-41aa-9abc-b25e7d9f125a None admin] RBAC: Adding query filter params (type=image) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:40.999688 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b84e3f-a5cd-41aa-9abc-b25e7d9f125a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:41.002565 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b84e3f-a5cd-41aa-9abc-b25e7d9f125a None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:41.007958 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 529/1060] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:39:40 2022] GET /identity/v3/services?type=image => generated 350 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:39:41.009200 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d9dd2-a291-4faa-a164-22d93a08c09d None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:41.009486 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d9dd2-a291-4faa-a164-22d93a08c09d None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:41.009793 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d9dd2-a291-4faa-a164-22d93a08c09d None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:41.011186 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 530/1061] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:39:41.011578 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdbdd4d-ca09-4a46-9286-b1f2f3bcd7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:41.012311 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbdd4d-ca09-4a46-9286-b1f2f3bcd7da None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:41.012754 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbdd4d-ca09-4a46-9286-b1f2f3bcd7da None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:41.013010 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbdd4d-ca09-4a46-9286-b1f2f3bcd7da None admin] PATH_INFO: `/v3/projects/service` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:41.014640 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d9dd2-a291-4faa-a164-22d93a08c09d None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:41.021458 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdbdd4d-ca09-4a46-9286-b1f2f3bcd7da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:41.022972 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdbdd4d-ca09-4a46-9286-b1f2f3bcd7da None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:41.035336 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-cfdbdd4d-ca09-4a46-9286-b1f2f3bcd7da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:39:41.035336 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:41.035336 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:41.035336 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:41.035336 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:41.035336 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:41.035336 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:41.035336 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:41.035336 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:41.035336 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:41.035336 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:41.035336 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:41.035336 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:39:41.035336 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:39:41.035336 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:39:41.036335 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:39:41.036335 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:41.036335 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:41.036335 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:41.036335 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:41.036335 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:41.036335 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:41.036335 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:41.036335 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:41.036335 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:41.036335 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:41.036335 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:41.036335 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:41.036335 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:41.036335 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:41.036335 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:41.036335 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:41.037267 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:39:41.037267 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:39:41.037267 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:39:41.037267 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:39:41.037267 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:39:41.037267 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:39:41.037267 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:39:41.037267 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:39:41.037267 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 532/1062] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Sep 24 19:39:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:39:41.039849 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284abfb-7a56-40b7-90f9-913175aea4ed None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:41.040133 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284abfb-7a56-40b7-90f9-913175aea4ed None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:41.040442 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284abfb-7a56-40b7-90f9-913175aea4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:41.058429 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-e284abfb-7a56-40b7-90f9-913175aea4ed None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:39:41.059625 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-e284abfb-7a56-40b7-90f9-913175aea4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:39:41.128665 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:41.134491 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d9dd2-a291-4faa-a164-22d93a08c09d None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:41.137606 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 533/1063] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:39:41 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:39:41.138156 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e284abfb-7a56-40b7-90f9-913175aea4ed None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:41.153442 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:41.175875 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e5f741-4d33-4e2c-ab7a-421073d057cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:41.176517 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5f741-4d33-4e2c-ab7a-421073d057cd None admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:41.176793 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5f741-4d33-4e2c-ab7a-421073d057cd None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:41.177125 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5f741-4d33-4e2c-ab7a-421073d057cd None admin] PATH_INFO: `/v3/endpoints` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:41.177917 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e5f741-4d33-4e2c-ab7a-421073d057cd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:41.179263 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e5f741-4d33-4e2c-ab7a-421073d057cd None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:41.254001 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e284abfb-7a56-40b7-90f9-913175aea4ed None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:41.289954 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6fdad7-6f1c-47db-b54f-617ac35d4ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:41.290551 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6fdad7-6f1c-47db-b54f-617ac35d4ff0 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:41.290826 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6fdad7-6f1c-47db-b54f-617ac35d4ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:41.291095 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6fdad7-6f1c-47db-b54f-617ac35d4ff0 None admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:41.291823 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6fdad7-6f1c-47db-b54f-617ac35d4ff0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:41.292125 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6fdad7-6f1c-47db-b54f-617ac35d4ff0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:41.293533 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6fdad7-6f1c-47db-b54f-617ac35d4ff0 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:41.305554 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 534/1064] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Sep 24 19:39:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:41.312197 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6fdad7-6f1c-47db-b54f-617ac35d4ff0 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:41.319590 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 531/1065] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:39:41 2022] POST /identity/v3/endpoints => generated 327 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:39:41.380671 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:41.417588 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e5f741-4d33-4e2c-ab7a-421073d057cd None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:41.435343 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6fdad7-6f1c-47db-b54f-617ac35d4ff0 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:41.482977 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd5de5-bc86-49e6-8fd0-71d5c9bc4af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:41.483649 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd5de5-bc86-49e6-8fd0-71d5c9bc4af7 None admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:41.483927 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd5de5-bc86-49e6-8fd0-71d5c9bc4af7 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:41.484190 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd5de5-bc86-49e6-8fd0-71d5c9bc4af7 None admin] PATH_INFO: `/v3/projects/5c2da88af5714e619238772bde676a42/users/f3b5047a59bc4547be643ffa78808a6d/roles/ccbad8fea592451d9078a68926df4aca` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:41.487965 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfd5de5-bc86-49e6-8fd0-71d5c9bc4af7 None admin] RBAC: Authorizing `identity:create_grant(project_id=5c2da88af5714e619238772bde676a42, user_id=f3b5047a59bc4547be643ffa78808a6d, role_id=ccbad8fea592451d9078a68926df4aca)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:41.489456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfd5de5-bc86-49e6-8fd0-71d5c9bc4af7 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:41.542524 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e5f741-4d33-4e2c-ab7a-421073d057cd None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:41.583552 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d500a1b-a0b7-43a9-9b7f-8b2051d36c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:41.584198 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d500a1b-a0b7-43a9-9b7f-8b2051d36c95 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:41.584475 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d500a1b-a0b7-43a9-9b7f-8b2051d36c95 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:41.584742 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d500a1b-a0b7-43a9-9b7f-8b2051d36c95 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:41.600050 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d500a1b-a0b7-43a9-9b7f-8b2051d36c95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:39:41.606644 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-5d500a1b-a0b7-43a9-9b7f-8b2051d36c95 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:39:41.606644 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:41.606644 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:41.606644 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:41.606644 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:41.606644 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:41.606644 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:41.606644 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:41.606644 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:41.606644 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:41.606644 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:41.606644 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:41.606644 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:39:41.606644 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:39:41.606644 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:39:41.606644 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:39:41.608162 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:39:41.608162 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:39:41.608162 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:39:41.608162 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:39:41.608162 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:41.608162 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:41.608162 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:41.608162 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:41.608162 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:41.608162 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:41.608162 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:41.608162 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:41.608162 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:41.608162 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:41.608162 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:41.608162 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:41.610009 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:41.610009 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:41.610009 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:41.610009 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:41.610009 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:39:41.610009 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:39:41.610009 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:39:41.610009 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:39:41.610009 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:39:41.610009 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:39:41.610009 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:39:41.610009 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:41.610652 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 535/1066] 10.222.0.60 () {58 vars in 1439 bytes} [Sat Sep 24 19:39:41 2022] PUT /identity/v3/projects/5c2da88af5714e619238772bde676a42/users/f3b5047a59bc4547be643ffa78808a6d/roles/ccbad8fea592451d9078a68926df4aca => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:39:41.610727 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 532/1067] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Sep 24 19:39:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:39:41.614880 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd5de5-bc86-49e6-8fd0-71d5c9bc4af7 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:41.745385 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd5de5-bc86-49e6-8fd0-71d5c9bc4af7 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:41.758218 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:41.788895 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0643bc-c4e7-4b44-8f85-c8ccb018e60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:41.789857 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0643bc-c4e7-4b44-8f85-c8ccb018e60c None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:41.790301 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0643bc-c4e7-4b44-8f85-c8ccb018e60c None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:41.790714 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0643bc-c4e7-4b44-8f85-c8ccb018e60c None admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:41.791533 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0643bc-c4e7-4b44-8f85-c8ccb018e60c None admin] RBAC: Adding query filter params (name=admin) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:41.791973 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0643bc-c4e7-4b44-8f85-c8ccb018e60c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:41.793602 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0643bc-c4e7-4b44-8f85-c8ccb018e60c None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:41.805725 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 536/1068] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Sep 24 19:39:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:41.812144 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d500a1b-a0b7-43a9-9b7f-8b2051d36c95 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:41.850053 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:41.928064 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d500a1b-a0b7-43a9-9b7f-8b2051d36c95 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:41.966146 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f94f443-f89e-489e-abab-18966a0b5ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:41.966775 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94f443-f89e-489e-abab-18966a0b5ffa None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:41.967051 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94f443-f89e-489e-abab-18966a0b5ffa None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:41.967317 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94f443-f89e-489e-abab-18966a0b5ffa None admin] PATH_INFO: `/v3/users/f822b0e90bbd4858a6092f9e1950d6a8` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:41.983178 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f94f443-f89e-489e-abab-18966a0b5ffa None admin] RBAC: Authorizing `identity:get_user(user_id=f822b0e90bbd4858a6092f9e1950d6a8)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:41.984980 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f94f443-f89e-489e-abab-18966a0b5ffa None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:41.986722 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 533/1069] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Sep 24 19:39:41 2022] GET /identity/v3/users/f822b0e90bbd4858a6092f9e1950d6a8 => generated 285 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:41.992238 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0643bc-c4e7-4b44-8f85-c8ccb018e60c None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:42.100075 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0643bc-c4e7-4b44-8f85-c8ccb018e60c None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:42.139508 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132eff56-dc62-4f2d-b9b5-7588bfd18f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:42.140125 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132eff56-dc62-4f2d-b9b5-7588bfd18f32 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:42.140404 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132eff56-dc62-4f2d-b9b5-7588bfd18f32 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:42.141210 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132eff56-dc62-4f2d-b9b5-7588bfd18f32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:42.184963 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:42.214713 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132eff56-dc62-4f2d-b9b5-7588bfd18f32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:42.216293 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132eff56-dc62-4f2d-b9b5-7588bfd18f32 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:42.327881 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 537/1070] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Sep 24 19:39:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 19:39:42.334666 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f94f443-f89e-489e-abab-18966a0b5ffa None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:42.434512 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:42.445737 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f94f443-f89e-489e-abab-18966a0b5ffa None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:42.482145 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b0e53-a618-4470-9ccd-f9d07398ffa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:42.482864 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b0e53-a618-4470-9ccd-f9d07398ffa9 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:42.483206 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b0e53-a618-4470-9ccd-f9d07398ffa9 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:42.483544 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b0e53-a618-4470-9ccd-f9d07398ffa9 None admin] PATH_INFO: `/v3/projects/36372c4a9ca94b18a9caebcf473386fd` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:42.484863 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402b0e53-a618-4470-9ccd-f9d07398ffa9 None admin] RBAC: Authorizing `identity:get_project(project_id=36372c4a9ca94b18a9caebcf473386fd)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:42.486394 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402b0e53-a618-4470-9ccd-f9d07398ffa9 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:42.490617 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 534/1071] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Sep 24 19:39:42 2022] GET /identity/v3/projects/36372c4a9ca94b18a9caebcf473386fd => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:39:42.496480 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132eff56-dc62-4f2d-b9b5-7588bfd18f32 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:42.580673 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:42.612928 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132eff56-dc62-4f2d-b9b5-7588bfd18f32 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:42.649700 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d055ce-0712-42e9-934e-11c7eb9880d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:42.650314 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d055ce-0712-42e9-934e-11c7eb9880d4 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:42.650590 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d055ce-0712-42e9-934e-11c7eb9880d4 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:42.650858 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d055ce-0712-42e9-934e-11c7eb9880d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:42.651585 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d055ce-0712-42e9-934e-11c7eb9880d4 None admin] RBAC: Adding query filter params (role.id=f022705fa6ce43828345ef50b3f7efc9, scope.project.id=36372c4a9ca94b18a9caebcf473386fd, user.id=f822b0e90bbd4858a6092f9e1950d6a8) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:42.651890 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d055ce-0712-42e9-934e-11c7eb9880d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:42.654029 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d055ce-0712-42e9-934e-11c7eb9880d4 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:42.669533 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 538/1072] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Sep 24 19:39:42 2022] GET /identity/v3/role_assignments?user.id=f822b0e90bbd4858a6092f9e1950d6a8&scope.project.id=36372c4a9ca94b18a9caebcf473386fd&role.id=f022705fa6ce43828345ef50b3f7efc9 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:43.643333 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd440ec8-7eb3-4941-b13b-6bf32eb2ae18 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:43.643865 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd440ec8-7eb3-4941-b13b-6bf32eb2ae18 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:43.643865 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd440ec8-7eb3-4941-b13b-6bf32eb2ae18 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:43.645318 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 535/1073] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:39:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:39:43.650975 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa021e0-008f-448c-a054-f24614cf4504 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:43.651424 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa021e0-008f-448c-a054-f24614cf4504 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:43.651520 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa021e0-008f-448c-a054-f24614cf4504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:43.673955 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-faa021e0-008f-448c-a054-f24614cf4504 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:39:43.675340 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-faa021e0-008f-448c-a054-f24614cf4504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:39:43.761553 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 539/1074] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:39:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:39:43.902373 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f464b-de05-410f-a3a1-96d8b0ed6f05 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:43.902673 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f464b-de05-410f-a3a1-96d8b0ed6f05 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:43.902856 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f464b-de05-410f-a3a1-96d8b0ed6f05 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:43.904200 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 536/1075] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:39:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:39:43.911077 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c89e8-ffeb-40b2-9984-ce4d18e541b8 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:43.911376 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c89e8-ffeb-40b2-9984-ce4d18e541b8 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:43.911661 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c89e8-ffeb-40b2-9984-ce4d18e541b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:43.931689 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-fb7c89e8-ffeb-40b2-9984-ce4d18e541b8 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:39:43.932891 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-fb7c89e8-ffeb-40b2-9984-ce4d18e541b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:39:44.002785 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:44.011650 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 540/1076] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:39:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 19:39:44.034120 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f464b-de05-410f-a3a1-96d8b0ed6f05 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:44.148663 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f464b-de05-410f-a3a1-96d8b0ed6f05 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:44.187971 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073389a1-0159-4a37-9e9d-adcc58bf553e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:44.188627 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073389a1-0159-4a37-9e9d-adcc58bf553e None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:44.188916 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073389a1-0159-4a37-9e9d-adcc58bf553e None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:44.189187 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073389a1-0159-4a37-9e9d-adcc58bf553e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:44.222425 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:44.272052 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073389a1-0159-4a37-9e9d-adcc58bf553e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:44.273545 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073389a1-0159-4a37-9e9d-adcc58bf553e None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:44.295630 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c89e8-ffeb-40b2-9984-ce4d18e541b8 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:44.401582 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 537/1077] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Sep 24 19:39:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 19:39:44.407511 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073389a1-0159-4a37-9e9d-adcc58bf553e None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:44.424133 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c89e8-ffeb-40b2-9984-ce4d18e541b8 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:44.466990 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d571b5-a1e7-4dc0-8e7e-d416a17f358f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:44.466990 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d571b5-a1e7-4dc0-8e7e-d416a17f358f None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:44.466990 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d571b5-a1e7-4dc0-8e7e-d416a17f358f None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:44.466990 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d571b5-a1e7-4dc0-8e7e-d416a17f358f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:44.478429 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:44.478902 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d571b5-a1e7-4dc0-8e7e-d416a17f358f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:39:44.485218 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-22d571b5-a1e7-4dc0-8e7e-d416a17f358f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 24 19:39:44.485218 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:44.485218 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:44.485218 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:44.485218 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:44.485218 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:44.485218 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:44.485218 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:44.485218 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:44.485218 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:44.485218 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:44.485218 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:44.485218 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:39:44.485218 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:39:44.485218 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:39:44.485218 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:39:44.486460 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:39:44.486460 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:39:44.486460 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:39:44.486460 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:39:44.486460 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:44.486460 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:44.486460 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:44.486460 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:44.486460 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:44.486460 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:44.486460 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:44.486460 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:44.486460 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:44.486460 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:44.486460 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:44.486460 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:44.487474 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:44.487474 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:44.487474 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:44.487474 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:44.487474 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:39:44.487474 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:39:44.487474 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:39:44.487474 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:39:44.487474 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:39:44.487474 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:39:44.487474 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 24 19:39:44.487474 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:39:44.489731 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 541/1078] 10.222.0.60 () {56 vars in 1120 bytes} [Sat Sep 24 19:39:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:39:44.495753 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d571b5-a1e7-4dc0-8e7e-d416a17f358f None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:44.532137 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073389a1-0159-4a37-9e9d-adcc58bf553e None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:44.558354 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:44.576124 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f031a9fd-9464-46a7-8ebe-d65ea05c458f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:44.576769 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031a9fd-9464-46a7-8ebe-d65ea05c458f None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:44.577044 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031a9fd-9464-46a7-8ebe-d65ea05c458f None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:44.577311 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031a9fd-9464-46a7-8ebe-d65ea05c458f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:44.593911 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f031a9fd-9464-46a7-8ebe-d65ea05c458f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:44.595386 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f031a9fd-9464-46a7-8ebe-d65ea05c458f None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:44.611367 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-f031a9fd-9464-46a7-8ebe-d65ea05c458f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:39:44.611367 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:44.611367 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:44.611367 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:44.611367 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:44.611367 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:44.611367 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:44.611367 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:44.611367 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:44.611367 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:44.611367 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:44.611367 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:44.611367 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:39:44.611367 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:39:44.611367 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:39:44.611367 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:39:44.613120 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:44.613120 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:44.613120 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:44.613120 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:44.613120 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:44.613120 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:44.613120 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:44.613120 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:44.613120 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:44.613120 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:44.613120 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:44.613120 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:44.613120 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:44.613120 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:44.613120 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:44.613120 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:44.613120 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:39:44.614116 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:39:44.614116 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:39:44.614116 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:44.614116 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 538/1079] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:39:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:39:44.619290 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f031a9fd-9464-46a7-8ebe-d65ea05c458f None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:44.621624 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d571b5-a1e7-4dc0-8e7e-d416a17f358f None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:44.673289 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bf1cae-bbe6-471d-b87b-ef439b79cda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:44.673289 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf1cae-bbe6-471d-b87b-ef439b79cda6 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:44.673289 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf1cae-bbe6-471d-b87b-ef439b79cda6 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:44.674257 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf1cae-bbe6-471d-b87b-ef439b79cda6 None admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:44.674815 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bf1cae-bbe6-471d-b87b-ef439b79cda6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:44.675122 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bf1cae-bbe6-471d-b87b-ef439b79cda6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:44.676568 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bf1cae-bbe6-471d-b87b-ef439b79cda6 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:44.687105 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 542/1080] 10.222.0.60 () {56 vars in 1115 bytes} [Sat Sep 24 19:39:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:39:44.695832 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bf1cae-bbe6-471d-b87b-ef439b79cda6 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:44.763943 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f031a9fd-9464-46a7-8ebe-d65ea05c458f None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:44.786512 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:44.824341 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec8770f-26bc-4b19-bbde-23fdb7be842f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:44.824968 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8770f-26bc-4b19-bbde-23fdb7be842f None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:44.825246 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8770f-26bc-4b19-bbde-23fdb7be842f None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:44.825541 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8770f-26bc-4b19-bbde-23fdb7be842f None admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:44.826194 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec8770f-26bc-4b19-bbde-23fdb7be842f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:44.826499 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec8770f-26bc-4b19-bbde-23fdb7be842f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:44.827942 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec8770f-26bc-4b19-bbde-23fdb7be842f None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:44.841290 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 539/1081] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:39:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:44.844053 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bf1cae-bbe6-471d-b87b-ef439b79cda6 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:44.864468 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:44.887555 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784fc98f-7665-4018-b9d4-2c85dbc5b5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:44.888206 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784fc98f-7665-4018-b9d4-2c85dbc5b5ba None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:44.888485 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784fc98f-7665-4018-b9d4-2c85dbc5b5ba None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:44.888756 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784fc98f-7665-4018-b9d4-2c85dbc5b5ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:44.891046 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e22d9-16c3-4095-87a3-f456aae47cc8 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:44.891360 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e22d9-16c3-4095-87a3-f456aae47cc8 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:44.891658 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e22d9-16c3-4095-87a3-f456aae47cc8 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:44.893243 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 540/1082] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:39:44.898659 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc825a5a-357d-46b5-b26a-4f8d3f0644d6 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:44.898947 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc825a5a-357d-46b5-b26a-4f8d3f0644d6 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:44.899225 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc825a5a-357d-46b5-b26a-4f8d3f0644d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:44.903140 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784fc98f-7665-4018-b9d4-2c85dbc5b5ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:44.904646 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784fc98f-7665-4018-b9d4-2c85dbc5b5ba None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:44.919606 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-dc825a5a-357d-46b5-b26a-4f8d3f0644d6 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:39:44.920839 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-dc825a5a-357d-46b5-b26a-4f8d3f0644d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:39:44.922639 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-784fc98f-7665-4018-b9d4-2c85dbc5b5ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:39:44.922639 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:44.922639 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:44.922639 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:44.922639 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:44.922639 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:44.922639 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:44.922639 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:44.922639 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:44.922639 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:44.922639 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:44.922639 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:44.922639 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:39:44.922639 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:39:44.922639 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:39:44.922639 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:39:44.923630 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:44.923630 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:44.923630 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:44.923630 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:44.923630 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:44.923630 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:44.923630 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:44.923630 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:44.923630 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:44.923630 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:44.923630 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:44.923630 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:44.923630 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:44.923630 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:44.923630 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:44.923630 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:44.923630 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:39:44.924534 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:39:44.924534 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:39:44.924534 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:39:44.926141 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 543/1083] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:39:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:39:44.932488 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784fc98f-7665-4018-b9d4-2c85dbc5b5ba None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:45.011418 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 541/1084] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:39:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 19:39:45.070053 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784fc98f-7665-4018-b9d4-2c85dbc5b5ba None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:45.111711 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cdd86b-9160-4492-a32d-b34e3c47f817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:45.112369 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cdd86b-9160-4492-a32d-b34e3c47f817 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:45.112654 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cdd86b-9160-4492-a32d-b34e3c47f817 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:45.112933 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cdd86b-9160-4492-a32d-b34e3c47f817 None admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:45.113614 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cdd86b-9160-4492-a32d-b34e3c47f817 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:45.113922 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cdd86b-9160-4492-a32d-b34e3c47f817 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:45.117202 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cdd86b-9160-4492-a32d-b34e3c47f817 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:45.129345 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 544/1085] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:39:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:39:45.134798 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc825a5a-357d-46b5-b26a-4f8d3f0644d6 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:45.251269 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:45.255145 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc825a5a-357d-46b5-b26a-4f8d3f0644d6 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:45.280436 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cdd86b-9160-4492-a32d-b34e3c47f817 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:45.291252 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a86d66-96f2-4bc2-a4a1-36ed2a9ccbed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:45.291897 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a86d66-96f2-4bc2-a4a1-36ed2a9ccbed None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:45.292172 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a86d66-96f2-4bc2-a4a1-36ed2a9ccbed None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:45.292444 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a86d66-96f2-4bc2-a4a1-36ed2a9ccbed None admin] PATH_INFO: `/v3/users/nova` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:45.301898 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a86d66-96f2-4bc2-a4a1-36ed2a9ccbed None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:45.303389 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a86d66-96f2-4bc2-a4a1-36ed2a9ccbed None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:45.311827 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:45.318476 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-73a86d66-96f2-4bc2-a4a1-36ed2a9ccbed None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 24 19:39:45.318476 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:45.318476 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:45.318476 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:45.318476 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:45.318476 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:45.318476 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:45.318476 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:45.318476 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:45.318476 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:45.318476 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:45.318476 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:45.318476 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:39:45.318476 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:39:45.318476 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:39:45.318476 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:39:45.319501 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:45.319501 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:45.319501 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:39:45.319501 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:39:45.319501 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:39:45.319501 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:39:45.319501 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:45.319501 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:45.319501 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:45.319501 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:45.319501 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:45.319501 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:45.319501 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:45.319501 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:45.319501 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:45.319501 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:45.319501 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:45.319501 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:45.320497 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:45.320497 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:45.320497 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:39:45.320497 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:39:45.320497 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:39:45.320497 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:39:45.320497 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:39:45.320497 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:39:45.320497 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 24 19:39:45.320497 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:45.320497 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 542/1086] 10.222.0.60 () {56 vars in 1093 bytes} [Sat Sep 24 19:39:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:39:45.325969 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a86d66-96f2-4bc2-a4a1-36ed2a9ccbed None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:45.391242 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cdd86b-9160-4492-a32d-b34e3c47f817 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:45.430031 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a030f2c-d9cb-45bb-a8e4-b17e4b0f5c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:45.430673 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a030f2c-d9cb-45bb-a8e4-b17e4b0f5c15 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:45.430949 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a030f2c-d9cb-45bb-a8e4-b17e4b0f5c15 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:45.431228 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a030f2c-d9cb-45bb-a8e4-b17e4b0f5c15 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:45.441675 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a86d66-96f2-4bc2-a4a1-36ed2a9ccbed None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:45.442642 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a030f2c-d9cb-45bb-a8e4-b17e4b0f5c15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:39:45.447567 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-6a030f2c-d9cb-45bb-a8e4-b17e4b0f5c15 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:39:45.447567 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:45.447567 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:45.447567 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:45.447567 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:45.447567 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:45.447567 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:45.447567 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:45.447567 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:45.447567 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:45.447567 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:45.447567 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:45.447567 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:39:45.447567 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:39:45.447567 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:39:45.447567 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:39:45.448693 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:39:45.448693 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:39:45.448693 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:39:45.448693 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:39:45.448693 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:45.448693 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:45.448693 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:45.448693 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:45.448693 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:45.448693 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:45.448693 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:45.448693 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:45.448693 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:45.448693 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:45.448693 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:45.448693 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:45.449607 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:45.449607 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:45.449607 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:45.449607 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:45.449607 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:39:45.449607 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:39:45.449607 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:39:45.449607 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:39:45.449607 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:39:45.449607 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:39:45.449607 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:39:45.449607 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:39:45.449607 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 545/1087] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Sep 24 19:39:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:39:45.454998 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a030f2c-d9cb-45bb-a8e4-b17e4b0f5c15 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:45.481594 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3dfe3-d198-4889-8e9f-bc932bd1de3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:45.482207 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3dfe3-d198-4889-8e9f-bc932bd1de3e None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:45.482482 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3dfe3-d198-4889-8e9f-bc932bd1de3e None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:45.482755 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3dfe3-d198-4889-8e9f-bc932bd1de3e None admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:45.483563 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f3dfe3-d198-4889-8e9f-bc932bd1de3e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:45.483823 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f3dfe3-d198-4889-8e9f-bc932bd1de3e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:45.485924 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f3dfe3-d198-4889-8e9f-bc932bd1de3e None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:45.503842 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 543/1088] 10.222.0.60 () {56 vars in 1133 bytes} [Sat Sep 24 19:39:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:39:45.509580 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3dfe3-d198-4889-8e9f-bc932bd1de3e None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:45.527742 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:45.556043 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:45.565668 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a030f2c-d9cb-45bb-a8e4-b17e4b0f5c15 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:45.602608 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595d9bc-f071-4c43-91cc-d1c00d817175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:45.603112 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595d9bc-f071-4c43-91cc-d1c00d817175 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:45.603393 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595d9bc-f071-4c43-91cc-d1c00d817175 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:45.603670 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595d9bc-f071-4c43-91cc-d1c00d817175 None admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:45.604333 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8595d9bc-f071-4c43-91cc-d1c00d817175 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:45.604641 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8595d9bc-f071-4c43-91cc-d1c00d817175 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:45.606059 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8595d9bc-f071-4c43-91cc-d1c00d817175 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:45.615415 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 546/1089] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Sep 24 19:39:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:39:45.621453 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595d9bc-f071-4c43-91cc-d1c00d817175 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:45.626716 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3dfe3-d198-4889-8e9f-bc932bd1de3e None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:45.663194 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15397d64-136d-4e26-9392-fe8ede38fb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:45.663821 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15397d64-136d-4e26-9392-fe8ede38fb51 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:45.664101 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15397d64-136d-4e26-9392-fe8ede38fb51 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:45.664370 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15397d64-136d-4e26-9392-fe8ede38fb51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:45.732112 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595d9bc-f071-4c43-91cc-d1c00d817175 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:45.742021 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15397d64-136d-4e26-9392-fe8ede38fb51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:45.743477 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15397d64-136d-4e26-9392-fe8ede38fb51 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:45.761402 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:45.770781 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6840e91-0918-4d89-a8fe-8c1dc0cf2665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:45.771414 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6840e91-0918-4d89-a8fe-8c1dc0cf2665 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:45.774372 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6840e91-0918-4d89-a8fe-8c1dc0cf2665 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:45.774372 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6840e91-0918-4d89-a8fe-8c1dc0cf2665 None admin] PATH_INFO: `/v3/users/f822b0e90bbd4858a6092f9e1950d6a8` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:45.774372 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6840e91-0918-4d89-a8fe-8c1dc0cf2665 None admin] RBAC: Authorizing `identity:get_user(user_id=f822b0e90bbd4858a6092f9e1950d6a8)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:45.774622 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6840e91-0918-4d89-a8fe-8c1dc0cf2665 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:45.776165 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 547/1090] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Sep 24 19:39:45 2022] GET /identity/v3/users/f822b0e90bbd4858a6092f9e1950d6a8 => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:39:45.783198 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6840e91-0918-4d89-a8fe-8c1dc0cf2665 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:45.806603 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:45.854440 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 544/1091] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Sep 24 19:39:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 24 19:39:45.861066 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15397d64-136d-4e26-9392-fe8ede38fb51 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:45.895409 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6840e91-0918-4d89-a8fe-8c1dc0cf2665 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:45.933210 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be243284-8fe8-4ccd-92f2-df9ff3034e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:45.933877 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be243284-8fe8-4ccd-92f2-df9ff3034e1d None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:45.934158 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be243284-8fe8-4ccd-92f2-df9ff3034e1d None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:45.934435 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be243284-8fe8-4ccd-92f2-df9ff3034e1d None admin] PATH_INFO: `/v3/projects/36372c4a9ca94b18a9caebcf473386fd` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:45.935577 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be243284-8fe8-4ccd-92f2-df9ff3034e1d None admin] RBAC: Authorizing `identity:get_project(project_id=36372c4a9ca94b18a9caebcf473386fd)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:45.937032 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be243284-8fe8-4ccd-92f2-df9ff3034e1d None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:45.938761 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 548/1092] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Sep 24 19:39:45 2022] GET /identity/v3/projects/36372c4a9ca94b18a9caebcf473386fd => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:39:45.944730 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be243284-8fe8-4ccd-92f2-df9ff3034e1d None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:45.971518 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15397d64-136d-4e26-9392-fe8ede38fb51 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:45.989605 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:46.007398 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14fa99-62ee-4506-ba39-7906031796cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:46.008027 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14fa99-62ee-4506-ba39-7906031796cc None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:46.008301 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14fa99-62ee-4506-ba39-7906031796cc None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:46.008573 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14fa99-62ee-4506-ba39-7906031796cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:46.020288 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f14fa99-62ee-4506-ba39-7906031796cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:46.021770 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f14fa99-62ee-4506-ba39-7906031796cc None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:46.037790 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-0f14fa99-62ee-4506-ba39-7906031796cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:39:46.037790 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:46.037790 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:46.037790 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:46.037790 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:46.037790 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:46.037790 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:46.037790 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:46.037790 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:46.037790 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:46.037790 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:46.037790 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:46.037790 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:39:46.037790 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:39:46.037790 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:39:46.037790 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:39:46.038882 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:46.038882 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:46.038882 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:46.038882 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:46.038882 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:46.038882 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:46.038882 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:46.038882 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:46.038882 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:46.038882 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:46.038882 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:46.038882 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:46.038882 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:46.038882 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:46.038882 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:46.038882 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:46.038882 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:39:46.039796 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:39:46.039796 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:39:46.039796 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:46.039796 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 545/1093] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:39:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:39:46.044576 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14fa99-62ee-4506-ba39-7906031796cc None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:46.048430 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:46.060771 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be243284-8fe8-4ccd-92f2-df9ff3034e1d None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:46.098419 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79bec45-2be7-41b1-bdf7-8e9b73ca97f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:46.099091 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79bec45-2be7-41b1-bdf7-8e9b73ca97f4 None admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:46.099369 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79bec45-2be7-41b1-bdf7-8e9b73ca97f4 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:46.099639 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79bec45-2be7-41b1-bdf7-8e9b73ca97f4 None admin] PATH_INFO: `/v3/projects/36372c4a9ca94b18a9caebcf473386fd/users/f822b0e90bbd4858a6092f9e1950d6a8/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:46.101610 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79bec45-2be7-41b1-bdf7-8e9b73ca97f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=36372c4a9ca94b18a9caebcf473386fd, user_id=f822b0e90bbd4858a6092f9e1950d6a8, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:46.103079 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79bec45-2be7-41b1-bdf7-8e9b73ca97f4 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:46.152434 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14fa99-62ee-4506-ba39-7906031796cc None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:46.173810 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 549/1094] 10.222.0.60 () {58 vars in 1439 bytes} [Sat Sep 24 19:39:45 2022] PUT /identity/v3/projects/36372c4a9ca94b18a9caebcf473386fd/users/f822b0e90bbd4858a6092f9e1950d6a8/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 19:39:46.189018 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b546c-2daa-4077-a85d-ae7d69f935b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:46.189692 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b546c-2daa-4077-a85d-ae7d69f935b0 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:46.190029 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b546c-2daa-4077-a85d-ae7d69f935b0 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:46.190299 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b546c-2daa-4077-a85d-ae7d69f935b0 None admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:46.191029 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5b546c-2daa-4077-a85d-ae7d69f935b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:46.191329 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5b546c-2daa-4077-a85d-ae7d69f935b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:46.192748 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5b546c-2daa-4077-a85d-ae7d69f935b0 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:46.207938 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 546/1095] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:39:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:46.214297 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79bec45-2be7-41b1-bdf7-8e9b73ca97f4 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:46.330417 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79bec45-2be7-41b1-bdf7-8e9b73ca97f4 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:46.368091 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d72d5bc-f2d9-4ed2-8fb1-d328746f63a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:46.368721 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72d5bc-f2d9-4ed2-8fb1-d328746f63a3 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:46.368997 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72d5bc-f2d9-4ed2-8fb1-d328746f63a3 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:46.369271 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72d5bc-f2d9-4ed2-8fb1-d328746f63a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:46.376375 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d72d5bc-f2d9-4ed2-8fb1-d328746f63a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:46.378083 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d72d5bc-f2d9-4ed2-8fb1-d328746f63a3 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:46.391168 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-8d72d5bc-f2d9-4ed2-8fb1-d328746f63a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:39:46.391168 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:46.391168 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:46.391168 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:46.391168 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:46.391168 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:46.391168 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:46.391168 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:46.391168 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:46.391168 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:46.391168 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:46.391168 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:46.391168 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:39:46.391168 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:39:46.391168 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:39:46.392556 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:39:46.392556 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:46.392556 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:46.392556 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:46.392556 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:46.392556 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:46.392556 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:46.392556 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:46.392556 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:46.392556 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:46.392556 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:46.392556 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:46.392556 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:46.392556 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:46.392556 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:46.392556 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:46.392556 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:46.393793 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:39:46.393793 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:39:46.393793 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:39:46.393793 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:39:46.393793 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:39:46.393793 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:39:46.393793 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:39:46.393793 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:39:46.393793 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 550/1096] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Sep 24 19:39:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:39:46.399170 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b546c-2daa-4077-a85d-ae7d69f935b0 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:46.431050 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:46.509692 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b546c-2daa-4077-a85d-ae7d69f935b0 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:46.551648 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59eaf5a-dd2c-49bf-9dd6-1468fb73df9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:46.552270 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59eaf5a-dd2c-49bf-9dd6-1468fb73df9e None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:46.552550 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59eaf5a-dd2c-49bf-9dd6-1468fb73df9e None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:46.552853 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59eaf5a-dd2c-49bf-9dd6-1468fb73df9e None admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:46.553554 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59eaf5a-dd2c-49bf-9dd6-1468fb73df9e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:46.553861 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59eaf5a-dd2c-49bf-9dd6-1468fb73df9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:46.555312 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59eaf5a-dd2c-49bf-9dd6-1468fb73df9e None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:46.568411 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 547/1097] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Sep 24 19:39:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:46.574495 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d72d5bc-f2d9-4ed2-8fb1-d328746f63a3 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:46.586988 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:46.684902 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d72d5bc-f2d9-4ed2-8fb1-d328746f63a3 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:46.721070 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89425e29-8f37-4f0e-90b1-0561231d9b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:46.721913 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89425e29-8f37-4f0e-90b1-0561231d9b89 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:46.722197 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89425e29-8f37-4f0e-90b1-0561231d9b89 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:46.722524 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89425e29-8f37-4f0e-90b1-0561231d9b89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:46.723258 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89425e29-8f37-4f0e-90b1-0561231d9b89 None admin] RBAC: Adding query filter params (role.id=ccbad8fea592451d9078a68926df4aca, scope.project.id=5c2da88af5714e619238772bde676a42, user.id=f3b5047a59bc4547be643ffa78808a6d) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:46.723566 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89425e29-8f37-4f0e-90b1-0561231d9b89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:46.724990 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89425e29-8f37-4f0e-90b1-0561231d9b89 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:46.731239 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 551/1098] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Sep 24 19:39:46 2022] GET /identity/v3/role_assignments?user.id=f3b5047a59bc4547be643ffa78808a6d&scope.project.id=5c2da88af5714e619238772bde676a42&role.id=ccbad8fea592451d9078a68926df4aca => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:48.448054 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958471c-3f61-4a0d-a50b-0f80204817f1 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:48.452368 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958471c-3f61-4a0d-a50b-0f80204817f1 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:48.452368 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958471c-3f61-4a0d-a50b-0f80204817f1 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:48.452368 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 548/1099] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:39:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:39:48.458205 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ce4e2-ed7c-40b2-9fb4-e89a94271010 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:48.458715 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ce4e2-ed7c-40b2-9fb4-e89a94271010 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:48.458810 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ce4e2-ed7c-40b2-9fb4-e89a94271010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:48.478728 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-472ce4e2-ed7c-40b2-9fb4-e89a94271010 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:39:48.479921 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-472ce4e2-ed7c-40b2-9fb4-e89a94271010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:39:48.548135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 552/1100] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:39:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:39:48.816370 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958471c-3f61-4a0d-a50b-0f80204817f1 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:48.914440 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:48.925623 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958471c-3f61-4a0d-a50b-0f80204817f1 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:48.963566 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b71bce7-74ff-484b-a849-7bf7a6467ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:48.964197 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71bce7-74ff-484b-a849-7bf7a6467ca6 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:48.964474 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71bce7-74ff-484b-a849-7bf7a6467ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:48.964747 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71bce7-74ff-484b-a849-7bf7a6467ca6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:48.977049 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b71bce7-74ff-484b-a849-7bf7a6467ca6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:39:48.982109 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-5b71bce7-74ff-484b-a849-7bf7a6467ca6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:39:48.982109 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:39:48.982109 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:39:48.982109 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:39:48.982109 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:39:48.982109 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:39:48.982109 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:39:48.982109 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:39:48.982109 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:39:48.982109 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:39:48.982109 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:39:48.982109 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:39:48.982109 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:39:48.982109 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:39:48.982109 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:39:48.982109 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:39:48.983242 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:39:48.983242 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:39:48.983242 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:39:48.983242 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:39:48.983242 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:39:48.983242 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:39:48.983242 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:39:48.983242 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:39:48.983242 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:39:48.983242 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:39:48.983242 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:39:48.983242 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:39:48.983242 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:39:48.983242 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:39:48.983242 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:39:48.983242 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:39:48.984184 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:39:48.984184 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:39:48.984184 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:39:48.984184 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:39:48.984184 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:39:48.984184 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:39:48.984184 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:39:48.984184 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:39:48.984184 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:39:48.984184 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:39:48.984184 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:39:48.984184 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:39:48.984184 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 549/1101] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Sep 24 19:39:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:39:48.991112 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ce4e2-ed7c-40b2-9fb4-e89a94271010 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:48.992508 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:49.096915 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ce4e2-ed7c-40b2-9fb4-e89a94271010 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:49.135265 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac81d1-5529-402c-a858-a89db9936880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:49.135870 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac81d1-5529-402c-a858-a89db9936880 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:49.136152 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac81d1-5529-402c-a858-a89db9936880 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:49.136423 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac81d1-5529-402c-a858-a89db9936880 None admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:49.137096 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ac81d1-5529-402c-a858-a89db9936880 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:49.137399 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ac81d1-5529-402c-a858-a89db9936880 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:49.138868 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ac81d1-5529-402c-a858-a89db9936880 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:49.148215 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 553/1102] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Sep 24 19:39:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:49.154262 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b71bce7-74ff-484b-a849-7bf7a6467ca6 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:49.271404 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b71bce7-74ff-484b-a849-7bf7a6467ca6 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:49.309385 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116df79c-3596-4cf8-8852-dee38af09d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:49.310201 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116df79c-3596-4cf8-8852-dee38af09d0d None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:49.310484 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116df79c-3596-4cf8-8852-dee38af09d0d None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:49.310757 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116df79c-3596-4cf8-8852-dee38af09d0d None admin] PATH_INFO: `/v3/users/f822b0e90bbd4858a6092f9e1950d6a8` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:49.311893 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116df79c-3596-4cf8-8852-dee38af09d0d None admin] RBAC: Authorizing `identity:get_user(user_id=f822b0e90bbd4858a6092f9e1950d6a8)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:49.313763 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116df79c-3596-4cf8-8852-dee38af09d0d None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:49.315594 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 550/1103] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Sep 24 19:39:49 2022] GET /identity/v3/users/f822b0e90bbd4858a6092f9e1950d6a8 => generated 285 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:49.323518 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac81d1-5529-402c-a858-a89db9936880 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:49.392380 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:49.431820 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac81d1-5529-402c-a858-a89db9936880 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:49.466768 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9005736-d8fb-4b7d-9ba2-73476fa6521a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:49.468066 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9005736-d8fb-4b7d-9ba2-73476fa6521a None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:49.468066 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9005736-d8fb-4b7d-9ba2-73476fa6521a None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:49.468066 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9005736-d8fb-4b7d-9ba2-73476fa6521a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:49.542691 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9005736-d8fb-4b7d-9ba2-73476fa6521a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:49.544134 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9005736-d8fb-4b7d-9ba2-73476fa6521a None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:49.605626 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:49.645327 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 554/1104] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Sep 24 19:39:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 19:39:49.651412 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116df79c-3596-4cf8-8852-dee38af09d0d None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:49.671776 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:49.754188 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116df79c-3596-4cf8-8852-dee38af09d0d None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:49.787748 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e198bff-3ab5-4ce5-9b94-da4148d4abcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:49.788374 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e198bff-3ab5-4ce5-9b94-da4148d4abcf None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:49.788649 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e198bff-3ab5-4ce5-9b94-da4148d4abcf None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:49.788918 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e198bff-3ab5-4ce5-9b94-da4148d4abcf None admin] PATH_INFO: `/v3/projects/36372c4a9ca94b18a9caebcf473386fd` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:49.790063 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e198bff-3ab5-4ce5-9b94-da4148d4abcf None admin] RBAC: Authorizing `identity:get_project(project_id=36372c4a9ca94b18a9caebcf473386fd)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:49.791497 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e198bff-3ab5-4ce5-9b94-da4148d4abcf None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:49.793134 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 551/1105] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Sep 24 19:39:49 2022] GET /identity/v3/projects/36372c4a9ca94b18a9caebcf473386fd => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:49.799977 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9005736-d8fb-4b7d-9ba2-73476fa6521a None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:49.898736 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9005736-d8fb-4b7d-9ba2-73476fa6521a None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:49.932594 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d24334-a512-40fc-9fcb-2a43bf8c9104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:49.933191 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d24334-a512-40fc-9fcb-2a43bf8c9104 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:49.933465 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d24334-a512-40fc-9fcb-2a43bf8c9104 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:49.933763 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d24334-a512-40fc-9fcb-2a43bf8c9104 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:49.934485 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d24334-a512-40fc-9fcb-2a43bf8c9104 None admin] RBAC: Adding query filter params (role.id=f022705fa6ce43828345ef50b3f7efc9, scope.project.id=36372c4a9ca94b18a9caebcf473386fd, user.id=f822b0e90bbd4858a6092f9e1950d6a8) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:49.934788 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d24334-a512-40fc-9fcb-2a43bf8c9104 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:49.936197 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d24334-a512-40fc-9fcb-2a43bf8c9104 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:49.942473 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 555/1106] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Sep 24 19:39:49 2022] GET /identity/v3/role_assignments?user.id=f822b0e90bbd4858a6092f9e1950d6a8&scope.project.id=36372c4a9ca94b18a9caebcf473386fd&role.id=f022705fa6ce43828345ef50b3f7efc9 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:52.141242 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7332f447-874e-43d9-8b5a-3120527bee0e None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:52.141848 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7332f447-874e-43d9-8b5a-3120527bee0e None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:52.141848 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7332f447-874e-43d9-8b5a-3120527bee0e None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:52.143178 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 552/1107] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:39:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:39:52.148528 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5da3d-325b-4dcb-8421-6a7c305dc0ac None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:52.148968 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5da3d-325b-4dcb-8421-6a7c305dc0ac None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:52.149071 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5da3d-325b-4dcb-8421-6a7c305dc0ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:52.167432 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-e9c5da3d-325b-4dcb-8421-6a7c305dc0ac None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:39:52.168617 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-e9c5da3d-325b-4dcb-8421-6a7c305dc0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:39:52.191938 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:52.236532 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 556/1108] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:39:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:39:52.506479 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7332f447-874e-43d9-8b5a-3120527bee0e None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:52.591537 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:52.607349 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7332f447-874e-43d9-8b5a-3120527bee0e None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:52.641038 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada50527-0c10-4e97-821e-14fc013efbbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:52.641708 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada50527-0c10-4e97-821e-14fc013efbbf None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:52.641953 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada50527-0c10-4e97-821e-14fc013efbbf None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:52.642217 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada50527-0c10-4e97-821e-14fc013efbbf None admin] PATH_INFO: `/v3/domains/default` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:52.643303 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada50527-0c10-4e97-821e-14fc013efbbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:52.644717 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada50527-0c10-4e97-821e-14fc013efbbf None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:52.646279 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 553/1109] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:39:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:52.652038 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c5da3d-325b-4dcb-8421-6a7c305dc0ac None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:52.747861 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c5da3d-325b-4dcb-8421-6a7c305dc0ac None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:52.780829 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d2ffeb-ea2c-4fba-a80c-7fe1952c526f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:52.781530 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2ffeb-ea2c-4fba-a80c-7fe1952c526f None admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:52.781804 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2ffeb-ea2c-4fba-a80c-7fe1952c526f None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:52.782075 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2ffeb-ea2c-4fba-a80c-7fe1952c526f None admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:52.782713 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d2ffeb-ea2c-4fba-a80c-7fe1952c526f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:52.784118 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d2ffeb-ea2c-4fba-a80c-7fe1952c526f None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:52.871693 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 557/1110] 10.222.0.60 () {60 vars in 1132 bytes} [Sat Sep 24 19:39:52 2022] POST /identity/v3/users => generated 286 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:39:55.119444 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c1ccc-97c5-49bb-a5a0-928c1bc0ee83 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:55.119981 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c1ccc-97c5-49bb-a5a0-928c1bc0ee83 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:55.119981 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c1ccc-97c5-49bb-a5a0-928c1bc0ee83 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:55.121323 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 554/1111] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:39:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:39:55.127322 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8f3d0-4215-4af1-a556-aaa55a9b4592 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:55.128097 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8f3d0-4215-4af1-a556-aaa55a9b4592 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:55.128097 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8f3d0-4215-4af1-a556-aaa55a9b4592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:55.146588 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-7bc8f3d0-4215-4af1-a556-aaa55a9b4592 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:39:55.147773 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-7bc8f3d0-4215-4af1-a556-aaa55a9b4592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:39:55.158164 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:55.215384 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 558/1112] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:39:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:39:55.491898 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c1ccc-97c5-49bb-a5a0-928c1bc0ee83 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:55.598105 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c1ccc-97c5-49bb-a5a0-928c1bc0ee83 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:55.636237 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63fecd8-bd01-4a1e-b192-e31bb90a56dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:55.636863 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63fecd8-bd01-4a1e-b192-e31bb90a56dd None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:55.637140 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63fecd8-bd01-4a1e-b192-e31bb90a56dd None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:55.637409 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63fecd8-bd01-4a1e-b192-e31bb90a56dd None admin] PATH_INFO: `/v3/roles/dd695228990e4288afe29e3cefb75823` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:55.638827 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63fecd8-bd01-4a1e-b192-e31bb90a56dd None admin] RBAC: Authorizing `identity:get_role(role_id=dd695228990e4288afe29e3cefb75823)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:55.640238 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63fecd8-bd01-4a1e-b192-e31bb90a56dd None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:55.641576 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 555/1113] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Sep 24 19:39:55 2022] GET /identity/v3/roles/dd695228990e4288afe29e3cefb75823 => generated 223 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:55.647397 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8f3d0-4215-4af1-a556-aaa55a9b4592 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:55.746023 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8f3d0-4215-4af1-a556-aaa55a9b4592 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:55.781813 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92163444-701b-434e-bfb2-4f1303f05bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:55.782435 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92163444-701b-434e-bfb2-4f1303f05bcc None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:55.782712 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92163444-701b-434e-bfb2-4f1303f05bcc None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:55.782986 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92163444-701b-434e-bfb2-4f1303f05bcc None admin] PATH_INFO: `/v3/users/fa3aa1d474894aae8c113f59c034b28a` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:55.797773 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92163444-701b-434e-bfb2-4f1303f05bcc None admin] RBAC: Authorizing `identity:get_user(user_id=fa3aa1d474894aae8c113f59c034b28a)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:55.799204 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92163444-701b-434e-bfb2-4f1303f05bcc None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:55.800864 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 559/1114] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Sep 24 19:39:55 2022] GET /identity/v3/users/fa3aa1d474894aae8c113f59c034b28a => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:55.807012 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63fecd8-bd01-4a1e-b192-e31bb90a56dd None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:55.831899 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:55.906466 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63fecd8-bd01-4a1e-b192-e31bb90a56dd None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:55.940156 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc3a3a-aa75-4bf6-a57e-4152246372d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:55.940755 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc3a3a-aa75-4bf6-a57e-4152246372d4 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:55.941098 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc3a3a-aa75-4bf6-a57e-4152246372d4 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:55.941300 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc3a3a-aa75-4bf6-a57e-4152246372d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:56.006952 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fc3a3a-aa75-4bf6-a57e-4152246372d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:56.008337 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fc3a3a-aa75-4bf6-a57e-4152246372d4 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:56.030917 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:56.106995 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 556/1115] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Sep 24 19:39:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 19:39:56.113724 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92163444-701b-434e-bfb2-4f1303f05bcc None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:56.116578 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:56.223451 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92163444-701b-434e-bfb2-4f1303f05bcc None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:56.257407 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b507a1cc-ec0a-4b22-a2c2-c90d6669fcbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:56.257978 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507a1cc-ec0a-4b22-a2c2-c90d6669fcbe None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:56.258256 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507a1cc-ec0a-4b22-a2c2-c90d6669fcbe None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:56.258524 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507a1cc-ec0a-4b22-a2c2-c90d6669fcbe None admin] PATH_INFO: `/v3/projects/36372c4a9ca94b18a9caebcf473386fd` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:56.259628 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b507a1cc-ec0a-4b22-a2c2-c90d6669fcbe None admin] RBAC: Authorizing `identity:get_project(project_id=36372c4a9ca94b18a9caebcf473386fd)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:56.261032 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b507a1cc-ec0a-4b22-a2c2-c90d6669fcbe None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:56.262700 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 560/1116] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Sep 24 19:39:56 2022] GET /identity/v3/projects/36372c4a9ca94b18a9caebcf473386fd => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:56.269728 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc3a3a-aa75-4bf6-a57e-4152246372d4 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:56.366530 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc3a3a-aa75-4bf6-a57e-4152246372d4 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:56.388440 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:56.400756 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad1f3b-c34c-49d7-babb-bd51b7ac18b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:56.401356 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad1f3b-c34c-49d7-babb-bd51b7ac18b7 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:56.401673 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad1f3b-c34c-49d7-babb-bd51b7ac18b7 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:56.403488 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad1f3b-c34c-49d7-babb-bd51b7ac18b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:56.403488 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbad1f3b-c34c-49d7-babb-bd51b7ac18b7 None admin] RBAC: Adding query filter params (role.id=dd695228990e4288afe29e3cefb75823, scope.project.id=36372c4a9ca94b18a9caebcf473386fd, user.id=fa3aa1d474894aae8c113f59c034b28a) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:39:56.403488 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbad1f3b-c34c-49d7-babb-bd51b7ac18b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:56.404333 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbad1f3b-c34c-49d7-babb-bd51b7ac18b7 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:56.410563 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 557/1117] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Sep 24 19:39:56 2022] GET /identity/v3/role_assignments?user.id=fa3aa1d474894aae8c113f59c034b28a&scope.project.id=36372c4a9ca94b18a9caebcf473386fd&role.id=dd695228990e4288afe29e3cefb75823 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:58.612426 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af9596-9c67-4455-9cf1-81da7029f481 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:58.612969 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af9596-9c67-4455-9cf1-81da7029f481 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:58.612969 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af9596-9c67-4455-9cf1-81da7029f481 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:58.614332 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 561/1118] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:39:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:39:58.619566 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35574e2-ff61-4131-94d4-f09dbf70c085 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:58.619968 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35574e2-ff61-4131-94d4-f09dbf70c085 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:58.620119 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35574e2-ff61-4131-94d4-f09dbf70c085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:58.640806 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-d35574e2-ff61-4131-94d4-f09dbf70c085 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:39:58.642026 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-d35574e2-ff61-4131-94d4-f09dbf70c085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:39:58.711941 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 558/1119] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:39:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:39:58.990450 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af9596-9c67-4455-9cf1-81da7029f481 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:59.062294 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:59.095124 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af9596-9c67-4455-9cf1-81da7029f481 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:59.138926 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20fa87-b773-4084-9064-1760a6e30f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:59.139734 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20fa87-b773-4084-9064-1760a6e30f20 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:59.140649 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20fa87-b773-4084-9064-1760a6e30f20 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:59.140933 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20fa87-b773-4084-9064-1760a6e30f20 None admin] PATH_INFO: `/v3/roles/dd695228990e4288afe29e3cefb75823` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:59.142441 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a20fa87-b773-4084-9064-1760a6e30f20 None admin] RBAC: Authorizing `identity:get_role(role_id=dd695228990e4288afe29e3cefb75823)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:59.143862 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a20fa87-b773-4084-9064-1760a6e30f20 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:59.145575 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 562/1120] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Sep 24 19:39:58 2022] GET /identity/v3/roles/dd695228990e4288afe29e3cefb75823 => generated 223 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:59.151658 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35574e2-ff61-4131-94d4-f09dbf70c085 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:59.255450 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35574e2-ff61-4131-94d4-f09dbf70c085 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:59.271872 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:59.293839 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d9977d-d859-44ba-9fac-52e5916910ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:59.294467 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9977d-d859-44ba-9fac-52e5916910ab None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:59.294738 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9977d-d859-44ba-9fac-52e5916910ab None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:59.295000 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9977d-d859-44ba-9fac-52e5916910ab None admin] PATH_INFO: `/v3/users/fa3aa1d474894aae8c113f59c034b28a` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:59.296330 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d9977d-d859-44ba-9fac-52e5916910ab None admin] RBAC: Authorizing `identity:get_user(user_id=fa3aa1d474894aae8c113f59c034b28a)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:59.297784 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d9977d-d859-44ba-9fac-52e5916910ab None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:59.299363 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 559/1121] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Sep 24 19:39:59 2022] GET /identity/v3/users/fa3aa1d474894aae8c113f59c034b28a => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:59.305418 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20fa87-b773-4084-9064-1760a6e30f20 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:59.402649 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20fa87-b773-4084-9064-1760a6e30f20 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:59.435796 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aace7e1c-c096-44d3-ae10-5112dad82456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:59.436445 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace7e1c-c096-44d3-ae10-5112dad82456 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:59.436717 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace7e1c-c096-44d3-ae10-5112dad82456 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:59.436986 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace7e1c-c096-44d3-ae10-5112dad82456 None admin] PATH_INFO: `/v3/projects/36372c4a9ca94b18a9caebcf473386fd` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:59.438096 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aace7e1c-c096-44d3-ae10-5112dad82456 None admin] RBAC: Authorizing `identity:get_project(project_id=36372c4a9ca94b18a9caebcf473386fd)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:59.439494 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aace7e1c-c096-44d3-ae10-5112dad82456 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:59.441113 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 563/1122] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Sep 24 19:39:59 2022] GET /identity/v3/projects/36372c4a9ca94b18a9caebcf473386fd => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:39:59.447188 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d9977d-d859-44ba-9fac-52e5916910ab None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:59.550711 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d9977d-d859-44ba-9fac-52e5916910ab None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:59.587661 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c1b4a8-bb7e-4c27-98bf-92e093bf3137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:59.588321 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c1b4a8-bb7e-4c27-98bf-92e093bf3137 None admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:59.588601 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c1b4a8-bb7e-4c27-98bf-92e093bf3137 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:59.588869 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c1b4a8-bb7e-4c27-98bf-92e093bf3137 None admin] PATH_INFO: `/v3/projects/36372c4a9ca94b18a9caebcf473386fd/users/fa3aa1d474894aae8c113f59c034b28a/roles/dd695228990e4288afe29e3cefb75823` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:59.591041 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c1b4a8-bb7e-4c27-98bf-92e093bf3137 None admin] RBAC: Authorizing `identity:create_grant(project_id=36372c4a9ca94b18a9caebcf473386fd, user_id=fa3aa1d474894aae8c113f59c034b28a, role_id=dd695228990e4288afe29e3cefb75823)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:59.592467 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c1b4a8-bb7e-4c27-98bf-92e093bf3137 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:59.671650 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 560/1123] 10.222.0.60 () {58 vars in 1439 bytes} [Sat Sep 24 19:39:59 2022] PUT /identity/v3/projects/36372c4a9ca94b18a9caebcf473386fd/users/fa3aa1d474894aae8c113f59c034b28a/roles/dd695228990e4288afe29e3cefb75823 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:40:01.833928 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7fb4bb-9178-4f7b-9808-e47ad2518515 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:01.834501 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7fb4bb-9178-4f7b-9808-e47ad2518515 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:01.834501 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7fb4bb-9178-4f7b-9808-e47ad2518515 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:01.835826 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 564/1124] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:40:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:40:01.841796 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a5191-0739-49fc-bbe3-05e1f4a2e496 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:01.842297 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a5191-0739-49fc-bbe3-05e1f4a2e496 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:01.842401 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a5191-0739-49fc-bbe3-05e1f4a2e496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:01.861732 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-328a5191-0739-49fc-bbe3-05e1f4a2e496 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:40:01.862940 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-328a5191-0739-49fc-bbe3-05e1f4a2e496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:40:01.903889 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:40:01.931346 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 561/1125] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:40:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:40:02.213074 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7fb4bb-9178-4f7b-9808-e47ad2518515 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:02.222556 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:40:02.315535 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7fb4bb-9178-4f7b-9808-e47ad2518515 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:02.351827 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298245f-3ae5-4e5d-b92b-7122fbd16e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:02.355430 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298245f-3ae5-4e5d-b92b-7122fbd16e5c None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:02.355430 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298245f-3ae5-4e5d-b92b-7122fbd16e5c None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:02.355430 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298245f-3ae5-4e5d-b92b-7122fbd16e5c None admin] PATH_INFO: `/v3/roles/dd695228990e4288afe29e3cefb75823` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:02.355430 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298245f-3ae5-4e5d-b92b-7122fbd16e5c None admin] RBAC: Authorizing `identity:get_role(role_id=dd695228990e4288afe29e3cefb75823)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:40:02.355897 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298245f-3ae5-4e5d-b92b-7122fbd16e5c None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:40:02.357156 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 565/1126] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Sep 24 19:40:02 2022] GET /identity/v3/roles/dd695228990e4288afe29e3cefb75823 => generated 223 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:40:02.363164 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a5191-0739-49fc-bbe3-05e1f4a2e496 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:02.468561 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a5191-0739-49fc-bbe3-05e1f4a2e496 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:02.502743 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e97b92-5d84-4571-9b29-2e025253ad6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:02.503368 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e97b92-5d84-4571-9b29-2e025253ad6b None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:02.503636 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e97b92-5d84-4571-9b29-2e025253ad6b None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:02.503899 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e97b92-5d84-4571-9b29-2e025253ad6b None admin] PATH_INFO: `/v3/users/fa3aa1d474894aae8c113f59c034b28a` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:02.505013 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e97b92-5d84-4571-9b29-2e025253ad6b None admin] RBAC: Authorizing `identity:get_user(user_id=fa3aa1d474894aae8c113f59c034b28a)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:40:02.506458 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e97b92-5d84-4571-9b29-2e025253ad6b None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:40:02.508027 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 562/1127] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Sep 24 19:40:02 2022] GET /identity/v3/users/fa3aa1d474894aae8c113f59c034b28a => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:40:02.513910 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298245f-3ae5-4e5d-b92b-7122fbd16e5c None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:02.589559 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:40:02.613455 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298245f-3ae5-4e5d-b92b-7122fbd16e5c None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:02.646526 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e91c85d-6b93-4e51-b1a5-1d2e07b2a440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:02.647126 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e91c85d-6b93-4e51-b1a5-1d2e07b2a440 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:02.647402 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e91c85d-6b93-4e51-b1a5-1d2e07b2a440 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:02.647669 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e91c85d-6b93-4e51-b1a5-1d2e07b2a440 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:02.727130 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e91c85d-6b93-4e51-b1a5-1d2e07b2a440 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:40:02.729393 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e91c85d-6b93-4e51-b1a5-1d2e07b2a440 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:40:02.803296 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:40:02.828952 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 566/1128] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Sep 24 19:40:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 19:40:02.834917 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e97b92-5d84-4571-9b29-2e025253ad6b None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:02.877448 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:40:02.933566 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e97b92-5d84-4571-9b29-2e025253ad6b None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:02.968984 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122a566-7149-40f6-aea3-33b38cb93ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:02.969721 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122a566-7149-40f6-aea3-33b38cb93ae5 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:02.970004 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122a566-7149-40f6-aea3-33b38cb93ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:02.970276 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122a566-7149-40f6-aea3-33b38cb93ae5 None admin] PATH_INFO: `/v3/projects/36372c4a9ca94b18a9caebcf473386fd` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:02.971483 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2122a566-7149-40f6-aea3-33b38cb93ae5 None admin] RBAC: Authorizing `identity:get_project(project_id=36372c4a9ca94b18a9caebcf473386fd)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:40:02.972907 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2122a566-7149-40f6-aea3-33b38cb93ae5 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:40:02.974649 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 563/1129] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Sep 24 19:40:02 2022] GET /identity/v3/projects/36372c4a9ca94b18a9caebcf473386fd => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:40:02.981346 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e91c85d-6b93-4e51-b1a5-1d2e07b2a440 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:03.077155 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e91c85d-6b93-4e51-b1a5-1d2e07b2a440 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:03.109938 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a874f0cd-725b-44c3-bd07-2f08e20cf3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:03.110536 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874f0cd-725b-44c3-bd07-2f08e20cf3ad None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:03.110812 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874f0cd-725b-44c3-bd07-2f08e20cf3ad None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:03.111081 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874f0cd-725b-44c3-bd07-2f08e20cf3ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:03.111798 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a874f0cd-725b-44c3-bd07-2f08e20cf3ad None admin] RBAC: Adding query filter params (role.id=dd695228990e4288afe29e3cefb75823, scope.project.id=36372c4a9ca94b18a9caebcf473386fd, user.id=fa3aa1d474894aae8c113f59c034b28a) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:40:03.112111 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a874f0cd-725b-44c3-bd07-2f08e20cf3ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:40:03.113526 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a874f0cd-725b-44c3-bd07-2f08e20cf3ad None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:40:03.119248 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 567/1130] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Sep 24 19:40:02 2022] GET /identity/v3/role_assignments?user.id=fa3aa1d474894aae8c113f59c034b28a&scope.project.id=36372c4a9ca94b18a9caebcf473386fd&role.id=dd695228990e4288afe29e3cefb75823 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:40:05.291108 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9542d4-0265-4f67-a635-e66a7772c772 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:05.291690 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9542d4-0265-4f67-a635-e66a7772c772 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:05.291690 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9542d4-0265-4f67-a635-e66a7772c772 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:05.292965 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 564/1131] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:40:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:40:05.299033 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af44bd-81c0-4716-835b-c19deaec8dad None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:05.299422 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af44bd-81c0-4716-835b-c19deaec8dad None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:05.299582 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af44bd-81c0-4716-835b-c19deaec8dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:05.317960 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-48af44bd-81c0-4716-835b-c19deaec8dad None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:40:05.319119 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-48af44bd-81c0-4716-835b-c19deaec8dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:40:05.347279 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:40:05.383286 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 568/1132] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:40:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:40:05.654068 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9542d4-0265-4f67-a635-e66a7772c772 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:05.754745 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9542d4-0265-4f67-a635-e66a7772c772 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:05.765768 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:40:05.787691 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad3428e-8ea1-4c03-a1fa-09ec7d7a0407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:05.788300 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3428e-8ea1-4c03-a1fa-09ec7d7a0407 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:05.788572 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3428e-8ea1-4c03-a1fa-09ec7d7a0407 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:05.788834 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3428e-8ea1-4c03-a1fa-09ec7d7a0407 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:05.789941 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad3428e-8ea1-4c03-a1fa-09ec7d7a0407 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:40:05.791366 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad3428e-8ea1-4c03-a1fa-09ec7d7a0407 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:40:05.792901 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 565/1133] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:40:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:40:05.799183 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48af44bd-81c0-4716-835b-c19deaec8dad None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:05.898255 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48af44bd-81c0-4716-835b-c19deaec8dad None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:05.930965 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3cf5c2-2a30-4c36-8080-40a8bff3094c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:05.931496 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3cf5c2-2a30-4c36-8080-40a8bff3094c None admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:05.931775 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3cf5c2-2a30-4c36-8080-40a8bff3094c None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:05.932047 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3cf5c2-2a30-4c36-8080-40a8bff3094c None admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:05.932689 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3cf5c2-2a30-4c36-8080-40a8bff3094c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:40:05.934125 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3cf5c2-2a30-4c36-8080-40a8bff3094c None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:40:06.016471 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 569/1134] 10.222.0.60 () {60 vars in 1141 bytes} [Sat Sep 24 19:40:05 2022] POST /identity/v3/projects => generated 311 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:40:08.202990 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414191b-cc03-4c91-9050-0f1f555a0347 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:08.203820 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414191b-cc03-4c91-9050-0f1f555a0347 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:08.203985 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414191b-cc03-4c91-9050-0f1f555a0347 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:08.205332 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 566/1135] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:40:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:40:08.210875 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878b377-f0f0-4062-bbed-1271ff683565 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:08.211390 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878b377-f0f0-4062-bbed-1271ff683565 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:08.211520 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878b377-f0f0-4062-bbed-1271ff683565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:08.229351 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-a878b377-f0f0-4062-bbed-1271ff683565 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:40:08.230558 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-a878b377-f0f0-4062-bbed-1271ff683565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:40:08.244136 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:40:08.294578 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 570/1136] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:40:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 19:40:08.569196 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3414191b-cc03-4c91-9050-0f1f555a0347 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:08.671821 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3414191b-cc03-4c91-9050-0f1f555a0347 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:08.705233 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78c63f-a381-4947-a2c7-d747eeaa4996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:08.705884 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78c63f-a381-4947-a2c7-d747eeaa4996 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:08.706159 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78c63f-a381-4947-a2c7-d747eeaa4996 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:08.706424 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78c63f-a381-4947-a2c7-d747eeaa4996 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:08.707511 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc78c63f-a381-4947-a2c7-d747eeaa4996 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:40:08.708918 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc78c63f-a381-4947-a2c7-d747eeaa4996 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:40:08.710486 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 567/1137] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:40:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:40:08.716249 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a878b377-f0f0-4062-bbed-1271ff683565 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:08.818728 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a878b377-f0f0-4062-bbed-1271ff683565 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:08.855033 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a1f96-0edf-4dbf-9206-139e8571d599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:08.855560 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a1f96-0edf-4dbf-9206-139e8571d599 None admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:08.855836 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a1f96-0edf-4dbf-9206-139e8571d599 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:08.856105 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a1f96-0edf-4dbf-9206-139e8571d599 None admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:08.856741 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93a1f96-0edf-4dbf-9206-139e8571d599 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:40:08.858834 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93a1f96-0edf-4dbf-9206-139e8571d599 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:40:08.932465 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 571/1138] 10.222.0.60 () {60 vars in 1132 bytes} [Sat Sep 24 19:40:08 2022] POST /identity/v3/users => generated 286 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:40:11.150693 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862c928-214b-4113-a97c-0904f5d51b96 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:11.151249 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862c928-214b-4113-a97c-0904f5d51b96 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:11.151249 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862c928-214b-4113-a97c-0904f5d51b96 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:11.152563 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 568/1139] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:40:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:40:11.158068 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe9e18-1d8e-439c-94cc-29c9e13bb591 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:11.158472 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe9e18-1d8e-439c-94cc-29c9e13bb591 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:11.158616 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe9e18-1d8e-439c-94cc-29c9e13bb591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:11.171361 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:40:11.176589 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-5bfe9e18-1d8e-439c-94cc-29c9e13bb591 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:40:11.177791 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-5bfe9e18-1d8e-439c-94cc-29c9e13bb591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:40:11.242710 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 572/1140] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:40:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:40:11.512363 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862c928-214b-4113-a97c-0904f5d51b96 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:11.559758 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:40:11.612342 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862c928-214b-4113-a97c-0904f5d51b96 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:11.645845 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8175cf4-13a5-4ef0-bd28-c95786d5263f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:11.646460 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8175cf4-13a5-4ef0-bd28-c95786d5263f None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:11.646736 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8175cf4-13a5-4ef0-bd28-c95786d5263f None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:11.647001 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8175cf4-13a5-4ef0-bd28-c95786d5263f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:11.657542 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8175cf4-13a5-4ef0-bd28-c95786d5263f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:40:11.662356 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-d8175cf4-13a5-4ef0-bd28-c95786d5263f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:40:11.662356 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:40:11.662356 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:40:11.662356 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:40:11.662356 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:40:11.662356 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:40:11.662356 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:40:11.662356 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:40:11.662356 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:40:11.662356 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:40:11.662356 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:40:11.662356 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:40:11.662356 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:40:11.662356 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:40:11.662356 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:40:11.662356 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:40:11.663537 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:40:11.663537 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:40:11.663537 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:40:11.663537 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:40:11.663537 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:40:11.663537 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:40:11.663537 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:40:11.663537 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:40:11.663537 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:40:11.663537 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:40:11.663537 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:40:11.663537 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:40:11.663537 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:40:11.663537 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:40:11.663537 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:40:11.663537 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:40:11.664605 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:40:11.664605 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:40:11.664605 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:40:11.664605 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:40:11.664605 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:40:11.664605 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:40:11.664605 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:40:11.664605 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:40:11.664605 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:40:11.664605 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:40:11.664605 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:40:11.664605 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:40:11.664605 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 569/1141] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Sep 24 19:40:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:40:11.669421 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe9e18-1d8e-439c-94cc-29c9e13bb591 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:11.767485 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe9e18-1d8e-439c-94cc-29c9e13bb591 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:11.800417 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6920c56-59f3-4e4b-bacc-b26665d9a17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:11.801012 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6920c56-59f3-4e4b-bacc-b26665d9a17b None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:11.801287 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6920c56-59f3-4e4b-bacc-b26665d9a17b None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:11.801580 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6920c56-59f3-4e4b-bacc-b26665d9a17b None admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:11.802232 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6920c56-59f3-4e4b-bacc-b26665d9a17b None admin] RBAC: Adding query filter params (name=admin) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:40:11.802529 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6920c56-59f3-4e4b-bacc-b26665d9a17b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:40:11.803861 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6920c56-59f3-4e4b-bacc-b26665d9a17b None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:40:11.805962 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:40:11.812112 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 573/1142] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Sep 24 19:40:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:40:11.818259 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8175cf4-13a5-4ef0-bd28-c95786d5263f None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:11.926717 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8175cf4-13a5-4ef0-bd28-c95786d5263f None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:11.934498 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:40:11.962614 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadbd0b0-7802-4788-a106-e8038b21300b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:11.963325 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadbd0b0-7802-4788-a106-e8038b21300b None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:11.963606 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadbd0b0-7802-4788-a106-e8038b21300b None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:11.963879 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadbd0b0-7802-4788-a106-e8038b21300b None admin] PATH_INFO: `/v3/users/cd162ee1602c40d988975afeeeb296f3` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:11.977002 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadbd0b0-7802-4788-a106-e8038b21300b None admin] RBAC: Authorizing `identity:get_user(user_id=cd162ee1602c40d988975afeeeb296f3)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:40:11.978465 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadbd0b0-7802-4788-a106-e8038b21300b None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:40:11.980060 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 570/1143] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Sep 24 19:40:11 2022] GET /identity/v3/users/cd162ee1602c40d988975afeeeb296f3 => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:40:11.986353 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6920c56-59f3-4e4b-bacc-b26665d9a17b None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:12.082224 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6920c56-59f3-4e4b-bacc-b26665d9a17b None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:12.114436 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce264e3-076c-443c-8f5c-8bdd7e7d73e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:12.115023 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce264e3-076c-443c-8f5c-8bdd7e7d73e6 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:12.115302 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce264e3-076c-443c-8f5c-8bdd7e7d73e6 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:12.115571 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce264e3-076c-443c-8f5c-8bdd7e7d73e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:12.176573 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:40:12.179570 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce264e3-076c-443c-8f5c-8bdd7e7d73e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:40:12.180988 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce264e3-076c-443c-8f5c-8bdd7e7d73e6 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:40:12.287137 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 574/1144] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Sep 24 19:40:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 19:40:12.293082 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadbd0b0-7802-4788-a106-e8038b21300b None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:12.390005 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadbd0b0-7802-4788-a106-e8038b21300b None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:12.423265 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39cfb8-d08a-4fe0-a679-9ffe8e463811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:12.423883 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39cfb8-d08a-4fe0-a679-9ffe8e463811 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:12.424158 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39cfb8-d08a-4fe0-a679-9ffe8e463811 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:12.424427 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39cfb8-d08a-4fe0-a679-9ffe8e463811 None admin] PATH_INFO: `/v3/projects/f56e917154f1438f973d0da73c1cfc41` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:12.425777 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e39cfb8-d08a-4fe0-a679-9ffe8e463811 None admin] RBAC: Authorizing `identity:get_project(project_id=f56e917154f1438f973d0da73c1cfc41)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:40:12.427466 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e39cfb8-d08a-4fe0-a679-9ffe8e463811 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:40:12.429367 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 571/1145] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Sep 24 19:40:12 2022] GET /identity/v3/projects/f56e917154f1438f973d0da73c1cfc41 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:40:12.435385 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce264e3-076c-443c-8f5c-8bdd7e7d73e6 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:12.527968 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:40:12.533329 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce264e3-076c-443c-8f5c-8bdd7e7d73e6 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:12.566295 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3862fd31-e915-4c5d-9f66-d44fb4a568da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:12.566885 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862fd31-e915-4c5d-9f66-d44fb4a568da None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:12.567164 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862fd31-e915-4c5d-9f66-d44fb4a568da None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:12.567430 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862fd31-e915-4c5d-9f66-d44fb4a568da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:12.568138 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3862fd31-e915-4c5d-9f66-d44fb4a568da None admin] RBAC: Adding query filter params (role.id=f022705fa6ce43828345ef50b3f7efc9, scope.project.id=f56e917154f1438f973d0da73c1cfc41, user.id=cd162ee1602c40d988975afeeeb296f3) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:40:12.568442 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3862fd31-e915-4c5d-9f66-d44fb4a568da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:40:12.569857 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3862fd31-e915-4c5d-9f66-d44fb4a568da None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:40:12.575270 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 575/1146] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Sep 24 19:40:12 2022] GET /identity/v3/role_assignments?user.id=cd162ee1602c40d988975afeeeb296f3&scope.project.id=f56e917154f1438f973d0da73c1cfc41&role.id=f022705fa6ce43828345ef50b3f7efc9 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:40:14.728103 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a462b8-5f73-405d-adbc-dd11c98053c4 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:14.728655 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a462b8-5f73-405d-adbc-dd11c98053c4 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:14.728655 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a462b8-5f73-405d-adbc-dd11c98053c4 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:14.730005 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 572/1147] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:40:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:40:14.735767 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230885fe-7bbe-4bce-a52e-191dc322a6c7 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:14.736196 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230885fe-7bbe-4bce-a52e-191dc322a6c7 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:14.736323 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230885fe-7bbe-4bce-a52e-191dc322a6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:14.755479 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-230885fe-7bbe-4bce-a52e-191dc322a6c7 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:40:14.756692 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-230885fe-7bbe-4bce-a52e-191dc322a6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:40:14.836977 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 576/1148] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:40:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:40:15.104989 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a462b8-5f73-405d-adbc-dd11c98053c4 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:15.136190 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:40:15.204400 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a462b8-5f73-405d-adbc-dd11c98053c4 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:15.237780 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff356d7b-c705-4efb-8967-0490f0c34e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:15.238392 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff356d7b-c705-4efb-8967-0490f0c34e19 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:15.238665 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff356d7b-c705-4efb-8967-0490f0c34e19 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:15.238931 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff356d7b-c705-4efb-8967-0490f0c34e19 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:15.248691 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff356d7b-c705-4efb-8967-0490f0c34e19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:40:15.253712 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-ff356d7b-c705-4efb-8967-0490f0c34e19 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:40:15.253712 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:40:15.253712 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:40:15.253712 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:40:15.253712 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:40:15.253712 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:40:15.253712 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:40:15.253712 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:40:15.253712 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:40:15.253712 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:40:15.253712 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:40:15.253712 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:40:15.253712 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:40:15.253712 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:40:15.253712 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:40:15.253712 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:40:15.254830 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:40:15.254830 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:40:15.254830 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:40:15.254830 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:40:15.254830 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:40:15.254830 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:40:15.254830 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:40:15.254830 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:40:15.254830 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:40:15.254830 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:40:15.254830 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:40:15.254830 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:40:15.254830 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:40:15.254830 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:40:15.254830 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:40:15.254830 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:40:15.255854 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:40:15.255854 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:40:15.255854 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:40:15.255854 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:40:15.255854 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:40:15.255854 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:40:15.255854 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:40:15.255854 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:40:15.255854 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:40:15.255854 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:40:15.255854 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:40:15.255854 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:40:15.255854 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 573/1149] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Sep 24 19:40:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:40:15.260915 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230885fe-7bbe-4bce-a52e-191dc322a6c7 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:15.347817 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:40:15.361038 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230885fe-7bbe-4bce-a52e-191dc322a6c7 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:15.389975 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7770581f-75dc-40d8-bead-0ab26efebe69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:15.390572 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770581f-75dc-40d8-bead-0ab26efebe69 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:15.390850 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770581f-75dc-40d8-bead-0ab26efebe69 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:15.391122 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770581f-75dc-40d8-bead-0ab26efebe69 None admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:15.391778 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7770581f-75dc-40d8-bead-0ab26efebe69 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:40:15.392079 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7770581f-75dc-40d8-bead-0ab26efebe69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:40:15.393423 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7770581f-75dc-40d8-bead-0ab26efebe69 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:40:15.401137 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 577/1150] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Sep 24 19:40:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:40:15.407566 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff356d7b-c705-4efb-8967-0490f0c34e19 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:15.495847 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:40:15.504616 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff356d7b-c705-4efb-8967-0490f0c34e19 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:15.538260 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60990ef-245b-4193-82d8-90cb76665153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:15.538867 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60990ef-245b-4193-82d8-90cb76665153 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:15.539143 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60990ef-245b-4193-82d8-90cb76665153 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:15.539409 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60990ef-245b-4193-82d8-90cb76665153 None admin] PATH_INFO: `/v3/users/cd162ee1602c40d988975afeeeb296f3` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:15.540514 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60990ef-245b-4193-82d8-90cb76665153 None admin] RBAC: Authorizing `identity:get_user(user_id=cd162ee1602c40d988975afeeeb296f3)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:40:15.541961 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60990ef-245b-4193-82d8-90cb76665153 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:40:15.543635 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 574/1151] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Sep 24 19:40:15 2022] GET /identity/v3/users/cd162ee1602c40d988975afeeeb296f3 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:40:15.549515 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7770581f-75dc-40d8-bead-0ab26efebe69 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:15.646948 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7770581f-75dc-40d8-bead-0ab26efebe69 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:15.681098 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd51e8-2abe-487f-b2ab-0b86ddb8243c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:15.681752 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd51e8-2abe-487f-b2ab-0b86ddb8243c None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:15.682030 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd51e8-2abe-487f-b2ab-0b86ddb8243c None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:15.682301 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd51e8-2abe-487f-b2ab-0b86ddb8243c None admin] PATH_INFO: `/v3/projects/f56e917154f1438f973d0da73c1cfc41` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:15.683387 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cd51e8-2abe-487f-b2ab-0b86ddb8243c None admin] RBAC: Authorizing `identity:get_project(project_id=f56e917154f1438f973d0da73c1cfc41)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:40:15.684785 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cd51e8-2abe-487f-b2ab-0b86ddb8243c None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:40:15.686446 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 578/1152] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Sep 24 19:40:15 2022] GET /identity/v3/projects/f56e917154f1438f973d0da73c1cfc41 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:40:15.692334 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60990ef-245b-4193-82d8-90cb76665153 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:15.796436 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60990ef-245b-4193-82d8-90cb76665153 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:15.832019 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a263928-41ed-4c05-b65f-1c77bdc5288e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:15.832669 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a263928-41ed-4c05-b65f-1c77bdc5288e None admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:15.832944 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a263928-41ed-4c05-b65f-1c77bdc5288e None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:15.833212 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a263928-41ed-4c05-b65f-1c77bdc5288e None admin] PATH_INFO: `/v3/projects/f56e917154f1438f973d0da73c1cfc41/users/cd162ee1602c40d988975afeeeb296f3/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:15.835172 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a263928-41ed-4c05-b65f-1c77bdc5288e None admin] RBAC: Authorizing `identity:create_grant(project_id=f56e917154f1438f973d0da73c1cfc41, user_id=cd162ee1602c40d988975afeeeb296f3, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:40:15.836606 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a263928-41ed-4c05-b65f-1c77bdc5288e None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:40:15.899036 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 575/1153] 10.222.0.60 () {58 vars in 1439 bytes} [Sat Sep 24 19:40:15 2022] PUT /identity/v3/projects/f56e917154f1438f973d0da73c1cfc41/users/cd162ee1602c40d988975afeeeb296f3/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:40:18.080657 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0516b25-e38f-4dd9-b8eb-e7a74c871c1b None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:18.081208 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0516b25-e38f-4dd9-b8eb-e7a74c871c1b None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:18.081208 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0516b25-e38f-4dd9-b8eb-e7a74c871c1b None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:18.082624 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 579/1154] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:40:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:40:18.088030 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd1746-4a10-4635-bee9-a0e2480d472e None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:18.088412 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd1746-4a10-4635-bee9-a0e2480d472e None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:18.088566 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd1746-4a10-4635-bee9-a0e2480d472e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:18.107228 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-77bd1746-4a10-4635-bee9-a0e2480d472e None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:40:18.108541 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-77bd1746-4a10-4635-bee9-a0e2480d472e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:40:18.122272 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:40:18.174904 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 576/1155] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:40:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:40:18.449564 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0516b25-e38f-4dd9-b8eb-e7a74c871c1b None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:18.474833 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:40:18.549299 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0516b25-e38f-4dd9-b8eb-e7a74c871c1b None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:18.581627 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026d8ba0-780c-4968-ba52-04081b59a36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:18.582231 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d8ba0-780c-4968-ba52-04081b59a36f None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:18.582509 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d8ba0-780c-4968-ba52-04081b59a36f None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:18.582781 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d8ba0-780c-4968-ba52-04081b59a36f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:18.592966 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026d8ba0-780c-4968-ba52-04081b59a36f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:40:18.597800 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-026d8ba0-780c-4968-ba52-04081b59a36f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:40:18.597800 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:40:18.597800 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:40:18.597800 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:40:18.597800 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:40:18.597800 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:40:18.597800 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:40:18.597800 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:40:18.597800 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:40:18.597800 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:40:18.597800 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:40:18.597800 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:40:18.597800 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:40:18.597800 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:40:18.597800 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:40:18.597800 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:40:18.598914 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:40:18.598914 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:40:18.598914 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:40:18.598914 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:40:18.598914 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:40:18.598914 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:40:18.598914 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:40:18.598914 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:40:18.598914 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:40:18.598914 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:40:18.598914 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:40:18.598914 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:40:18.598914 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:40:18.598914 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:40:18.598914 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:40:18.598914 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:40:18.600005 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:40:18.600005 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:40:18.600005 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:40:18.600005 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:40:18.600005 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:40:18.600005 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:40:18.600005 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:40:18.600005 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:40:18.600005 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:40:18.600005 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:40:18.600005 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:40:18.600005 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:40:18.600005 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 580/1156] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Sep 24 19:40:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:40:18.604997 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd1746-4a10-4635-bee9-a0e2480d472e None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:18.719353 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd1746-4a10-4635-bee9-a0e2480d472e None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:18.752885 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0100a-492f-4317-a2e5-4a982184eec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:18.753484 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0100a-492f-4317-a2e5-4a982184eec6 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:18.753818 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0100a-492f-4317-a2e5-4a982184eec6 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:18.754090 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0100a-492f-4317-a2e5-4a982184eec6 None admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:18.754747 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa0100a-492f-4317-a2e5-4a982184eec6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:40:18.755051 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa0100a-492f-4317-a2e5-4a982184eec6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:40:18.756411 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa0100a-492f-4317-a2e5-4a982184eec6 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:40:18.765312 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 577/1157] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Sep 24 19:40:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:40:18.771457 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026d8ba0-780c-4968-ba52-04081b59a36f None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:18.850882 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:40:18.867743 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026d8ba0-780c-4968-ba52-04081b59a36f None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:18.902724 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad39f9-784a-483f-beb1-0ab34d46ff16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:18.903342 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad39f9-784a-483f-beb1-0ab34d46ff16 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:18.903619 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad39f9-784a-483f-beb1-0ab34d46ff16 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:18.903891 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad39f9-784a-483f-beb1-0ab34d46ff16 None admin] PATH_INFO: `/v3/users/cd162ee1602c40d988975afeeeb296f3` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:18.905016 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ad39f9-784a-483f-beb1-0ab34d46ff16 None admin] RBAC: Authorizing `identity:get_user(user_id=cd162ee1602c40d988975afeeeb296f3)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:40:18.906460 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ad39f9-784a-483f-beb1-0ab34d46ff16 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:40:18.908012 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 581/1158] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Sep 24 19:40:18 2022] GET /identity/v3/users/cd162ee1602c40d988975afeeeb296f3 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:40:18.913938 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0100a-492f-4317-a2e5-4a982184eec6 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:18.928854 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:40:19.011027 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0100a-492f-4317-a2e5-4a982184eec6 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:19.043742 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d91b9-6c19-4c88-bf14-f9b7ea142d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:19.044330 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d91b9-6c19-4c88-bf14-f9b7ea142d8a None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:19.044673 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d91b9-6c19-4c88-bf14-f9b7ea142d8a None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:19.044948 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d91b9-6c19-4c88-bf14-f9b7ea142d8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:19.109132 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0d91b9-6c19-4c88-bf14-f9b7ea142d8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:40:19.110587 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0d91b9-6c19-4c88-bf14-f9b7ea142d8a None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:40:19.123226 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:40:19.204308 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 578/1159] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Sep 24 19:40:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 19:40:19.210264 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad39f9-784a-483f-beb1-0ab34d46ff16 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:19.305946 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad39f9-784a-483f-beb1-0ab34d46ff16 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:19.338519 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a19548-bbcf-4762-b147-09f44448b420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:19.339127 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a19548-bbcf-4762-b147-09f44448b420 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:19.339405 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a19548-bbcf-4762-b147-09f44448b420 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:19.339676 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a19548-bbcf-4762-b147-09f44448b420 None admin] PATH_INFO: `/v3/projects/f56e917154f1438f973d0da73c1cfc41` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:19.340776 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a19548-bbcf-4762-b147-09f44448b420 None admin] RBAC: Authorizing `identity:get_project(project_id=f56e917154f1438f973d0da73c1cfc41)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:40:19.342881 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a19548-bbcf-4762-b147-09f44448b420 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:40:19.344477 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 582/1160] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Sep 24 19:40:19 2022] GET /identity/v3/projects/f56e917154f1438f973d0da73c1cfc41 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:40:19.350490 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d91b9-6c19-4c88-bf14-f9b7ea142d8a None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:19.445370 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d91b9-6c19-4c88-bf14-f9b7ea142d8a None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:19.458003 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:40:19.478406 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bab73d-e894-4125-b856-0b02af90f81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:19.478996 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bab73d-e894-4125-b856-0b02af90f81a None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:19.479273 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bab73d-e894-4125-b856-0b02af90f81a None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:19.479543 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bab73d-e894-4125-b856-0b02af90f81a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:19.480249 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bab73d-e894-4125-b856-0b02af90f81a None admin] RBAC: Adding query filter params (role.id=f022705fa6ce43828345ef50b3f7efc9, scope.project.id=f56e917154f1438f973d0da73c1cfc41, user.id=cd162ee1602c40d988975afeeeb296f3) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:40:19.480559 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bab73d-e894-4125-b856-0b02af90f81a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:40:19.482025 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bab73d-e894-4125-b856-0b02af90f81a None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:40:19.487648 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 579/1161] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Sep 24 19:40:19 2022] GET /identity/v3/role_assignments?user.id=cd162ee1602c40d988975afeeeb296f3&scope.project.id=f56e917154f1438f973d0da73c1cfc41&role.id=f022705fa6ce43828345ef50b3f7efc9 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:40:21.664008 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4959e93-e10b-4b23-b2a2-c663d1e3b7b6 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:21.664639 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4959e93-e10b-4b23-b2a2-c663d1e3b7b6 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:21.664639 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4959e93-e10b-4b23-b2a2-c663d1e3b7b6 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:21.665917 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 583/1162] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:40:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:40:21.671681 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65396627-dd91-40a1-9793-a11e120faddc None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:21.672078 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65396627-dd91-40a1-9793-a11e120faddc None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:21.672228 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65396627-dd91-40a1-9793-a11e120faddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:21.690793 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-65396627-dd91-40a1-9793-a11e120faddc None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:40:21.691973 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-65396627-dd91-40a1-9793-a11e120faddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:40:21.756665 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 580/1163] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:40:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:40:22.030433 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4959e93-e10b-4b23-b2a2-c663d1e3b7b6 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:22.049605 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:40:22.129863 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4959e93-e10b-4b23-b2a2-c663d1e3b7b6 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:22.162214 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef43c6f-8200-4885-8ee2-04b84e161846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:22.162811 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef43c6f-8200-4885-8ee2-04b84e161846 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:22.163090 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef43c6f-8200-4885-8ee2-04b84e161846 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:22.163363 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef43c6f-8200-4885-8ee2-04b84e161846 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:22.228104 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef43c6f-8200-4885-8ee2-04b84e161846 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:40:22.229536 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef43c6f-8200-4885-8ee2-04b84e161846 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:40:22.245896 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:40:22.323450 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 584/1164] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Sep 24 19:40:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 19:40:22.330490 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65396627-dd91-40a1-9793-a11e120faddc None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:22.427133 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65396627-dd91-40a1-9793-a11e120faddc None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:22.434139 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:40:22.459834 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07cd70-3c28-4e97-b7ff-c73f50fe3199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:22.460448 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07cd70-3c28-4e97-b7ff-c73f50fe3199 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:22.460722 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07cd70-3c28-4e97-b7ff-c73f50fe3199 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:22.460989 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07cd70-3c28-4e97-b7ff-c73f50fe3199 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:22.467783 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d07cd70-3c28-4e97-b7ff-c73f50fe3199 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:40:22.469205 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d07cd70-3c28-4e97-b7ff-c73f50fe3199 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:40:22.480790 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-4d07cd70-3c28-4e97-b7ff-c73f50fe3199 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 24 19:40:22.480790 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:40:22.480790 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 24 19:40:22.480790 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 24 19:40:22.480790 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:40:22.480790 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:40:22.480790 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:40:22.480790 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:40:22.480790 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 24 19:40:22.480790 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:40:22.480790 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:40:22.480790 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:40:22.480790 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:40:22.480790 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:40:22.480790 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:40:22.480790 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:40:22.480790 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:40:22.482639 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:40:22.482639 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:40:22.482639 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:40:22.482639 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:40:22.482639 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:40:22.482639 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:40:22.482639 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:40:22.482639 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:40:22.482639 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:40:22.482639 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:40:22.482639 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:40:22.482639 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:40:22.482639 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:40:22.482639 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:40:22.482639 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:40:22.482639 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:40:22.483620 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:40:22.483620 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:40:22.483620 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:40:22.483620 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:40:22.483620 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:40:22.483620 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:40:22.483620 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:40:22.483620 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:40:22.483620 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:40:22.483620 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:40:22.483620 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 24 19:40:22.483620 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:40:22.483620 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 24 19:40:22.483620 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:40:22.483620 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 581/1165] 10.222.0.60 () {56 vars in 1117 bytes} [Sat Sep 24 19:40:22 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:40:22.488440 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef43c6f-8200-4885-8ee2-04b84e161846 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:22.584836 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef43c6f-8200-4885-8ee2-04b84e161846 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:22.602040 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:40:22.618818 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f96ea0-5878-43d7-9d93-8dfab0f8e678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:22.619417 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f96ea0-5878-43d7-9d93-8dfab0f8e678 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:22.619696 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f96ea0-5878-43d7-9d93-8dfab0f8e678 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:22.619969 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f96ea0-5878-43d7-9d93-8dfab0f8e678 None admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:22.620609 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f96ea0-5878-43d7-9d93-8dfab0f8e678 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:40:22.620910 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f96ea0-5878-43d7-9d93-8dfab0f8e678 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:40:22.622276 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f96ea0-5878-43d7-9d93-8dfab0f8e678 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:40:22.629782 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 585/1166] 10.222.0.60 () {56 vars in 1115 bytes} [Sat Sep 24 19:40:22 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:40:24.822221 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540c5a8-ca82-440d-b1bf-6fac969f62b8 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:24.822770 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540c5a8-ca82-440d-b1bf-6fac969f62b8 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:24.822770 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540c5a8-ca82-440d-b1bf-6fac969f62b8 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:24.824074 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 582/1167] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:40:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:40:24.829307 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb95ccd-5e8b-4938-81a2-f7fa7441944e None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:24.829733 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb95ccd-5e8b-4938-81a2-f7fa7441944e None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:24.829897 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb95ccd-5e8b-4938-81a2-f7fa7441944e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:24.848486 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-1cb95ccd-5e8b-4938-81a2-f7fa7441944e None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:40:24.849709 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-1cb95ccd-5e8b-4938-81a2-f7fa7441944e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:40:24.915511 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 586/1168] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:40:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:40:25.190991 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6540c5a8-ca82-440d-b1bf-6fac969f62b8 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:25.290390 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6540c5a8-ca82-440d-b1bf-6fac969f62b8 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:25.322249 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982701f-8ce5-4851-a5a1-94123cdd7c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:25.322831 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982701f-8ce5-4851-a5a1-94123cdd7c0d None admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:25.323105 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982701f-8ce5-4851-a5a1-94123cdd7c0d None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:25.323372 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982701f-8ce5-4851-a5a1-94123cdd7c0d None admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:25.324019 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4982701f-8ce5-4851-a5a1-94123cdd7c0d None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:40:25.326050 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4982701f-8ce5-4851-a5a1-94123cdd7c0d None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:40:25.384529 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 583/1169] 10.222.0.60 () {60 vars in 1138 bytes} [Sat Sep 24 19:40:25 2022] POST /identity/v3/domains => generated 267 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:40:27.585644 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad652d-2c10-4bde-b4d1-924cfde06dda None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:27.586179 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad652d-2c10-4bde-b4d1-924cfde06dda None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:27.586179 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad652d-2c10-4bde-b4d1-924cfde06dda None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:27.587527 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 587/1170] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:40:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:40:27.593469 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b4ce4d-1e82-448d-84b3-fbda85c55348 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:27.593928 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b4ce4d-1e82-448d-84b3-fbda85c55348 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:27.594058 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b4ce4d-1e82-448d-84b3-fbda85c55348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:27.613870 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-a6b4ce4d-1e82-448d-84b3-fbda85c55348 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:40:27.615066 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-a6b4ce4d-1e82-448d-84b3-fbda85c55348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:40:27.635191 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:40:27.682114 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 584/1171] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:40:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:40:27.959580 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad652d-2c10-4bde-b4d1-924cfde06dda None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:28.060995 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad652d-2c10-4bde-b4d1-924cfde06dda None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:28.073704 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:40:28.095484 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacfb876-5e21-4711-8d62-e7c73132c985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:28.096127 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacfb876-5e21-4711-8d62-e7c73132c985 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:28.096410 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacfb876-5e21-4711-8d62-e7c73132c985 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:28.096732 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacfb876-5e21-4711-8d62-e7c73132c985 None admin] PATH_INFO: `/v3/domains/f8bdebe34bbf43d9a5b50d79685bd308` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:28.108438 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacfb876-5e21-4711-8d62-e7c73132c985 None admin] RBAC: Authorizing `identity:get_domain(domain_id=f8bdebe34bbf43d9a5b50d79685bd308)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:40:28.110288 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacfb876-5e21-4711-8d62-e7c73132c985 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:40:28.112529 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 588/1172] 10.222.0.60 () {56 vars in 1183 bytes} [Sat Sep 24 19:40:27 2022] GET /identity/v3/domains/f8bdebe34bbf43d9a5b50d79685bd308 => generated 267 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:40:28.120329 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b4ce4d-1e82-448d-84b3-fbda85c55348 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:28.222228 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b4ce4d-1e82-448d-84b3-fbda85c55348 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:28.257146 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab1680-4d9f-4872-bfd2-c14841c5fb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:28.257786 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab1680-4d9f-4872-bfd2-c14841c5fb0e None admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:28.258068 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab1680-4d9f-4872-bfd2-c14841c5fb0e None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:28.258339 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab1680-4d9f-4872-bfd2-c14841c5fb0e None admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:28.258980 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbab1680-4d9f-4872-bfd2-c14841c5fb0e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:40:28.260424 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbab1680-4d9f-4872-bfd2-c14841c5fb0e None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:40:28.345163 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 585/1173] 10.222.0.60 () {60 vars in 1141 bytes} [Sat Sep 24 19:40:28 2022] POST /identity/v3/projects => generated 361 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:40:30.567625 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f4ea8-cdd9-4a99-9486-a5b038f13299 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:30.568309 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f4ea8-cdd9-4a99-9486-a5b038f13299 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:30.568309 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f4ea8-cdd9-4a99-9486-a5b038f13299 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:30.569596 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 589/1174] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:40:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:40:30.574826 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e3e0e-e0c5-494e-9896-b0ef0ef78de2 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:30.575216 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e3e0e-e0c5-494e-9896-b0ef0ef78de2 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:30.575401 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e3e0e-e0c5-494e-9896-b0ef0ef78de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:30.593194 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-aa4e3e0e-e0c5-494e-9896-b0ef0ef78de2 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:40:30.594390 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-aa4e3e0e-e0c5-494e-9896-b0ef0ef78de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:40:30.596303 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:40:30.661045 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 586/1175] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:40:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:40:30.931635 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f4ea8-cdd9-4a99-9486-a5b038f13299 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:31.032290 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f4ea8-cdd9-4a99-9486-a5b038f13299 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:31.066137 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310769f8-5ac6-4a21-9ac9-b8e92760d769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:31.066881 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310769f8-5ac6-4a21-9ac9-b8e92760d769 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:31.067190 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310769f8-5ac6-4a21-9ac9-b8e92760d769 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:31.067466 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310769f8-5ac6-4a21-9ac9-b8e92760d769 None admin] PATH_INFO: `/v3/domains/f8bdebe34bbf43d9a5b50d79685bd308` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:31.068682 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310769f8-5ac6-4a21-9ac9-b8e92760d769 None admin] RBAC: Authorizing `identity:get_domain(domain_id=f8bdebe34bbf43d9a5b50d79685bd308)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:40:31.070163 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310769f8-5ac6-4a21-9ac9-b8e92760d769 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:40:31.072035 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 590/1176] 10.222.0.60 () {56 vars in 1183 bytes} [Sat Sep 24 19:40:30 2022] GET /identity/v3/domains/f8bdebe34bbf43d9a5b50d79685bd308 => generated 267 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:40:31.079099 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e3e0e-e0c5-494e-9896-b0ef0ef78de2 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:31.179503 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e3e0e-e0c5-494e-9896-b0ef0ef78de2 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:31.212555 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8be2600-b9cf-4099-a0c8-09b8b941704c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:31.213079 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be2600-b9cf-4099-a0c8-09b8b941704c None admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:31.213354 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be2600-b9cf-4099-a0c8-09b8b941704c None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:31.213650 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be2600-b9cf-4099-a0c8-09b8b941704c None admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:31.214295 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8be2600-b9cf-4099-a0c8-09b8b941704c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:40:31.215734 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8be2600-b9cf-4099-a0c8-09b8b941704c None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:40:31.225567 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:40:31.337728 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 587/1177] 10.222.0.60 () {60 vars in 1132 bytes} [Sat Sep 24 19:40:31 2022] POST /identity/v3/users => generated 311 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 19:40:33.597770 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0dbf85-cef5-4761-9574-6db539eb3bba None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:33.598338 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0dbf85-cef5-4761-9574-6db539eb3bba None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:33.598338 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0dbf85-cef5-4761-9574-6db539eb3bba None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:33.599654 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 591/1178] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:40:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:40:33.604958 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5554a4a-9009-4413-b653-9d04eed1b8c7 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:33.605387 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5554a4a-9009-4413-b653-9d04eed1b8c7 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:33.605542 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5554a4a-9009-4413-b653-9d04eed1b8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:33.625841 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-b5554a4a-9009-4413-b653-9d04eed1b8c7 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:40:33.627031 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-b5554a4a-9009-4413-b653-9d04eed1b8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:40:33.695165 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 588/1179] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:40:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:40:33.974018 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0dbf85-cef5-4761-9574-6db539eb3bba None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:34.017910 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:40:34.076285 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0dbf85-cef5-4761-9574-6db539eb3bba None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:34.133190 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a299b0f8-027a-4cb1-838e-bcb30aca91fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:34.133833 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299b0f8-027a-4cb1-838e-bcb30aca91fe None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:34.134112 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299b0f8-027a-4cb1-838e-bcb30aca91fe None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:34.134379 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299b0f8-027a-4cb1-838e-bcb30aca91fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:34.144711 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a299b0f8-027a-4cb1-838e-bcb30aca91fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:40:34.149440 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-a299b0f8-027a-4cb1-838e-bcb30aca91fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:40:34.149440 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:40:34.149440 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:40:34.149440 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:40:34.149440 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:40:34.149440 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:40:34.149440 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:40:34.149440 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:40:34.149440 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:40:34.149440 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:40:34.149440 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:40:34.149440 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:40:34.149440 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:40:34.149440 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:40:34.149440 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:40:34.149440 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:40:34.150666 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:40:34.150666 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:40:34.150666 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:40:34.150666 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:40:34.150666 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:40:34.150666 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:40:34.150666 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:40:34.150666 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:40:34.150666 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:40:34.150666 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:40:34.150666 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:40:34.150666 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:40:34.150666 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:40:34.150666 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:40:34.150666 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:40:34.150666 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:40:34.151749 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:40:34.151749 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:40:34.151749 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:40:34.151749 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:40:34.151749 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:40:34.151749 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:40:34.151749 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:40:34.151749 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:40:34.151749 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:40:34.151749 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:40:34.151749 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:40:34.151749 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:40:34.151749 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 592/1180] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Sep 24 19:40:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:40:34.157015 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5554a4a-9009-4413-b653-9d04eed1b8c7 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:34.255377 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5554a4a-9009-4413-b653-9d04eed1b8c7 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:34.278621 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:40:34.290372 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a1bf1-fd64-4736-ad80-43c07316b2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:34.290977 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a1bf1-fd64-4736-ad80-43c07316b2d5 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:34.291253 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a1bf1-fd64-4736-ad80-43c07316b2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:34.291521 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a1bf1-fd64-4736-ad80-43c07316b2d5 None admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:34.292176 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493a1bf1-fd64-4736-ad80-43c07316b2d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:40:34.292474 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493a1bf1-fd64-4736-ad80-43c07316b2d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:40:34.294538 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493a1bf1-fd64-4736-ad80-43c07316b2d5 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:40:34.302476 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 589/1181] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Sep 24 19:40:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:40:34.308639 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a299b0f8-027a-4cb1-838e-bcb30aca91fe None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:34.405886 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:40:34.408737 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a299b0f8-027a-4cb1-838e-bcb30aca91fe None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:34.445292 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6574fb06-f53b-4740-a433-0230b9c89746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:34.445945 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574fb06-f53b-4740-a433-0230b9c89746 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:34.446231 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574fb06-f53b-4740-a433-0230b9c89746 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:34.446505 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574fb06-f53b-4740-a433-0230b9c89746 None admin] PATH_INFO: `/v3/users/7706ddfcf6c94ed3bd714ad4935409ce` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:34.460117 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6574fb06-f53b-4740-a433-0230b9c89746 None admin] RBAC: Authorizing `identity:get_user(user_id=7706ddfcf6c94ed3bd714ad4935409ce)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:40:34.461659 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6574fb06-f53b-4740-a433-0230b9c89746 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:40:34.463284 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 593/1182] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Sep 24 19:40:34 2022] GET /identity/v3/users/7706ddfcf6c94ed3bd714ad4935409ce => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:40:34.471222 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a1bf1-fd64-4736-ad80-43c07316b2d5 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:34.572257 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a1bf1-fd64-4736-ad80-43c07316b2d5 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:34.604272 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97854883-a54a-4fb9-9096-1a8a76dd8d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:34.604944 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97854883-a54a-4fb9-9096-1a8a76dd8d84 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:34.605218 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97854883-a54a-4fb9-9096-1a8a76dd8d84 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:34.605779 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97854883-a54a-4fb9-9096-1a8a76dd8d84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:34.657785 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:40:34.671041 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97854883-a54a-4fb9-9096-1a8a76dd8d84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:40:34.672488 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97854883-a54a-4fb9-9096-1a8a76dd8d84 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:40:34.782239 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 590/1183] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Sep 24 19:40:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 19:40:34.788186 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6574fb06-f53b-4740-a433-0230b9c89746 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:34.886685 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6574fb06-f53b-4740-a433-0230b9c89746 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:34.921459 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e66926-66c3-4f05-8a98-04d77a311226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:34.922097 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e66926-66c3-4f05-8a98-04d77a311226 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:34.922432 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e66926-66c3-4f05-8a98-04d77a311226 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:34.922704 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e66926-66c3-4f05-8a98-04d77a311226 None admin] PATH_INFO: `/v3/projects/a85f37611e8a470e9a336432a89ec09b` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:34.923788 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e66926-66c3-4f05-8a98-04d77a311226 None admin] RBAC: Authorizing `identity:get_project(project_id=a85f37611e8a470e9a336432a89ec09b)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:40:34.925178 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e66926-66c3-4f05-8a98-04d77a311226 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:40:34.926810 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 594/1184] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Sep 24 19:40:34 2022] GET /identity/v3/projects/a85f37611e8a470e9a336432a89ec09b => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:40:34.932893 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97854883-a54a-4fb9-9096-1a8a76dd8d84 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:35.017606 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:40:35.031781 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97854883-a54a-4fb9-9096-1a8a76dd8d84 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:35.066094 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442035b-4afc-45ed-a517-46b505014b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:35.066688 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442035b-4afc-45ed-a517-46b505014b3b None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:35.066963 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442035b-4afc-45ed-a517-46b505014b3b None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:35.067230 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442035b-4afc-45ed-a517-46b505014b3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:35.067961 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1442035b-4afc-45ed-a517-46b505014b3b None admin] RBAC: Adding query filter params (role.id=f022705fa6ce43828345ef50b3f7efc9, scope.project.id=a85f37611e8a470e9a336432a89ec09b, user.id=7706ddfcf6c94ed3bd714ad4935409ce) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:40:35.068264 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1442035b-4afc-45ed-a517-46b505014b3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:40:35.069705 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1442035b-4afc-45ed-a517-46b505014b3b None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:40:35.075237 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 591/1185] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Sep 24 19:40:34 2022] GET /identity/v3/role_assignments?user.id=7706ddfcf6c94ed3bd714ad4935409ce&scope.project.id=a85f37611e8a470e9a336432a89ec09b&role.id=f022705fa6ce43828345ef50b3f7efc9 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:40:37.250517 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31497b-d5d1-4ac1-ad2d-361257149e73 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:37.251091 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31497b-d5d1-4ac1-ad2d-361257149e73 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:37.251091 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31497b-d5d1-4ac1-ad2d-361257149e73 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:37.252413 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 595/1186] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:40:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:40:37.258235 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90721372-f53c-4a65-a46c-196be17cba8b None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:37.258650 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90721372-f53c-4a65-a46c-196be17cba8b None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:37.258812 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90721372-f53c-4a65-a46c-196be17cba8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:37.277060 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-90721372-f53c-4a65-a46c-196be17cba8b None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:40:37.278262 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-90721372-f53c-4a65-a46c-196be17cba8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:40:37.349604 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 592/1187] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:40:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:40:37.624718 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e31497b-d5d1-4ac1-ad2d-361257149e73 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:37.652361 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:40:37.730792 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e31497b-d5d1-4ac1-ad2d-361257149e73 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:37.765201 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8287ba3d-16f1-41dc-9725-e36ecc40fcd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:37.765851 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8287ba3d-16f1-41dc-9725-e36ecc40fcd8 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:37.766126 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8287ba3d-16f1-41dc-9725-e36ecc40fcd8 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:37.766405 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8287ba3d-16f1-41dc-9725-e36ecc40fcd8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:37.776161 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8287ba3d-16f1-41dc-9725-e36ecc40fcd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:40:37.781646 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-8287ba3d-16f1-41dc-9725-e36ecc40fcd8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:40:37.781646 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:40:37.781646 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:40:37.781646 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:40:37.781646 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:40:37.781646 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:40:37.781646 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:40:37.781646 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:40:37.781646 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:40:37.781646 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:40:37.781646 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:40:37.781646 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:40:37.781646 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:40:37.781646 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:40:37.781646 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:40:37.781646 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:40:37.782812 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:40:37.782812 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:40:37.782812 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:40:37.782812 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:40:37.782812 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:40:37.782812 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:40:37.782812 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:40:37.782812 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:40:37.782812 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:40:37.782812 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:40:37.782812 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:40:37.782812 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:40:37.782812 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:40:37.782812 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:40:37.782812 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:40:37.782812 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:40:37.783999 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:40:37.783999 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:40:37.783999 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:40:37.783999 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:40:37.783999 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:40:37.783999 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:40:37.783999 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:40:37.783999 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:40:37.783999 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:40:37.783999 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:40:37.783999 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:40:37.783999 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:40:37.783999 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 596/1188] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Sep 24 19:40:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:40:37.788949 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90721372-f53c-4a65-a46c-196be17cba8b None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:37.871908 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:40:37.893742 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90721372-f53c-4a65-a46c-196be17cba8b None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:37.939037 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821530a0-7e80-4ab5-8faa-04d1a57d58ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:37.939636 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821530a0-7e80-4ab5-8faa-04d1a57d58ed None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:37.939911 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821530a0-7e80-4ab5-8faa-04d1a57d58ed None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:37.940175 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821530a0-7e80-4ab5-8faa-04d1a57d58ed None admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:37.940830 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821530a0-7e80-4ab5-8faa-04d1a57d58ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:40:37.941126 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821530a0-7e80-4ab5-8faa-04d1a57d58ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:40:37.942526 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821530a0-7e80-4ab5-8faa-04d1a57d58ed None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:40:37.952276 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 593/1189] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Sep 24 19:40:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:40:37.958354 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8287ba3d-16f1-41dc-9725-e36ecc40fcd8 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:38.046802 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:40:38.062879 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8287ba3d-16f1-41dc-9725-e36ecc40fcd8 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:38.099327 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a65186b-d53c-49f3-a4ba-db4caec15e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:38.099957 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65186b-d53c-49f3-a4ba-db4caec15e1e None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:38.100235 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65186b-d53c-49f3-a4ba-db4caec15e1e None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:38.100506 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65186b-d53c-49f3-a4ba-db4caec15e1e None admin] PATH_INFO: `/v3/users/7706ddfcf6c94ed3bd714ad4935409ce` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:38.101646 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a65186b-d53c-49f3-a4ba-db4caec15e1e None admin] RBAC: Authorizing `identity:get_user(user_id=7706ddfcf6c94ed3bd714ad4935409ce)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:40:38.103194 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a65186b-d53c-49f3-a4ba-db4caec15e1e None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:40:38.105155 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 597/1190] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Sep 24 19:40:37 2022] GET /identity/v3/users/7706ddfcf6c94ed3bd714ad4935409ce => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:40:38.113222 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821530a0-7e80-4ab5-8faa-04d1a57d58ed None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:38.216995 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821530a0-7e80-4ab5-8faa-04d1a57d58ed None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:38.251791 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2317ecae-09bc-46b2-8256-37bc56b992ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:38.252468 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317ecae-09bc-46b2-8256-37bc56b992ea None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:38.252741 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317ecae-09bc-46b2-8256-37bc56b992ea None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:38.253007 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317ecae-09bc-46b2-8256-37bc56b992ea None admin] PATH_INFO: `/v3/projects/a85f37611e8a470e9a336432a89ec09b` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:38.254204 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2317ecae-09bc-46b2-8256-37bc56b992ea None admin] RBAC: Authorizing `identity:get_project(project_id=a85f37611e8a470e9a336432a89ec09b)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:40:38.255722 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2317ecae-09bc-46b2-8256-37bc56b992ea None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:40:38.257572 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 594/1191] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Sep 24 19:40:38 2022] GET /identity/v3/projects/a85f37611e8a470e9a336432a89ec09b => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:40:38.263428 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a65186b-d53c-49f3-a4ba-db4caec15e1e None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:38.364506 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a65186b-d53c-49f3-a4ba-db4caec15e1e None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:38.396669 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc73c46c-ccfd-4d64-80bb-3fc4a22fc02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:38.397313 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73c46c-ccfd-4d64-80bb-3fc4a22fc02c None admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:38.397616 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73c46c-ccfd-4d64-80bb-3fc4a22fc02c None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:38.397890 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73c46c-ccfd-4d64-80bb-3fc4a22fc02c None admin] PATH_INFO: `/v3/projects/a85f37611e8a470e9a336432a89ec09b/users/7706ddfcf6c94ed3bd714ad4935409ce/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:38.399739 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc73c46c-ccfd-4d64-80bb-3fc4a22fc02c None admin] RBAC: Authorizing `identity:create_grant(project_id=a85f37611e8a470e9a336432a89ec09b, user_id=7706ddfcf6c94ed3bd714ad4935409ce, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:40:38.401148 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc73c46c-ccfd-4d64-80bb-3fc4a22fc02c None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:40:38.491229 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 598/1192] 10.222.0.60 () {58 vars in 1439 bytes} [Sat Sep 24 19:40:38 2022] PUT /identity/v3/projects/a85f37611e8a470e9a336432a89ec09b/users/7706ddfcf6c94ed3bd714ad4935409ce/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:40:40.620904 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ebd60-fb54-4f5e-9c65-7f95fb564729 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:40.621488 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ebd60-fb54-4f5e-9c65-7f95fb564729 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:40.621488 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ebd60-fb54-4f5e-9c65-7f95fb564729 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:40.622948 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 595/1193] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:40:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:40:40.628426 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb0cb6-fb29-4e67-b3cf-742f22dcf9c4 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:40.628828 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb0cb6-fb29-4e67-b3cf-742f22dcf9c4 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:40.628964 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb0cb6-fb29-4e67-b3cf-742f22dcf9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:40.646626 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-e1cb0cb6-fb29-4e67-b3cf-742f22dcf9c4 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:40:40.647784 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-e1cb0cb6-fb29-4e67-b3cf-742f22dcf9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:40:40.657576 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:40:40.714075 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 599/1194] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:40:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:40:40.993436 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ebd60-fb54-4f5e-9c65-7f95fb564729 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:41.006556 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:40:41.093365 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ebd60-fb54-4f5e-9c65-7f95fb564729 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:41.127144 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b1bd9d-357a-4399-bab8-35dc573c9e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:41.127763 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b1bd9d-357a-4399-bab8-35dc573c9e18 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:41.128040 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b1bd9d-357a-4399-bab8-35dc573c9e18 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:41.128307 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b1bd9d-357a-4399-bab8-35dc573c9e18 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:41.138757 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b1bd9d-357a-4399-bab8-35dc573c9e18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:40:41.143561 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-e8b1bd9d-357a-4399-bab8-35dc573c9e18 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:40:41.143561 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:40:41.143561 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:40:41.143561 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:40:41.143561 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:40:41.143561 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:40:41.143561 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:40:41.143561 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:40:41.143561 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:40:41.143561 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:40:41.143561 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:40:41.143561 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:40:41.143561 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:40:41.143561 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:40:41.143561 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:40:41.143561 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:40:41.144674 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:40:41.144674 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:40:41.144674 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:40:41.144674 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:40:41.144674 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:40:41.144674 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:40:41.144674 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:40:41.144674 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:40:41.144674 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:40:41.144674 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:40:41.144674 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:40:41.144674 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:40:41.144674 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:40:41.144674 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:40:41.144674 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:40:41.144674 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:40:41.145555 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:40:41.145555 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:40:41.145555 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:40:41.145555 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:40:41.145555 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:40:41.145555 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:40:41.145555 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:40:41.145555 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:40:41.145555 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:40:41.145555 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:40:41.145555 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:40:41.145555 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:40:41.145555 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 596/1195] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Sep 24 19:40:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:40:41.150868 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cb0cb6-fb29-4e67-b3cf-742f22dcf9c4 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:41.244566 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cb0cb6-fb29-4e67-b3cf-742f22dcf9c4 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:41.278184 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ffc52-6ba5-4acb-8cad-2cd4cc8bf584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:41.278788 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ffc52-6ba5-4acb-8cad-2cd4cc8bf584 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:41.279064 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ffc52-6ba5-4acb-8cad-2cd4cc8bf584 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:41.279332 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ffc52-6ba5-4acb-8cad-2cd4cc8bf584 None admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:41.279982 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ffc52-6ba5-4acb-8cad-2cd4cc8bf584 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:40:41.280279 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ffc52-6ba5-4acb-8cad-2cd4cc8bf584 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:40:41.281645 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ffc52-6ba5-4acb-8cad-2cd4cc8bf584 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:40:41.289335 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 600/1196] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Sep 24 19:40:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:40:41.295593 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b1bd9d-357a-4399-bab8-35dc573c9e18 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:41.364035 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:40:41.394315 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b1bd9d-357a-4399-bab8-35dc573c9e18 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:41.427195 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b683b1-c6c5-4716-b280-83f3d1702d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:41.427813 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b683b1-c6c5-4716-b280-83f3d1702d7e None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:41.428089 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b683b1-c6c5-4716-b280-83f3d1702d7e None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:41.428358 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b683b1-c6c5-4716-b280-83f3d1702d7e None admin] PATH_INFO: `/v3/users/7706ddfcf6c94ed3bd714ad4935409ce` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:41.429465 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b683b1-c6c5-4716-b280-83f3d1702d7e None admin] RBAC: Authorizing `identity:get_user(user_id=7706ddfcf6c94ed3bd714ad4935409ce)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:40:41.430927 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b683b1-c6c5-4716-b280-83f3d1702d7e None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:40:41.432480 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 597/1197] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Sep 24 19:40:41 2022] GET /identity/v3/users/7706ddfcf6c94ed3bd714ad4935409ce => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:40:41.439283 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ffc52-6ba5-4acb-8cad-2cd4cc8bf584 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:41.448940 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:40:41.535986 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ffc52-6ba5-4acb-8cad-2cd4cc8bf584 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:41.568169 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7fdbc4-f08d-4bfa-b436-2cc02acc0807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:41.568763 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7fdbc4-f08d-4bfa-b436-2cc02acc0807 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:41.569039 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7fdbc4-f08d-4bfa-b436-2cc02acc0807 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:41.569308 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7fdbc4-f08d-4bfa-b436-2cc02acc0807 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:41.633251 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7fdbc4-f08d-4bfa-b436-2cc02acc0807 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:40:41.634735 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7fdbc4-f08d-4bfa-b436-2cc02acc0807 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:40:41.642116 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:40:41.731675 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 601/1198] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Sep 24 19:40:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 19:40:41.737665 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b683b1-c6c5-4716-b280-83f3d1702d7e None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:41.835853 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b683b1-c6c5-4716-b280-83f3d1702d7e None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:41.869198 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c347835-95c8-4b4c-bdb1-d9449e5bd3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:41.869840 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c347835-95c8-4b4c-bdb1-d9449e5bd3dc None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:41.870197 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c347835-95c8-4b4c-bdb1-d9449e5bd3dc None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:41.870470 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c347835-95c8-4b4c-bdb1-d9449e5bd3dc None admin] PATH_INFO: `/v3/projects/a85f37611e8a470e9a336432a89ec09b` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:41.871743 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c347835-95c8-4b4c-bdb1-d9449e5bd3dc None admin] RBAC: Authorizing `identity:get_project(project_id=a85f37611e8a470e9a336432a89ec09b)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:40:41.873169 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c347835-95c8-4b4c-bdb1-d9449e5bd3dc None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:40:41.874814 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 598/1199] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Sep 24 19:40:41 2022] GET /identity/v3/projects/a85f37611e8a470e9a336432a89ec09b => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:40:41.881157 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7fdbc4-f08d-4bfa-b436-2cc02acc0807 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:41.979239 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7fdbc4-f08d-4bfa-b436-2cc02acc0807 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:41.986554 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:40:42.011798 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c720b5ea-39b6-4e26-a2c6-1bbec3b6aea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:42.013040 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c720b5ea-39b6-4e26-a2c6-1bbec3b6aea1 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:42.013319 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c720b5ea-39b6-4e26-a2c6-1bbec3b6aea1 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:42.013620 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c720b5ea-39b6-4e26-a2c6-1bbec3b6aea1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:42.014336 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c720b5ea-39b6-4e26-a2c6-1bbec3b6aea1 None admin] RBAC: Adding query filter params (role.id=f022705fa6ce43828345ef50b3f7efc9, scope.project.id=a85f37611e8a470e9a336432a89ec09b, user.id=7706ddfcf6c94ed3bd714ad4935409ce) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:40:42.014641 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c720b5ea-39b6-4e26-a2c6-1bbec3b6aea1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:40:42.016118 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c720b5ea-39b6-4e26-a2c6-1bbec3b6aea1 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:40:42.022104 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 602/1200] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Sep 24 19:40:41 2022] GET /identity/v3/role_assignments?user.id=7706ddfcf6c94ed3bd714ad4935409ce&scope.project.id=a85f37611e8a470e9a336432a89ec09b&role.id=f022705fa6ce43828345ef50b3f7efc9 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:40:51.865040 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=97 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:40:52.019859 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=15 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:41:56.462069 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557c979-af9a-41d5-a16f-5c154aeb4440 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:41:56.462773 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557c979-af9a-41d5-a16f-5c154aeb4440 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:41:56.462773 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557c979-af9a-41d5-a16f-5c154aeb4440 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:41:56.464027 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 599/1201] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:41:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:41:56.469917 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205217bc-4766-4b90-85d9-cc4c33c425c1 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:41:56.470439 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205217bc-4766-4b90-85d9-cc4c33c425c1 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:41:56.470576 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205217bc-4766-4b90-85d9-cc4c33c425c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:41:56.489081 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-205217bc-4766-4b90-85d9-cc4c33c425c1 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:41:56.490391 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-205217bc-4766-4b90-85d9-cc4c33c425c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:41:56.561473 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 603/1202] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:41:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:41:56.844570 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557c979-af9a-41d5-a16f-5c154aeb4440 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:41:56.954305 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557c979-af9a-41d5-a16f-5c154aeb4440 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:41:56.992822 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d333dc61-19d4-4e4c-bbe6-4098fff5b9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:41:56.993595 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333dc61-19d4-4e4c-bbe6-4098fff5b9fe None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:41:56.993912 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333dc61-19d4-4e4c-bbe6-4098fff5b9fe None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:41:56.994252 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333dc61-19d4-4e4c-bbe6-4098fff5b9fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:41:57.005476 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d333dc61-19d4-4e4c-bbe6-4098fff5b9fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:41:57.006963 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d333dc61-19d4-4e4c-bbe6-4098fff5b9fe None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:41:57.023014 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-d333dc61-19d4-4e4c-bbe6-4098fff5b9fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:41:57.023014 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:41:57.023014 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:41:57.023014 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:41:57.023014 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:41:57.023014 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:41:57.023014 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:41:57.023014 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:41:57.023014 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:41:57.023014 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:41:57.023014 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:41:57.023014 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:41:57.023014 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:41:57.023014 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:41:57.023014 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:41:57.023014 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:41:57.024230 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:41:57.024230 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:41:57.024230 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:41:57.024230 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:41:57.024230 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:41:57.024230 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:41:57.024230 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:41:57.024230 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:41:57.024230 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:41:57.024230 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:41:57.024230 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:41:57.024230 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:41:57.024230 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:41:57.024230 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:41:57.024230 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:41:57.024230 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:41:57.024230 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:41:57.025334 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:41:57.025334 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:41:57.025334 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:41:57.025334 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 600/1203] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:41:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:41:57.032393 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205217bc-4766-4b90-85d9-cc4c33c425c1 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:41:57.139578 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205217bc-4766-4b90-85d9-cc4c33c425c1 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:41:57.169403 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:41:57.175864 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9726be5a-211e-40b1-acf9-3af59e3a3c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:41:57.176478 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726be5a-211e-40b1-acf9-3af59e3a3c63 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:41:57.176796 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726be5a-211e-40b1-acf9-3af59e3a3c63 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:41:57.177083 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726be5a-211e-40b1-acf9-3af59e3a3c63 None admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:41:57.177755 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9726be5a-211e-40b1-acf9-3af59e3a3c63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:41:57.178061 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9726be5a-211e-40b1-acf9-3af59e3a3c63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:41:57.185429 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9726be5a-211e-40b1-acf9-3af59e3a3c63 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:41:57.192540 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 604/1204] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:41:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:41:57.199100 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d333dc61-19d4-4e4c-bbe6-4098fff5b9fe None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:41:57.259250 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:41:57.309518 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d333dc61-19d4-4e4c-bbe6-4098fff5b9fe None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:41:57.344931 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354fd85c-9fe4-4205-8f93-f64ae5727159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:41:57.345579 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354fd85c-9fe4-4205-8f93-f64ae5727159 None admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:41:57.345844 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354fd85c-9fe4-4205-8f93-f64ae5727159 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:41:57.346113 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354fd85c-9fe4-4205-8f93-f64ae5727159 None admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:41:57.346758 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354fd85c-9fe4-4205-8f93-f64ae5727159 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:41:57.348226 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354fd85c-9fe4-4205-8f93-f64ae5727159 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:41:57.504352 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 601/1205] 10.222.0.60 () {60 vars in 1132 bytes} [Sat Sep 24 19:41:57 2022] POST /identity/v3/users => generated 251 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 19:41:59.820084 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68929333-7294-4673-9078-f27a974f9974 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:41:59.820611 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68929333-7294-4673-9078-f27a974f9974 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:41:59.820611 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68929333-7294-4673-9078-f27a974f9974 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:41:59.822060 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 605/1206] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:41:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:41:59.828136 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb7ae0-6fc5-4851-b9ef-449e8a58a8d3 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:41:59.829381 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb7ae0-6fc5-4851-b9ef-449e8a58a8d3 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:41:59.829381 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb7ae0-6fc5-4851-b9ef-449e8a58a8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:41:59.848418 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-cafb7ae0-6fc5-4851-b9ef-449e8a58a8d3 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:41:59.852308 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-cafb7ae0-6fc5-4851-b9ef-449e8a58a8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:41:59.920920 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 602/1207] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:41:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:42:00.208880 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68929333-7294-4673-9078-f27a974f9974 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:00.317092 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68929333-7294-4673-9078-f27a974f9974 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:00.352356 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcde610-87ee-4ae3-bc35-aa70e1703a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:00.352979 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcde610-87ee-4ae3-bc35-aa70e1703a04 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:00.353253 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcde610-87ee-4ae3-bc35-aa70e1703a04 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:00.353575 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcde610-87ee-4ae3-bc35-aa70e1703a04 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:00.363860 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcde610-87ee-4ae3-bc35-aa70e1703a04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:42:00.368638 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-6dcde610-87ee-4ae3-bc35-aa70e1703a04 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:42:00.368638 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:42:00.368638 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:42:00.368638 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:42:00.368638 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:42:00.368638 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:42:00.368638 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:42:00.368638 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:42:00.368638 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:42:00.368638 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:42:00.368638 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:42:00.368638 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:42:00.368638 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:42:00.368638 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:42:00.368638 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:42:00.368638 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:42:00.370694 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:42:00.370694 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:42:00.370694 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:42:00.370694 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:42:00.370694 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:42:00.370694 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:42:00.370694 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:42:00.370694 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:42:00.370694 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:42:00.370694 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:42:00.370694 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:42:00.370694 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:42:00.370694 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:42:00.370694 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:42:00.370694 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:42:00.370694 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:42:00.372970 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:42:00.372970 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:42:00.372970 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:42:00.372970 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:42:00.372970 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:42:00.372970 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:42:00.372970 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:42:00.372970 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:42:00.372970 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:42:00.372970 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:42:00.372970 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:42:00.372970 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:42:00.372970 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 606/1208] 10.222.0.60 () {56 vars in 1102 bytes} [Sat Sep 24 19:42:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:42:00.376921 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafb7ae0-6fc5-4851-b9ef-449e8a58a8d3 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:00.416679 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:00.477313 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafb7ae0-6fc5-4851-b9ef-449e8a58a8d3 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:00.511539 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33942083-3fa2-491f-af27-3398fc3dd692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:00.515418 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33942083-3fa2-491f-af27-3398fc3dd692 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:00.515418 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33942083-3fa2-491f-af27-3398fc3dd692 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:00.515418 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33942083-3fa2-491f-af27-3398fc3dd692 None admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:00.515418 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33942083-3fa2-491f-af27-3398fc3dd692 None admin] RBAC: Adding query filter params (name=service) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:42:00.515418 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33942083-3fa2-491f-af27-3398fc3dd692 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:00.516070 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33942083-3fa2-491f-af27-3398fc3dd692 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:00.523713 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 603/1209] 10.222.0.60 () {56 vars in 1103 bytes} [Sat Sep 24 19:42:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:42:00.530448 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcde610-87ee-4ae3-bc35-aa70e1703a04 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:00.583875 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:00.636286 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcde610-87ee-4ae3-bc35-aa70e1703a04 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:00.673588 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536cc838-f8cb-4032-b4cb-ea8d0ae87ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:00.674154 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536cc838-f8cb-4032-b4cb-ea8d0ae87ad4 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:00.674428 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536cc838-f8cb-4032-b4cb-ea8d0ae87ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:00.674694 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536cc838-f8cb-4032-b4cb-ea8d0ae87ad4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:00.686565 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536cc838-f8cb-4032-b4cb-ea8d0ae87ad4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:00.688041 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536cc838-f8cb-4032-b4cb-ea8d0ae87ad4 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:00.703157 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-536cc838-f8cb-4032-b4cb-ea8d0ae87ad4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:42:00.703157 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:42:00.703157 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:42:00.703157 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:42:00.703157 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:42:00.703157 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:42:00.703157 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:42:00.703157 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:42:00.703157 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:42:00.703157 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:42:00.703157 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:42:00.703157 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:42:00.703157 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:42:00.703157 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:42:00.703157 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:42:00.703157 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:42:00.704303 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:42:00.704303 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:42:00.704303 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:42:00.704303 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:42:00.704303 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:42:00.704303 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:42:00.704303 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:42:00.704303 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:42:00.704303 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:42:00.704303 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:42:00.704303 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:42:00.704303 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:42:00.704303 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:42:00.704303 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:42:00.704303 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:42:00.704303 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:42:00.704303 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:42:00.705286 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:42:00.705286 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:42:00.705286 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:42:00.705286 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 607/1210] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:42:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:42:00.710656 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33942083-3fa2-491f-af27-3398fc3dd692 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:00.832010 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:00.835125 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33942083-3fa2-491f-af27-3398fc3dd692 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:00.868672 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c96fb7-0b90-4029-b7ab-e76073c97581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:00.869275 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c96fb7-0b90-4029-b7ab-e76073c97581 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:00.869573 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c96fb7-0b90-4029-b7ab-e76073c97581 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:00.869838 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c96fb7-0b90-4029-b7ab-e76073c97581 None admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:00.870500 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c96fb7-0b90-4029-b7ab-e76073c97581 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:42:00.870794 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c96fb7-0b90-4029-b7ab-e76073c97581 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:00.872926 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c96fb7-0b90-4029-b7ab-e76073c97581 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:00.884192 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 604/1211] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:42:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:42:00.891083 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536cc838-f8cb-4032-b4cb-ea8d0ae87ad4 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:00.993349 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536cc838-f8cb-4032-b4cb-ea8d0ae87ad4 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:00.994955 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:01.032587 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ea9f1-b3e4-4d60-942e-c2b0cb74e274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:01.033223 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ea9f1-b3e4-4d60-942e-c2b0cb74e274 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:01.033518 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ea9f1-b3e4-4d60-942e-c2b0cb74e274 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:01.033861 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ea9f1-b3e4-4d60-942e-c2b0cb74e274 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:01.041410 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5ea9f1-b3e4-4d60-942e-c2b0cb74e274 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:01.042875 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5ea9f1-b3e4-4d60-942e-c2b0cb74e274 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:01.055669 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-2e5ea9f1-b3e4-4d60-942e-c2b0cb74e274 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 24 19:42:01.055669 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:42:01.055669 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:42:01.055669 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:42:01.055669 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:42:01.055669 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:42:01.055669 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:42:01.055669 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:42:01.055669 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:42:01.055669 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:42:01.055669 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:42:01.055669 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:42:01.055669 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:42:01.055669 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:42:01.055669 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:42:01.055669 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:42:01.058289 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:42:01.058289 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:42:01.058289 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:42:01.058289 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:42:01.058289 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:42:01.058289 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:42:01.058289 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:42:01.058289 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:42:01.058289 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:42:01.058289 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:42:01.058289 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:42:01.058289 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:42:01.058289 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:42:01.058289 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:42:01.058289 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:42:01.058289 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:42:01.058289 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:42:01.058289 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:42:01.060299 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:42:01.060299 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:42:01.060299 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:42:01.060299 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:42:01.060299 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:42:01.060299 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:42:01.060299 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:42:01.060299 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:42:01.060299 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 24 19:42:01.060299 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:42:01.060299 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 608/1212] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:42:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:42:01.063567 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c96fb7-0b90-4029-b7ab-e76073c97581 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:01.178016 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c96fb7-0b90-4029-b7ab-e76073c97581 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:01.214378 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8bf511-8fd6-4f60-a7d3-3daf2a09a5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:01.214994 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8bf511-8fd6-4f60-a7d3-3daf2a09a5a8 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:01.215392 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8bf511-8fd6-4f60-a7d3-3daf2a09a5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:01.215665 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8bf511-8fd6-4f60-a7d3-3daf2a09a5a8 None admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:01.217147 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8bf511-8fd6-4f60-a7d3-3daf2a09a5a8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:42:01.217457 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8bf511-8fd6-4f60-a7d3-3daf2a09a5a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:01.218980 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8bf511-8fd6-4f60-a7d3-3daf2a09a5a8 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:01.238298 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 605/1213] 10.222.0.60 () {56 vars in 1143 bytes} [Sat Sep 24 19:42:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:42:01.244552 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ea9f1-b3e4-4d60-942e-c2b0cb74e274 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:01.351629 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ea9f1-b3e4-4d60-942e-c2b0cb74e274 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:01.386648 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51b5659-7db5-4f2e-b3ed-7027cc3ab739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:01.387258 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b5659-7db5-4f2e-b3ed-7027cc3ab739 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:01.387535 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b5659-7db5-4f2e-b3ed-7027cc3ab739 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:01.388008 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b5659-7db5-4f2e-b3ed-7027cc3ab739 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:01.420133 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:01.459819 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51b5659-7db5-4f2e-b3ed-7027cc3ab739 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:01.461188 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51b5659-7db5-4f2e-b3ed-7027cc3ab739 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:01.583688 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 609/1214] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Sep 24 19:42:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 19:42:01.589822 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8bf511-8fd6-4f60-a7d3-3daf2a09a5a8 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:01.609965 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:01.696316 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8bf511-8fd6-4f60-a7d3-3daf2a09a5a8 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:01.737092 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a2031b-751a-471b-9911-7d7b8bcbaa6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:01.737678 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2031b-751a-471b-9911-7d7b8bcbaa6e None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:01.737953 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2031b-751a-471b-9911-7d7b8bcbaa6e None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:01.738218 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2031b-751a-471b-9911-7d7b8bcbaa6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:01.748762 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a2031b-751a-471b-9911-7d7b8bcbaa6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:01.750237 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a2031b-751a-471b-9911-7d7b8bcbaa6e None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:01.765126 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-f7a2031b-751a-471b-9911-7d7b8bcbaa6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:42:01.765126 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:42:01.765126 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:42:01.765126 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:42:01.765126 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:42:01.765126 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:42:01.765126 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:42:01.765126 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:42:01.765126 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:42:01.765126 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:42:01.765126 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:42:01.765126 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:42:01.765126 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:42:01.765126 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:42:01.765126 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:42:01.765126 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:42:01.766333 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:42:01.766333 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:42:01.766333 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:42:01.766333 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:42:01.766333 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:42:01.766333 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:42:01.766333 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:42:01.766333 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:42:01.766333 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:42:01.766333 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:42:01.766333 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:42:01.766333 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:42:01.766333 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:42:01.766333 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:42:01.766333 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:42:01.766333 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:42:01.766333 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:42:01.767427 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:42:01.767427 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:42:01.767427 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:42:01.767427 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 606/1215] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:42:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:42:01.772879 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51b5659-7db5-4f2e-b3ed-7027cc3ab739 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:01.843726 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:01.884006 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51b5659-7db5-4f2e-b3ed-7027cc3ab739 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:01.924746 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4058e9-2196-4947-a4f9-ee42dac29b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:01.925419 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4058e9-2196-4947-a4f9-ee42dac29b86 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:01.925639 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4058e9-2196-4947-a4f9-ee42dac29b86 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:01.925915 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4058e9-2196-4947-a4f9-ee42dac29b86 None admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:01.926605 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4058e9-2196-4947-a4f9-ee42dac29b86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:42:01.927133 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4058e9-2196-4947-a4f9-ee42dac29b86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:01.929183 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4058e9-2196-4947-a4f9-ee42dac29b86 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:01.941942 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 610/1216] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:42:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:42:01.948033 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a2031b-751a-471b-9911-7d7b8bcbaa6e None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:02.027719 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:02.059370 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a2031b-751a-471b-9911-7d7b8bcbaa6e None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:02.095201 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e61727-b1c6-4f8a-bce6-c22e525ffc87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:02.095829 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e61727-b1c6-4f8a-bce6-c22e525ffc87 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:02.096109 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e61727-b1c6-4f8a-bce6-c22e525ffc87 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:02.096378 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e61727-b1c6-4f8a-bce6-c22e525ffc87 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:02.103570 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e61727-b1c6-4f8a-bce6-c22e525ffc87 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:02.105569 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e61727-b1c6-4f8a-bce6-c22e525ffc87 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:02.120751 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-68e61727-b1c6-4f8a-bce6-c22e525ffc87 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:42:02.120751 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:42:02.120751 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:42:02.120751 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:42:02.120751 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:42:02.120751 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:42:02.120751 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:42:02.120751 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:42:02.120751 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:42:02.120751 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:42:02.120751 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:42:02.120751 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:42:02.120751 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:42:02.120751 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:42:02.120751 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:42:02.123466 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:42:02.123466 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:42:02.123466 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:42:02.123466 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:42:02.123466 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:42:02.123466 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:42:02.123466 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:42:02.123466 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:42:02.123466 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:42:02.123466 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:42:02.123466 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:42:02.123466 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:42:02.123466 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:42:02.123466 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:42:02.123466 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:42:02.123466 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:42:02.123466 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:42:02.125413 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:42:02.125413 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:42:02.125413 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:42:02.125413 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:42:02.125413 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:42:02.125413 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:42:02.125413 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:42:02.125413 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:42:02.125413 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 607/1217] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Sep 24 19:42:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:42:02.129218 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4058e9-2196-4947-a4f9-ee42dac29b86 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:02.241434 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4058e9-2196-4947-a4f9-ee42dac29b86 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:02.267248 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:02.279405 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bc6080-b07a-4b9f-8311-d737292471d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:02.280378 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc6080-b07a-4b9f-8311-d737292471d1 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:02.280916 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc6080-b07a-4b9f-8311-d737292471d1 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:02.281378 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc6080-b07a-4b9f-8311-d737292471d1 None admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:02.282697 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bc6080-b07a-4b9f-8311-d737292471d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:42:02.283259 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bc6080-b07a-4b9f-8311-d737292471d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:02.284754 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bc6080-b07a-4b9f-8311-d737292471d1 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:02.297595 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 611/1218] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Sep 24 19:42:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:42:02.304150 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e61727-b1c6-4f8a-bce6-c22e525ffc87 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:02.410331 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e61727-b1c6-4f8a-bce6-c22e525ffc87 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:02.438936 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:02.444767 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d7e17-bcb2-4f98-af0d-05f967e5bc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:02.445366 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d7e17-bcb2-4f98-af0d-05f967e5bc26 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:02.445678 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d7e17-bcb2-4f98-af0d-05f967e5bc26 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:02.446029 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d7e17-bcb2-4f98-af0d-05f967e5bc26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:02.446777 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d7e17-bcb2-4f98-af0d-05f967e5bc26 None admin] RBAC: Adding query filter params (role.id=e9acf72f841f4030a76e8f9c41c95d7f, scope.project.id=5c2da88af5714e619238772bde676a42, user.id=55f19f1385114fa5a921999747a6666b) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:42:02.447079 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d7e17-bcb2-4f98-af0d-05f967e5bc26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:02.448498 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d7e17-bcb2-4f98-af0d-05f967e5bc26 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:02.454736 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 608/1219] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Sep 24 19:42:02 2022] GET /identity/v3/role_assignments?user.id=55f19f1385114fa5a921999747a6666b&scope.project.id=5c2da88af5714e619238772bde676a42&role.id=e9acf72f841f4030a76e8f9c41c95d7f => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:42:04.651681 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3e235-2f04-4f65-b468-8d7ac8f9cc48 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:04.652223 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3e235-2f04-4f65-b468-8d7ac8f9cc48 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:04.652223 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3e235-2f04-4f65-b468-8d7ac8f9cc48 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:04.654273 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 612/1220] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:42:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:42:04.660327 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa41022-0109-4fa9-b1db-2f1606aa9e4a None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:04.660783 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa41022-0109-4fa9-b1db-2f1606aa9e4a None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:04.661203 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa41022-0109-4fa9-b1db-2f1606aa9e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:04.686326 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-6fa41022-0109-4fa9-b1db-2f1606aa9e4a None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:42:04.687519 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-6fa41022-0109-4fa9-b1db-2f1606aa9e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:42:04.758190 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 609/1221] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:42:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:42:05.041060 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3e235-2f04-4f65-b468-8d7ac8f9cc48 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:05.143311 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3e235-2f04-4f65-b468-8d7ac8f9cc48 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:05.178913 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88915291-03ec-43a2-b42e-9e6986649893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:05.183713 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88915291-03ec-43a2-b42e-9e6986649893 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:05.183713 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88915291-03ec-43a2-b42e-9e6986649893 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:05.183713 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88915291-03ec-43a2-b42e-9e6986649893 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:05.190791 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88915291-03ec-43a2-b42e-9e6986649893 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:42:05.195664 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-88915291-03ec-43a2-b42e-9e6986649893 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:42:05.195664 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:42:05.195664 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:42:05.195664 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:42:05.195664 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:42:05.195664 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:42:05.195664 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:42:05.195664 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:42:05.195664 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:42:05.195664 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:42:05.195664 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:42:05.195664 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:42:05.195664 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:42:05.195664 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:42:05.195664 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:42:05.195664 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:42:05.197325 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:42:05.197325 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:42:05.197325 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:42:05.197325 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:42:05.197325 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:42:05.197325 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:42:05.197325 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:42:05.197325 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:42:05.197325 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:42:05.197325 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:42:05.197325 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:42:05.197325 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:42:05.197325 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:42:05.197325 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:42:05.197325 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:42:05.197325 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:42:05.199002 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:42:05.199002 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:42:05.199002 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:42:05.199002 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:42:05.199002 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:42:05.199002 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:42:05.199002 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:42:05.199002 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:42:05.199002 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:42:05.199002 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:42:05.199002 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:42:05.199002 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:42:05.199002 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 613/1222] 10.222.0.60 () {56 vars in 1102 bytes} [Sat Sep 24 19:42:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:42:05.204207 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa41022-0109-4fa9-b1db-2f1606aa9e4a None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:05.311354 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa41022-0109-4fa9-b1db-2f1606aa9e4a None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:05.335880 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:05.346739 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f46b95-75fd-4f59-9221-6446b11f67b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:05.347347 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f46b95-75fd-4f59-9221-6446b11f67b8 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:05.347699 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f46b95-75fd-4f59-9221-6446b11f67b8 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:05.348115 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f46b95-75fd-4f59-9221-6446b11f67b8 None admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:05.348776 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f46b95-75fd-4f59-9221-6446b11f67b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:42:05.349077 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f46b95-75fd-4f59-9221-6446b11f67b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:05.350615 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f46b95-75fd-4f59-9221-6446b11f67b8 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:05.358737 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 610/1223] 10.222.0.60 () {56 vars in 1103 bytes} [Sat Sep 24 19:42:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:42:05.364817 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88915291-03ec-43a2-b42e-9e6986649893 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:05.411874 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:05.471508 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88915291-03ec-43a2-b42e-9e6986649893 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:05.506013 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2558b5-ee9e-4521-b8b8-76ca0988006c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:05.506632 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2558b5-ee9e-4521-b8b8-76ca0988006c None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:05.506908 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2558b5-ee9e-4521-b8b8-76ca0988006c None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:05.507179 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2558b5-ee9e-4521-b8b8-76ca0988006c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:05.517702 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2558b5-ee9e-4521-b8b8-76ca0988006c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:05.519139 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2558b5-ee9e-4521-b8b8-76ca0988006c None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:05.534112 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-7d2558b5-ee9e-4521-b8b8-76ca0988006c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:42:05.534112 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:42:05.534112 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:42:05.534112 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:42:05.534112 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:42:05.534112 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:42:05.534112 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:42:05.534112 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:42:05.534112 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:42:05.534112 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:42:05.534112 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:42:05.534112 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:42:05.534112 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:42:05.534112 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:42:05.534112 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:42:05.534112 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:42:05.535351 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:42:05.535351 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:42:05.535351 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:42:05.535351 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:42:05.535351 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:42:05.535351 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:42:05.535351 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:42:05.535351 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:42:05.535351 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:42:05.535351 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:42:05.535351 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:42:05.535351 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:42:05.535351 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:42:05.535351 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:42:05.535351 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:42:05.535351 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:42:05.535351 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:42:05.536757 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:42:05.536757 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:42:05.536757 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:42:05.536757 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 614/1224] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:42:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:42:05.541633 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f46b95-75fd-4f59-9221-6446b11f67b8 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:05.645424 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f46b95-75fd-4f59-9221-6446b11f67b8 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:05.681217 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b3477-143f-4b0b-b563-b76574490e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:05.681910 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b3477-143f-4b0b-b563-b76574490e2f None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:05.682163 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b3477-143f-4b0b-b563-b76574490e2f None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:05.682576 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b3477-143f-4b0b-b563-b76574490e2f None admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:05.683212 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b3477-143f-4b0b-b563-b76574490e2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:42:05.683512 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b3477-143f-4b0b-b563-b76574490e2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:05.685783 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b3477-143f-4b0b-b563-b76574490e2f None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:05.698194 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 611/1225] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:42:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:42:05.705176 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2558b5-ee9e-4521-b8b8-76ca0988006c None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:05.804006 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:05.811795 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2558b5-ee9e-4521-b8b8-76ca0988006c None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:05.845982 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7798af56-2a69-4a43-a6dc-297b0a34d3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:05.846630 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798af56-2a69-4a43-a6dc-297b0a34d3ec None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:05.846886 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798af56-2a69-4a43-a6dc-297b0a34d3ec None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:05.847153 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798af56-2a69-4a43-a6dc-297b0a34d3ec None admin] PATH_INFO: `/v3/users/placement` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:05.854107 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7798af56-2a69-4a43-a6dc-297b0a34d3ec None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:05.855505 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7798af56-2a69-4a43-a6dc-297b0a34d3ec None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:05.868778 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-7798af56-2a69-4a43-a6dc-297b0a34d3ec None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 24 19:42:05.868778 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:42:05.868778 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:42:05.868778 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:42:05.868778 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:42:05.868778 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:42:05.868778 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:42:05.868778 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:42:05.868778 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:42:05.868778 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:42:05.868778 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:42:05.868778 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:42:05.868778 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:42:05.868778 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:42:05.868778 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:42:05.868778 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:42:05.874603 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:42:05.874603 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:42:05.874603 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:42:05.874603 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:42:05.874603 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:42:05.874603 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:42:05.874603 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:42:05.874603 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:42:05.874603 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:42:05.874603 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:42:05.874603 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:42:05.874603 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:42:05.874603 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:42:05.874603 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:42:05.874603 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:42:05.874603 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:42:05.874603 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:42:05.874603 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:42:05.876514 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:42:05.876514 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:42:05.876514 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:42:05.876514 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:42:05.876514 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:42:05.876514 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:42:05.876514 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:42:05.876514 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:42:05.876514 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 24 19:42:05.876514 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:42:05.876514 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 615/1226] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:42:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:42:05.877754 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b3477-143f-4b0b-b563-b76574490e2f None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:05.925108 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:05.977728 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b3477-143f-4b0b-b563-b76574490e2f None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:06.014569 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe32076-43cc-497c-ba08-c5c12f773f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:06.015180 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe32076-43cc-497c-ba08-c5c12f773f95 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:06.015463 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe32076-43cc-497c-ba08-c5c12f773f95 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:06.015759 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe32076-43cc-497c-ba08-c5c12f773f95 None admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:06.016477 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe32076-43cc-497c-ba08-c5c12f773f95 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:42:06.016782 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe32076-43cc-497c-ba08-c5c12f773f95 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:06.018241 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe32076-43cc-497c-ba08-c5c12f773f95 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:06.036265 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 612/1227] 10.222.0.60 () {56 vars in 1143 bytes} [Sat Sep 24 19:42:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:42:06.042387 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7798af56-2a69-4a43-a6dc-297b0a34d3ec None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:06.145304 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7798af56-2a69-4a43-a6dc-297b0a34d3ec None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:06.179621 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43280cf-2bfc-4973-9dad-acbcae33c8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:06.180178 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43280cf-2bfc-4973-9dad-acbcae33c8a6 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:06.180458 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43280cf-2bfc-4973-9dad-acbcae33c8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:06.180733 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43280cf-2bfc-4973-9dad-acbcae33c8a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:06.192359 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43280cf-2bfc-4973-9dad-acbcae33c8a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:06.193959 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43280cf-2bfc-4973-9dad-acbcae33c8a6 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:06.209617 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-f43280cf-2bfc-4973-9dad-acbcae33c8a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:42:06.209617 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:42:06.209617 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:42:06.209617 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:42:06.209617 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:42:06.209617 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:42:06.209617 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:42:06.209617 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:42:06.209617 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:42:06.209617 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:42:06.209617 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:42:06.209617 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:42:06.209617 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:42:06.209617 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:42:06.209617 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:42:06.209617 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:42:06.215353 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:42:06.215353 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:42:06.215353 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:42:06.215353 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:42:06.215353 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:42:06.215353 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:42:06.215353 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:42:06.215353 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:42:06.215353 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:42:06.215353 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:42:06.215353 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:42:06.215353 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:42:06.215353 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:42:06.215353 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:42:06.215353 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:42:06.215353 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:42:06.215353 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:42:06.216538 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:42:06.216538 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:42:06.216538 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:42:06.216538 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 616/1228] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:42:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:42:06.217040 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe32076-43cc-497c-ba08-c5c12f773f95 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:06.316872 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe32076-43cc-497c-ba08-c5c12f773f95 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:06.319195 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:06.352080 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8f174c-248a-44a4-a6b6-166cd7d95052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:06.352686 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f174c-248a-44a4-a6b6-166cd7d95052 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:06.352960 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f174c-248a-44a4-a6b6-166cd7d95052 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:06.353224 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f174c-248a-44a4-a6b6-166cd7d95052 None admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:06.353887 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8f174c-248a-44a4-a6b6-166cd7d95052 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:42:06.354184 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8f174c-248a-44a4-a6b6-166cd7d95052 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:06.355531 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8f174c-248a-44a4-a6b6-166cd7d95052 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:06.367754 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 613/1229] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:42:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:42:06.374692 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43280cf-2bfc-4973-9dad-acbcae33c8a6 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:06.384491 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:06.476537 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43280cf-2bfc-4973-9dad-acbcae33c8a6 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:06.510783 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2376fb3-4d66-4676-8840-6baf5bd4e886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:06.511495 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2376fb3-4d66-4676-8840-6baf5bd4e886 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:06.511785 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2376fb3-4d66-4676-8840-6baf5bd4e886 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:06.512069 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2376fb3-4d66-4676-8840-6baf5bd4e886 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:06.519926 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2376fb3-4d66-4676-8840-6baf5bd4e886 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:06.523011 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2376fb3-4d66-4676-8840-6baf5bd4e886 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:06.533720 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-c2376fb3-4d66-4676-8840-6baf5bd4e886 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:42:06.533720 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:42:06.533720 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:42:06.533720 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:42:06.533720 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:42:06.533720 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:42:06.533720 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:42:06.533720 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:42:06.533720 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:42:06.533720 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:42:06.533720 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:42:06.533720 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:42:06.533720 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:42:06.533720 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:42:06.533720 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:42:06.535325 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:42:06.535325 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:42:06.535325 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:42:06.535325 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:42:06.535325 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:42:06.535325 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:42:06.535325 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:42:06.535325 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:42:06.535325 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:42:06.535325 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:42:06.535325 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:42:06.535325 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:42:06.535325 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:42:06.535325 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:42:06.535325 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:42:06.535325 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:42:06.535325 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:42:06.536829 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:42:06.536829 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:42:06.536829 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:42:06.536829 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:42:06.536829 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:42:06.536829 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:42:06.536829 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:42:06.536829 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:42:06.536829 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 617/1230] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Sep 24 19:42:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:42:06.540725 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8f174c-248a-44a4-a6b6-166cd7d95052 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:06.654212 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8f174c-248a-44a4-a6b6-166cd7d95052 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:06.690072 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db28ab-3051-4b75-9ef6-a7a6b1b435e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:06.690688 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db28ab-3051-4b75-9ef6-a7a6b1b435e6 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:06.690932 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db28ab-3051-4b75-9ef6-a7a6b1b435e6 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:06.691196 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db28ab-3051-4b75-9ef6-a7a6b1b435e6 None admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:06.691882 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3db28ab-3051-4b75-9ef6-a7a6b1b435e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:42:06.692183 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3db28ab-3051-4b75-9ef6-a7a6b1b435e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:06.693633 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3db28ab-3051-4b75-9ef6-a7a6b1b435e6 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:06.706667 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 614/1231] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Sep 24 19:42:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:42:06.713090 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2376fb3-4d66-4676-8840-6baf5bd4e886 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:06.784978 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:06.821658 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2376fb3-4d66-4676-8840-6baf5bd4e886 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:06.859246 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a0d50-6e47-4a87-b53e-f4356a8275eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:06.859945 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a0d50-6e47-4a87-b53e-f4356a8275eb None admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:06.860227 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a0d50-6e47-4a87-b53e-f4356a8275eb None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:06.860504 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a0d50-6e47-4a87-b53e-f4356a8275eb None admin] PATH_INFO: `/v3/projects/5c2da88af5714e619238772bde676a42/users/55f19f1385114fa5a921999747a6666b/roles/e9acf72f841f4030a76e8f9c41c95d7f` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:06.876262 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77a0d50-6e47-4a87-b53e-f4356a8275eb None admin] RBAC: Authorizing `identity:create_grant(project_id=5c2da88af5714e619238772bde676a42, user_id=55f19f1385114fa5a921999747a6666b, role_id=e9acf72f841f4030a76e8f9c41c95d7f)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:06.877856 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77a0d50-6e47-4a87-b53e-f4356a8275eb None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:06.951064 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 618/1232] 10.222.0.60 () {58 vars in 1439 bytes} [Sat Sep 24 19:42:06 2022] PUT /identity/v3/projects/5c2da88af5714e619238772bde676a42/users/55f19f1385114fa5a921999747a6666b/roles/e9acf72f841f4030a76e8f9c41c95d7f => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:42:09.127103 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c11f98-b768-494e-8f07-e30a534171d9 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:09.127774 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c11f98-b768-494e-8f07-e30a534171d9 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:09.127774 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c11f98-b768-494e-8f07-e30a534171d9 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:09.129010 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 615/1233] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:42:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:42:09.134431 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bdf5ea-a746-4783-9f6a-f28e166e7cdb None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:09.134894 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bdf5ea-a746-4783-9f6a-f28e166e7cdb None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:09.135240 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bdf5ea-a746-4783-9f6a-f28e166e7cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:09.154370 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-58bdf5ea-a746-4783-9f6a-f28e166e7cdb None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:42:09.155772 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-58bdf5ea-a746-4783-9f6a-f28e166e7cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:42:09.222010 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 619/1234] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:42:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:42:09.500757 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c11f98-b768-494e-8f07-e30a534171d9 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:09.526524 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:09.604633 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c11f98-b768-494e-8f07-e30a534171d9 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:09.639454 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2618166c-ce89-49a8-9172-66df5349238c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:09.640109 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618166c-ce89-49a8-9172-66df5349238c None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:09.640387 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618166c-ce89-49a8-9172-66df5349238c None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:09.640650 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618166c-ce89-49a8-9172-66df5349238c None admin] PATH_INFO: `/v3/roles/service` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:09.650654 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2618166c-ce89-49a8-9172-66df5349238c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:42:09.656351 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-2618166c-ce89-49a8-9172-66df5349238c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:42:09.656351 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:42:09.656351 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:42:09.656351 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:42:09.656351 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:42:09.656351 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:42:09.656351 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:42:09.656351 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:42:09.656351 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:42:09.656351 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:42:09.656351 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:42:09.656351 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:42:09.656351 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:42:09.656351 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:42:09.656351 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:42:09.656351 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:42:09.657534 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:42:09.657534 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:42:09.657534 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:42:09.657534 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:42:09.657534 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:42:09.657534 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:42:09.657534 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:42:09.657534 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:42:09.657534 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:42:09.657534 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:42:09.657534 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:42:09.657534 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:42:09.657534 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:42:09.657534 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:42:09.657534 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:42:09.657534 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:42:09.658447 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:42:09.658447 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:42:09.658447 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:42:09.658447 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:42:09.658447 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:42:09.658447 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:42:09.658447 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:42:09.658447 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:42:09.658447 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:42:09.658447 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:42:09.658447 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:42:09.658447 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:42:09.658447 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 616/1235] 10.222.0.60 () {56 vars in 1102 bytes} [Sat Sep 24 19:42:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:42:09.665351 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bdf5ea-a746-4783-9f6a-f28e166e7cdb None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:09.712607 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:09.767864 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bdf5ea-a746-4783-9f6a-f28e166e7cdb None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:09.800393 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed3340-8e4c-4545-a86b-f76f97702304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:09.806875 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed3340-8e4c-4545-a86b-f76f97702304 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:09.806875 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed3340-8e4c-4545-a86b-f76f97702304 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:09.806875 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed3340-8e4c-4545-a86b-f76f97702304 None admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:09.806875 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ed3340-8e4c-4545-a86b-f76f97702304 None admin] RBAC: Adding query filter params (name=service) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:42:09.806875 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ed3340-8e4c-4545-a86b-f76f97702304 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:09.806875 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ed3340-8e4c-4545-a86b-f76f97702304 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:09.812247 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 620/1236] 10.222.0.60 () {56 vars in 1103 bytes} [Sat Sep 24 19:42:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:42:09.818300 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2618166c-ce89-49a8-9172-66df5349238c None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:09.905672 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:09.921751 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2618166c-ce89-49a8-9172-66df5349238c None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:09.957782 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de29455f-89ac-4d6c-8a1e-063f6b6f9d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:09.958404 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29455f-89ac-4d6c-8a1e-063f6b6f9d72 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:09.958676 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29455f-89ac-4d6c-8a1e-063f6b6f9d72 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:09.958938 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29455f-89ac-4d6c-8a1e-063f6b6f9d72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:09.969714 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de29455f-89ac-4d6c-8a1e-063f6b6f9d72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:09.971156 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de29455f-89ac-4d6c-8a1e-063f6b6f9d72 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:09.986169 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-de29455f-89ac-4d6c-8a1e-063f6b6f9d72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:42:09.986169 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:42:09.986169 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:42:09.986169 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:42:09.986169 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:42:09.986169 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:42:09.986169 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:42:09.986169 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:42:09.986169 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:42:09.986169 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:42:09.986169 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:42:09.986169 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:42:09.986169 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:42:09.986169 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:42:09.986169 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:42:09.986169 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:42:09.987827 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:42:09.987827 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:42:09.987827 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:42:09.987827 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:42:09.987827 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:42:09.987827 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:42:09.987827 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:42:09.987827 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:42:09.987827 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:42:09.987827 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:42:09.987827 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:42:09.987827 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:42:09.987827 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:42:09.987827 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:42:09.987827 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:42:09.987827 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:42:09.987827 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:42:09.989055 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:42:09.989055 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:42:09.989055 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:42:09.989055 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 617/1237] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:42:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:42:09.993239 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed3340-8e4c-4545-a86b-f76f97702304 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:10.095085 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed3340-8e4c-4545-a86b-f76f97702304 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:10.104077 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:10.132905 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8afb0df-e25a-4b72-b74d-5903cee95423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:10.133513 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8afb0df-e25a-4b72-b74d-5903cee95423 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:10.133802 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8afb0df-e25a-4b72-b74d-5903cee95423 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:10.134072 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8afb0df-e25a-4b72-b74d-5903cee95423 None admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:10.134707 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8afb0df-e25a-4b72-b74d-5903cee95423 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:42:10.135280 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8afb0df-e25a-4b72-b74d-5903cee95423 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:10.136333 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8afb0df-e25a-4b72-b74d-5903cee95423 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:10.147801 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 621/1238] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:42:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:42:10.153744 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de29455f-89ac-4d6c-8a1e-063f6b6f9d72 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:10.255260 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de29455f-89ac-4d6c-8a1e-063f6b6f9d72 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:10.287993 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea85c582-d608-4b10-bdb4-cb075631286c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:10.288822 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea85c582-d608-4b10-bdb4-cb075631286c None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:10.289186 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea85c582-d608-4b10-bdb4-cb075631286c None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:10.289582 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea85c582-d608-4b10-bdb4-cb075631286c None admin] PATH_INFO: `/v3/users/placement` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:10.294033 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:10.298418 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea85c582-d608-4b10-bdb4-cb075631286c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:10.299859 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea85c582-d608-4b10-bdb4-cb075631286c None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:10.311539 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-ea85c582-d608-4b10-bdb4-cb075631286c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 24 19:42:10.311539 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:42:10.311539 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:42:10.311539 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:42:10.311539 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:42:10.311539 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:42:10.311539 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:42:10.311539 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:42:10.311539 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:42:10.311539 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:42:10.311539 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:42:10.311539 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:42:10.311539 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:42:10.311539 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:42:10.311539 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:42:10.311539 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:42:10.313334 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:42:10.313334 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:42:10.313334 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:42:10.313334 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:42:10.313334 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:42:10.313334 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:42:10.313334 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:42:10.313334 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:42:10.313334 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:42:10.313334 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:42:10.313334 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:42:10.313334 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:42:10.313334 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:42:10.313334 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:42:10.313334 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:42:10.313334 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:42:10.313334 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:42:10.313334 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:42:10.314503 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:42:10.314503 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:42:10.314503 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:42:10.314503 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:42:10.314503 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:42:10.314503 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:42:10.314503 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:42:10.314503 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:42:10.314503 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 24 19:42:10.314503 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:42:10.314503 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 618/1239] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:42:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:42:10.318596 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8afb0df-e25a-4b72-b74d-5903cee95423 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:10.417559 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8afb0df-e25a-4b72-b74d-5903cee95423 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:10.452534 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a72fa-a191-4afd-9022-a17510d410db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:10.453132 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a72fa-a191-4afd-9022-a17510d410db None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:10.453408 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a72fa-a191-4afd-9022-a17510d410db None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:10.453704 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a72fa-a191-4afd-9022-a17510d410db None admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:10.454433 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a72fa-a191-4afd-9022-a17510d410db None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:42:10.454736 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a72fa-a191-4afd-9022-a17510d410db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:10.456170 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a72fa-a191-4afd-9022-a17510d410db None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:10.473980 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 622/1240] 10.222.0.60 () {56 vars in 1143 bytes} [Sat Sep 24 19:42:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:42:10.480095 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea85c582-d608-4b10-bdb4-cb075631286c None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:10.582440 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea85c582-d608-4b10-bdb4-cb075631286c None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:10.617508 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ae901-f41a-4436-aef8-f0634394402d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:10.618138 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ae901-f41a-4436-aef8-f0634394402d None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:10.618415 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ae901-f41a-4436-aef8-f0634394402d None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:10.618685 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ae901-f41a-4436-aef8-f0634394402d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:10.685411 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:10.691970 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ae901-f41a-4436-aef8-f0634394402d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:10.693422 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ae901-f41a-4436-aef8-f0634394402d None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:10.793301 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 619/1241] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Sep 24 19:42:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 19:42:10.799951 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a72fa-a191-4afd-9022-a17510d410db None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:10.828183 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:10.901522 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a72fa-a191-4afd-9022-a17510d410db None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:10.938352 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790d94ac-7c07-42d1-a07d-648488abed88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:10.938925 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d94ac-7c07-42d1-a07d-648488abed88 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:10.939204 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d94ac-7c07-42d1-a07d-648488abed88 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:10.939474 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d94ac-7c07-42d1-a07d-648488abed88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:10.949422 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790d94ac-7c07-42d1-a07d-648488abed88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:10.950873 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790d94ac-7c07-42d1-a07d-648488abed88 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:10.965735 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-790d94ac-7c07-42d1-a07d-648488abed88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:42:10.965735 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:42:10.965735 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:42:10.965735 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:42:10.965735 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:42:10.965735 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:42:10.965735 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:42:10.965735 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:42:10.965735 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:42:10.965735 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:42:10.965735 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:42:10.965735 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:42:10.965735 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:42:10.965735 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:42:10.965735 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:42:10.965735 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:42:10.967647 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:42:10.967647 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:42:10.967647 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:42:10.967647 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:42:10.967647 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:42:10.967647 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:42:10.967647 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:42:10.967647 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:42:10.967647 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:42:10.967647 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:42:10.967647 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:42:10.967647 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:42:10.967647 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:42:10.967647 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:42:10.967647 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:42:10.967647 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:42:10.967647 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:42:10.969411 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:42:10.969411 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:42:10.969411 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:42:10.969411 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 623/1242] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:42:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:42:10.972871 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ae901-f41a-4436-aef8-f0634394402d None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:11.070983 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:11.076823 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ae901-f41a-4436-aef8-f0634394402d None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:11.111170 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8609b9c4-bea5-41b6-b611-66e4d2be9323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:11.111773 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609b9c4-bea5-41b6-b611-66e4d2be9323 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:11.112047 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609b9c4-bea5-41b6-b611-66e4d2be9323 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:11.112310 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609b9c4-bea5-41b6-b611-66e4d2be9323 None admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:11.112941 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8609b9c4-bea5-41b6-b611-66e4d2be9323 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:42:11.113236 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8609b9c4-bea5-41b6-b611-66e4d2be9323 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:11.114628 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8609b9c4-bea5-41b6-b611-66e4d2be9323 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:11.126929 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 620/1243] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:42:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:42:11.133001 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790d94ac-7c07-42d1-a07d-648488abed88 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:11.213354 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:11.235884 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790d94ac-7c07-42d1-a07d-648488abed88 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:11.272209 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eafbbc5-cb92-42f8-a9c1-7859cf528f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:11.272837 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eafbbc5-cb92-42f8-a9c1-7859cf528f6a None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:11.273117 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eafbbc5-cb92-42f8-a9c1-7859cf528f6a None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:11.273391 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eafbbc5-cb92-42f8-a9c1-7859cf528f6a None admin] PATH_INFO: `/v3/projects/service` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:11.281435 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eafbbc5-cb92-42f8-a9c1-7859cf528f6a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:11.282895 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eafbbc5-cb92-42f8-a9c1-7859cf528f6a None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:11.294570 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-5eafbbc5-cb92-42f8-a9c1-7859cf528f6a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:42:11.294570 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:42:11.294570 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:42:11.294570 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:42:11.294570 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:42:11.294570 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:42:11.294570 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:42:11.294570 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:42:11.294570 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:42:11.294570 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:42:11.294570 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:42:11.294570 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:42:11.294570 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:42:11.294570 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:42:11.294570 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:42:11.296188 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:42:11.296188 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:42:11.296188 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:42:11.296188 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:42:11.296188 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:42:11.296188 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:42:11.296188 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:42:11.296188 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:42:11.296188 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:42:11.296188 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:42:11.296188 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:42:11.296188 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:42:11.296188 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:42:11.296188 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:42:11.296188 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:42:11.296188 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:42:11.296188 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:42:11.298181 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:42:11.298181 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:42:11.298181 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:42:11.298181 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:42:11.298181 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:42:11.298181 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:42:11.298181 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:42:11.298181 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:42:11.298181 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 624/1244] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Sep 24 19:42:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:42:11.303278 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8609b9c4-bea5-41b6-b611-66e4d2be9323 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:11.411013 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8609b9c4-bea5-41b6-b611-66e4d2be9323 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:11.445065 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cee6eb-0a72-408c-81ee-43d6cd82a0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:11.445727 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cee6eb-0a72-408c-81ee-43d6cd82a0ef None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:11.446005 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cee6eb-0a72-408c-81ee-43d6cd82a0ef None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:11.446267 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cee6eb-0a72-408c-81ee-43d6cd82a0ef None admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:11.447087 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cee6eb-0a72-408c-81ee-43d6cd82a0ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:42:11.447385 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cee6eb-0a72-408c-81ee-43d6cd82a0ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:11.448799 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cee6eb-0a72-408c-81ee-43d6cd82a0ef None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:11.461443 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 621/1245] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Sep 24 19:42:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:42:11.468327 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eafbbc5-cb92-42f8-a9c1-7859cf528f6a None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:11.569501 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eafbbc5-cb92-42f8-a9c1-7859cf528f6a None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:11.603978 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0e6ba9-a4ba-46d4-b8fa-d71723461907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:11.604581 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e6ba9-a4ba-46d4-b8fa-d71723461907 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:11.604857 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e6ba9-a4ba-46d4-b8fa-d71723461907 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:11.605127 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e6ba9-a4ba-46d4-b8fa-d71723461907 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:11.606428 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0e6ba9-a4ba-46d4-b8fa-d71723461907 None admin] RBAC: Adding query filter params (role.id=e9acf72f841f4030a76e8f9c41c95d7f, scope.project.id=5c2da88af5714e619238772bde676a42, user.id=55f19f1385114fa5a921999747a6666b) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:42:11.606883 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0e6ba9-a4ba-46d4-b8fa-d71723461907 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:11.608313 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0e6ba9-a4ba-46d4-b8fa-d71723461907 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:11.614166 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 625/1246] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Sep 24 19:42:11 2022] GET /identity/v3/role_assignments?user.id=55f19f1385114fa5a921999747a6666b&scope.project.id=5c2da88af5714e619238772bde676a42&role.id=e9acf72f841f4030a76e8f9c41c95d7f => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:42:13.867442 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b1624-f20d-4868-887d-d6fc6d27c4ac None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:13.868054 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b1624-f20d-4868-887d-d6fc6d27c4ac None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:13.868054 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b1624-f20d-4868-887d-d6fc6d27c4ac None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:13.869305 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 622/1247] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:42:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:42:13.875767 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a190a96-9d49-450e-a671-95b06a3f3828 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:13.876210 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a190a96-9d49-450e-a671-95b06a3f3828 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:13.876360 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a190a96-9d49-450e-a671-95b06a3f3828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:13.882706 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:13.895017 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-0a190a96-9d49-450e-a671-95b06a3f3828 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:42:13.896193 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-0a190a96-9d49-450e-a671-95b06a3f3828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:42:13.963372 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 626/1248] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:42:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:42:14.239064 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b1624-f20d-4868-887d-d6fc6d27c4ac None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:14.257796 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:14.338163 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b1624-f20d-4868-887d-d6fc6d27c4ac None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:14.372521 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cca068-b6b9-45a4-952a-b58819c9508e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:14.373138 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cca068-b6b9-45a4-952a-b58819c9508e None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:14.373415 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cca068-b6b9-45a4-952a-b58819c9508e None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:14.373707 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cca068-b6b9-45a4-952a-b58819c9508e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:14.383524 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cca068-b6b9-45a4-952a-b58819c9508e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:42:14.388484 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-25cca068-b6b9-45a4-952a-b58819c9508e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:42:14.388484 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:42:14.388484 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:42:14.388484 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:42:14.388484 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:42:14.388484 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:42:14.388484 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:42:14.388484 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:42:14.388484 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:42:14.388484 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:42:14.388484 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:42:14.388484 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:42:14.388484 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:42:14.388484 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:42:14.388484 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:42:14.388484 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:42:14.400111 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:42:14.400111 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:42:14.400111 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:42:14.400111 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:42:14.400111 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:42:14.400111 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:42:14.400111 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:42:14.400111 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:42:14.400111 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:42:14.400111 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:42:14.400111 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:42:14.400111 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:42:14.400111 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:42:14.400111 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:42:14.400111 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:42:14.400111 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:42:14.401167 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:42:14.401167 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:42:14.401167 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:42:14.401167 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:42:14.401167 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:42:14.401167 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:42:14.401167 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:42:14.401167 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:42:14.401167 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:42:14.401167 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:42:14.401167 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:42:14.401167 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:42:14.401167 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 623/1249] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Sep 24 19:42:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:42:14.402086 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a190a96-9d49-450e-a671-95b06a3f3828 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:14.495217 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a190a96-9d49-450e-a671-95b06a3f3828 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:14.527128 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:14.533016 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b015c9-8b2c-4545-96bd-6f3979f2cd1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:14.533662 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b015c9-8b2c-4545-96bd-6f3979f2cd1c None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:14.533945 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b015c9-8b2c-4545-96bd-6f3979f2cd1c None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:14.534216 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b015c9-8b2c-4545-96bd-6f3979f2cd1c None admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:14.534876 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b015c9-8b2c-4545-96bd-6f3979f2cd1c None admin] RBAC: Adding query filter params (name=admin) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:42:14.535177 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b015c9-8b2c-4545-96bd-6f3979f2cd1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:14.536560 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b015c9-8b2c-4545-96bd-6f3979f2cd1c None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:14.545539 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 627/1250] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Sep 24 19:42:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:42:14.551475 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cca068-b6b9-45a4-952a-b58819c9508e None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:14.634227 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:14.658301 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cca068-b6b9-45a4-952a-b58819c9508e None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:14.692973 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c4712-b6d8-422a-a5ac-ac1b8565b065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:14.693644 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c4712-b6d8-422a-a5ac-ac1b8565b065 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:14.693958 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c4712-b6d8-422a-a5ac-ac1b8565b065 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:14.694231 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c4712-b6d8-422a-a5ac-ac1b8565b065 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:14.704713 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c4712-b6d8-422a-a5ac-ac1b8565b065 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:14.706193 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c4712-b6d8-422a-a5ac-ac1b8565b065 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:14.721206 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-cc5c4712-b6d8-422a-a5ac-ac1b8565b065 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:42:14.721206 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:42:14.721206 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:42:14.721206 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:42:14.721206 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:42:14.721206 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:42:14.721206 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:42:14.721206 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:42:14.721206 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:42:14.721206 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:42:14.721206 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:42:14.721206 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:42:14.721206 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:42:14.721206 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:42:14.721206 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:42:14.721206 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:42:14.722362 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:42:14.722362 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:42:14.722362 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:42:14.722362 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:42:14.722362 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:42:14.722362 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:42:14.722362 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:42:14.722362 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:42:14.722362 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:42:14.722362 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:42:14.722362 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:42:14.722362 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:42:14.722362 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:42:14.722362 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:42:14.722362 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:42:14.722362 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:42:14.722362 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:42:14.723440 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:42:14.723440 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:42:14.723440 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:42:14.723440 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 624/1251] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:42:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:42:14.728572 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b015c9-8b2c-4545-96bd-6f3979f2cd1c None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:14.827475 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b015c9-8b2c-4545-96bd-6f3979f2cd1c None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:14.860612 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991814b3-8843-4279-b7d3-3beb97119f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:14.861209 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991814b3-8843-4279-b7d3-3beb97119f82 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:14.861488 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991814b3-8843-4279-b7d3-3beb97119f82 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:14.861791 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991814b3-8843-4279-b7d3-3beb97119f82 None admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:14.862423 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991814b3-8843-4279-b7d3-3beb97119f82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:42:14.862728 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991814b3-8843-4279-b7d3-3beb97119f82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:14.864071 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991814b3-8843-4279-b7d3-3beb97119f82 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:14.875602 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 628/1252] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:42:14.881683 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c4712-b6d8-422a-a5ac-ac1b8565b065 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:14.987738 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c4712-b6d8-422a-a5ac-ac1b8565b065 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:15.015260 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:15.022844 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca3a58-b1a1-4afd-8272-86fd4ab4575d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:15.023546 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca3a58-b1a1-4afd-8272-86fd4ab4575d None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:15.023826 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca3a58-b1a1-4afd-8272-86fd4ab4575d None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:15.024095 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca3a58-b1a1-4afd-8272-86fd4ab4575d None admin] PATH_INFO: `/v3/users/placement` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:15.031549 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ca3a58-b1a1-4afd-8272-86fd4ab4575d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:15.032980 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ca3a58-b1a1-4afd-8272-86fd4ab4575d None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:15.044836 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-b6ca3a58-b1a1-4afd-8272-86fd4ab4575d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 24 19:42:15.044836 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:42:15.044836 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:42:15.044836 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:42:15.044836 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:42:15.044836 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:42:15.044836 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:42:15.044836 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:42:15.044836 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:42:15.044836 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:42:15.044836 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:42:15.044836 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:42:15.044836 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:42:15.044836 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:42:15.044836 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:42:15.044836 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:42:15.045992 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:42:15.045992 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:42:15.045992 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:42:15.045992 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:42:15.045992 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:42:15.045992 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:42:15.045992 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:42:15.045992 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:42:15.045992 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:42:15.045992 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:42:15.045992 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:42:15.045992 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:42:15.045992 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:42:15.045992 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:42:15.045992 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:42:15.045992 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:42:15.045992 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:42:15.045992 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:42:15.047212 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:42:15.047212 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:42:15.047212 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:42:15.047212 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:42:15.047212 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:42:15.047212 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:42:15.047212 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:42:15.047212 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:42:15.047212 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 24 19:42:15.047212 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:42:15.047212 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 625/1253] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:42:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:42:15.052104 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991814b3-8843-4279-b7d3-3beb97119f82 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:15.108107 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:15.151131 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991814b3-8843-4279-b7d3-3beb97119f82 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:15.182601 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d06cdee-ab6d-4eea-bad0-db8d16901026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:15.183189 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06cdee-ab6d-4eea-bad0-db8d16901026 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:15.183464 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06cdee-ab6d-4eea-bad0-db8d16901026 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:15.184244 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06cdee-ab6d-4eea-bad0-db8d16901026 None admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:15.184961 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d06cdee-ab6d-4eea-bad0-db8d16901026 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:42:15.185261 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d06cdee-ab6d-4eea-bad0-db8d16901026 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:15.186688 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d06cdee-ab6d-4eea-bad0-db8d16901026 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:15.208175 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 629/1254] 10.222.0.60 () {56 vars in 1143 bytes} [Sat Sep 24 19:42:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:42:15.214185 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca3a58-b1a1-4afd-8272-86fd4ab4575d None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:15.316187 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca3a58-b1a1-4afd-8272-86fd4ab4575d None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:15.350289 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba29d9-8409-481b-8fc1-2f799812c218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:15.350890 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba29d9-8409-481b-8fc1-2f799812c218 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:15.351166 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba29d9-8409-481b-8fc1-2f799812c218 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:15.351434 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba29d9-8409-481b-8fc1-2f799812c218 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:15.406171 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:15.417944 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cba29d9-8409-481b-8fc1-2f799812c218 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:15.419903 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cba29d9-8409-481b-8fc1-2f799812c218 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:15.516988 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 626/1255] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Sep 24 19:42:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 19:42:15.523032 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d06cdee-ab6d-4eea-bad0-db8d16901026 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:15.622632 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d06cdee-ab6d-4eea-bad0-db8d16901026 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:15.635952 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:15.656677 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c41120-4d72-43e9-b9ce-81f884d4ba99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:15.657238 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c41120-4d72-43e9-b9ce-81f884d4ba99 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:15.657546 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c41120-4d72-43e9-b9ce-81f884d4ba99 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:15.657823 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c41120-4d72-43e9-b9ce-81f884d4ba99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:15.669020 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c41120-4d72-43e9-b9ce-81f884d4ba99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:15.670480 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c41120-4d72-43e9-b9ce-81f884d4ba99 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:15.687294 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-74c41120-4d72-43e9-b9ce-81f884d4ba99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:42:15.687294 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:42:15.687294 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:42:15.687294 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:42:15.687294 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:42:15.687294 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:42:15.687294 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:42:15.687294 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:42:15.687294 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:42:15.687294 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:42:15.687294 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:42:15.687294 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:42:15.687294 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:42:15.687294 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:42:15.687294 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:42:15.687294 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:42:15.688722 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:42:15.688722 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:42:15.688722 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:42:15.688722 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:42:15.688722 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:42:15.688722 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:42:15.688722 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:42:15.688722 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:42:15.688722 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:42:15.688722 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:42:15.688722 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:42:15.688722 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:42:15.688722 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:42:15.688722 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:42:15.688722 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:42:15.688722 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:42:15.688722 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:42:15.689926 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:42:15.689926 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:42:15.689926 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:42:15.689926 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 630/1256] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:42:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:42:15.694804 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba29d9-8409-481b-8fc1-2f799812c218 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:15.785982 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:15.798021 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba29d9-8409-481b-8fc1-2f799812c218 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:15.831220 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e567f69-2a64-4b89-abd0-b02329556f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:15.831823 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e567f69-2a64-4b89-abd0-b02329556f6a None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:15.832099 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e567f69-2a64-4b89-abd0-b02329556f6a None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:15.832367 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e567f69-2a64-4b89-abd0-b02329556f6a None admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:15.833032 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e567f69-2a64-4b89-abd0-b02329556f6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:42:15.833329 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e567f69-2a64-4b89-abd0-b02329556f6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:15.834721 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e567f69-2a64-4b89-abd0-b02329556f6a None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:15.846100 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 627/1257] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:42:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:42:15.851964 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c41120-4d72-43e9-b9ce-81f884d4ba99 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:15.953123 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c41120-4d72-43e9-b9ce-81f884d4ba99 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:15.989044 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c782b-d28d-4e5d-9bf8-bc6ff2eb4bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:15.989696 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c782b-d28d-4e5d-9bf8-bc6ff2eb4bdf None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:15.989977 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c782b-d28d-4e5d-9bf8-bc6ff2eb4bdf None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:15.990247 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c782b-d28d-4e5d-9bf8-bc6ff2eb4bdf None admin] PATH_INFO: `/v3/projects/service` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:15.997188 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885c782b-d28d-4e5d-9bf8-bc6ff2eb4bdf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:15.998649 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885c782b-d28d-4e5d-9bf8-bc6ff2eb4bdf None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:16.009797 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-885c782b-d28d-4e5d-9bf8-bc6ff2eb4bdf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:42:16.009797 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:42:16.009797 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:42:16.009797 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:42:16.009797 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:42:16.009797 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:42:16.009797 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:42:16.009797 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:42:16.009797 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:42:16.009797 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:42:16.009797 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:42:16.009797 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:42:16.009797 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:42:16.009797 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:42:16.009797 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:42:16.010919 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:42:16.010919 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:42:16.010919 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:42:16.010919 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:42:16.010919 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:42:16.010919 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:42:16.010919 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:42:16.010919 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:42:16.010919 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:42:16.010919 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:42:16.010919 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:42:16.010919 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:42:16.010919 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:42:16.010919 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:42:16.010919 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:42:16.010919 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:42:16.010919 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:42:16.012038 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:42:16.012038 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:42:16.012038 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:42:16.012038 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:42:16.012038 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:42:16.012038 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:42:16.012038 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:42:16.012038 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:42:16.012038 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 631/1258] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Sep 24 19:42:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:42:16.017013 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e567f69-2a64-4b89-abd0-b02329556f6a None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:16.118569 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e567f69-2a64-4b89-abd0-b02329556f6a None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:16.153316 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954165c-1033-4f52-a942-8ec440f228bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:16.154049 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954165c-1033-4f52-a942-8ec440f228bb None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:16.154325 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954165c-1033-4f52-a942-8ec440f228bb None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:16.154593 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954165c-1033-4f52-a942-8ec440f228bb None admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:16.155279 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c954165c-1033-4f52-a942-8ec440f228bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:42:16.155579 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c954165c-1033-4f52-a942-8ec440f228bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:16.157000 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c954165c-1033-4f52-a942-8ec440f228bb None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:16.170728 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 628/1259] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Sep 24 19:42:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:42:16.177342 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c782b-d28d-4e5d-9bf8-bc6ff2eb4bdf None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:16.203888 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:16.280842 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c782b-d28d-4e5d-9bf8-bc6ff2eb4bdf None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:16.313618 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba4e49e-eb56-4534-b997-832bb5bcbb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:16.314217 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4e49e-eb56-4534-b997-832bb5bcbb95 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:16.314496 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4e49e-eb56-4534-b997-832bb5bcbb95 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:16.314770 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4e49e-eb56-4534-b997-832bb5bcbb95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:16.315627 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba4e49e-eb56-4534-b997-832bb5bcbb95 None admin] RBAC: Adding query filter params (role.id=f022705fa6ce43828345ef50b3f7efc9, scope.project.id=5c2da88af5714e619238772bde676a42, user.id=55f19f1385114fa5a921999747a6666b) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:42:16.315936 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba4e49e-eb56-4534-b997-832bb5bcbb95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:16.317340 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba4e49e-eb56-4534-b997-832bb5bcbb95 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:16.322878 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 632/1260] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Sep 24 19:42:16 2022] GET /identity/v3/role_assignments?user.id=55f19f1385114fa5a921999747a6666b&scope.project.id=5c2da88af5714e619238772bde676a42&role.id=f022705fa6ce43828345ef50b3f7efc9 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:42:18.473501 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2665171-6987-4b90-be75-de21aee1da67 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:18.474192 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2665171-6987-4b90-be75-de21aee1da67 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:18.474192 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2665171-6987-4b90-be75-de21aee1da67 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:18.475531 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 629/1261] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:42:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:42:18.481301 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3682e-23ac-42f7-8c55-6f6a12538c2d None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:18.481879 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3682e-23ac-42f7-8c55-6f6a12538c2d None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:18.481879 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3682e-23ac-42f7-8c55-6f6a12538c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:18.500616 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-90c3682e-23ac-42f7-8c55-6f6a12538c2d None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:42:18.501826 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-90c3682e-23ac-42f7-8c55-6f6a12538c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:42:18.567876 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 633/1262] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:42:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:42:18.842354 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2665171-6987-4b90-be75-de21aee1da67 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:18.854197 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:18.945443 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2665171-6987-4b90-be75-de21aee1da67 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:18.980230 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7166eab2-e6f7-4dfb-82d2-b81423f95478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:18.981463 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7166eab2-e6f7-4dfb-82d2-b81423f95478 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:18.981804 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7166eab2-e6f7-4dfb-82d2-b81423f95478 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:18.982089 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7166eab2-e6f7-4dfb-82d2-b81423f95478 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:18.991906 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7166eab2-e6f7-4dfb-82d2-b81423f95478 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:42:18.997072 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-7166eab2-e6f7-4dfb-82d2-b81423f95478 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:42:18.997072 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:42:18.997072 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:42:18.997072 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:42:18.997072 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:42:18.997072 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:42:18.997072 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:42:18.997072 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:42:18.997072 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:42:18.997072 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:42:18.997072 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:42:18.997072 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:42:18.997072 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:42:18.997072 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:42:18.997072 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:42:18.997072 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:42:18.998122 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:42:18.998122 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:42:18.998122 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:42:18.998122 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:42:18.998122 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:42:18.998122 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:42:18.998122 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:42:18.998122 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:42:18.998122 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:42:18.998122 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:42:18.998122 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:42:18.998122 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:42:18.998122 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:42:18.998122 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:42:18.998122 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:42:18.998122 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:42:18.999377 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:42:18.999377 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:42:18.999377 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:42:18.999377 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:42:18.999377 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:42:18.999377 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:42:18.999377 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:42:18.999377 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:42:18.999377 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:42:18.999377 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:42:18.999377 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:42:18.999377 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:42:18.999377 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 630/1263] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Sep 24 19:42:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:42:19.004346 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3682e-23ac-42f7-8c55-6f6a12538c2d None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:19.024337 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:19.106756 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3682e-23ac-42f7-8c55-6f6a12538c2d None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:19.141817 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f0fef-bc1b-4192-87e1-7161582a82aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:19.142425 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f0fef-bc1b-4192-87e1-7161582a82aa None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:19.142707 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f0fef-bc1b-4192-87e1-7161582a82aa None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:19.142984 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f0fef-bc1b-4192-87e1-7161582a82aa None admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:19.143642 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f0fef-bc1b-4192-87e1-7161582a82aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:42:19.143939 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f0fef-bc1b-4192-87e1-7161582a82aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:19.145289 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f0fef-bc1b-4192-87e1-7161582a82aa None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:19.154043 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 634/1264] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Sep 24 19:42:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:42:19.160162 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7166eab2-e6f7-4dfb-82d2-b81423f95478 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:19.226828 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:19.261252 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7166eab2-e6f7-4dfb-82d2-b81423f95478 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:19.295277 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb7da36-dec2-4bf9-aab0-2956f23b623c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:19.295897 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7da36-dec2-4bf9-aab0-2956f23b623c None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:19.296178 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7da36-dec2-4bf9-aab0-2956f23b623c None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:19.296450 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7da36-dec2-4bf9-aab0-2956f23b623c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:19.307482 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb7da36-dec2-4bf9-aab0-2956f23b623c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:19.309111 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb7da36-dec2-4bf9-aab0-2956f23b623c None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:19.323031 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-3eb7da36-dec2-4bf9-aab0-2956f23b623c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:42:19.323031 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:42:19.323031 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:42:19.323031 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:42:19.323031 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:42:19.323031 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:42:19.323031 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:42:19.323031 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:42:19.323031 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:42:19.323031 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:42:19.323031 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:42:19.323031 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:42:19.323031 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:42:19.323031 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:42:19.323031 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:42:19.323031 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:42:19.325392 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:42:19.325392 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:42:19.325392 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:42:19.325392 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:42:19.325392 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:42:19.325392 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:42:19.325392 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:42:19.325392 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:42:19.325392 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:42:19.325392 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:42:19.325392 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:42:19.325392 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:42:19.325392 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:42:19.325392 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:42:19.325392 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:42:19.325392 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:42:19.325392 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:42:19.326350 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:42:19.326350 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:42:19.326350 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:42:19.326350 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 631/1265] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:42:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:42:19.330789 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f0fef-bc1b-4192-87e1-7161582a82aa None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:19.416600 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:19.435504 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f0fef-bc1b-4192-87e1-7161582a82aa None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:19.470486 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d55c87f-603d-435c-9149-ce9fced857df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:19.471085 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55c87f-603d-435c-9149-ce9fced857df None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:19.471358 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55c87f-603d-435c-9149-ce9fced857df None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:19.471623 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55c87f-603d-435c-9149-ce9fced857df None admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:19.472254 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d55c87f-603d-435c-9149-ce9fced857df None admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:42:19.472586 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d55c87f-603d-435c-9149-ce9fced857df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:19.473972 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d55c87f-603d-435c-9149-ce9fced857df None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:19.485080 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 635/1266] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:42:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:42:19.490707 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb7da36-dec2-4bf9-aab0-2956f23b623c None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:19.590803 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb7da36-dec2-4bf9-aab0-2956f23b623c None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:19.610414 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:19.625580 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7205539b-53bc-4e07-a7f1-d47922eb91d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:19.626215 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205539b-53bc-4e07-a7f1-d47922eb91d5 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:19.626496 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205539b-53bc-4e07-a7f1-d47922eb91d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:19.626767 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205539b-53bc-4e07-a7f1-d47922eb91d5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:19.634560 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7205539b-53bc-4e07-a7f1-d47922eb91d5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:19.636012 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7205539b-53bc-4e07-a7f1-d47922eb91d5 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:19.648103 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-7205539b-53bc-4e07-a7f1-d47922eb91d5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 24 19:42:19.648103 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:42:19.648103 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:42:19.648103 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:42:19.648103 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:42:19.648103 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:42:19.648103 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:42:19.648103 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:42:19.648103 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:42:19.648103 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:42:19.648103 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:42:19.648103 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:42:19.648103 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:42:19.648103 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:42:19.648103 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:42:19.648103 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:42:19.649832 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:42:19.649832 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:42:19.649832 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:42:19.649832 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:42:19.649832 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:42:19.649832 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:42:19.649832 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:42:19.649832 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:42:19.649832 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:42:19.649832 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:42:19.649832 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:42:19.649832 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:42:19.649832 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:42:19.649832 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:42:19.649832 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:42:19.649832 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:42:19.649832 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:42:19.649832 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:42:19.650969 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:42:19.650969 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:42:19.650969 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:42:19.650969 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:42:19.650969 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:42:19.650969 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:42:19.650969 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:42:19.650969 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:42:19.650969 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 24 19:42:19.650969 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:42:19.650969 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 632/1267] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:42:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:42:19.655627 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d55c87f-603d-435c-9149-ce9fced857df None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:19.760711 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d55c87f-603d-435c-9149-ce9fced857df None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:19.796458 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f55160-cc18-43ff-bafb-c66a4bdb872e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:19.797079 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f55160-cc18-43ff-bafb-c66a4bdb872e None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:19.797355 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f55160-cc18-43ff-bafb-c66a4bdb872e None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:19.797724 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f55160-cc18-43ff-bafb-c66a4bdb872e None admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:19.798439 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f55160-cc18-43ff-bafb-c66a4bdb872e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:42:19.798741 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f55160-cc18-43ff-bafb-c66a4bdb872e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:19.800202 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f55160-cc18-43ff-bafb-c66a4bdb872e None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:19.810169 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:19.818689 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 636/1268] 10.222.0.60 () {56 vars in 1143 bytes} [Sat Sep 24 19:42:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:42:19.825452 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7205539b-53bc-4e07-a7f1-d47922eb91d5 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:19.931988 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7205539b-53bc-4e07-a7f1-d47922eb91d5 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:19.966603 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52489c3-9f2a-4999-8145-ba69f4dae403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:19.973849 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52489c3-9f2a-4999-8145-ba69f4dae403 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:19.973849 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52489c3-9f2a-4999-8145-ba69f4dae403 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:19.973849 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52489c3-9f2a-4999-8145-ba69f4dae403 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:19.978138 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52489c3-9f2a-4999-8145-ba69f4dae403 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:19.979575 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52489c3-9f2a-4999-8145-ba69f4dae403 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:19.994057 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-c52489c3-9f2a-4999-8145-ba69f4dae403 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:42:19.994057 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:42:19.994057 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:42:19.994057 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:42:19.994057 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:42:19.994057 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:42:19.994057 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:42:19.994057 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:42:19.994057 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:42:19.994057 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:42:19.994057 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:42:19.994057 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:42:19.994057 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:42:19.994057 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:42:19.994057 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:42:19.994057 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:42:19.995499 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:42:19.995499 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:42:19.995499 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:42:19.995499 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:42:19.995499 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:42:19.995499 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:42:19.995499 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:42:19.995499 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:42:19.995499 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:42:19.995499 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:42:19.995499 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:42:19.995499 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:42:19.995499 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:42:19.995499 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:42:19.995499 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:42:19.995499 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:42:19.995499 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:42:19.997231 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:42:19.997231 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:42:19.997231 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:42:19.997231 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 633/1269] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:42:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:42:20.002003 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f55160-cc18-43ff-bafb-c66a4bdb872e None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:20.104336 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f55160-cc18-43ff-bafb-c66a4bdb872e None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:20.140801 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91279446-033b-4945-b36f-64cc68b20cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:20.141364 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91279446-033b-4945-b36f-64cc68b20cb7 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:20.141669 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91279446-033b-4945-b36f-64cc68b20cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:20.141943 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91279446-033b-4945-b36f-64cc68b20cb7 None admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:20.142570 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91279446-033b-4945-b36f-64cc68b20cb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:42:20.142867 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91279446-033b-4945-b36f-64cc68b20cb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:20.144256 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91279446-033b-4945-b36f-64cc68b20cb7 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:20.156167 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 637/1270] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:42:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:42:20.162101 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52489c3-9f2a-4999-8145-ba69f4dae403 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:20.195784 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:20.265100 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52489c3-9f2a-4999-8145-ba69f4dae403 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:20.302681 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc040b6-a2ab-4bb1-bdda-ede5626267d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:20.303309 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc040b6-a2ab-4bb1-bdda-ede5626267d6 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:20.303587 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc040b6-a2ab-4bb1-bdda-ede5626267d6 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:20.303857 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc040b6-a2ab-4bb1-bdda-ede5626267d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:20.310855 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc040b6-a2ab-4bb1-bdda-ede5626267d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:20.312288 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc040b6-a2ab-4bb1-bdda-ede5626267d6 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:20.323340 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-2fc040b6-a2ab-4bb1-bdda-ede5626267d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:42:20.323340 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:42:20.323340 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:42:20.323340 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:42:20.323340 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:42:20.323340 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:42:20.323340 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:42:20.323340 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:42:20.323340 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:42:20.323340 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:42:20.323340 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:42:20.323340 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:42:20.323340 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:42:20.323340 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:42:20.323340 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:42:20.324455 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:42:20.324455 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:42:20.324455 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:42:20.324455 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:42:20.324455 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:42:20.324455 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:42:20.324455 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:42:20.324455 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:42:20.324455 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:42:20.324455 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:42:20.324455 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:42:20.324455 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:42:20.324455 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:42:20.324455 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:42:20.324455 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:42:20.324455 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:42:20.324455 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:42:20.326023 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:42:20.326023 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:42:20.326023 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:42:20.326023 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:42:20.326023 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:42:20.326023 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:42:20.326023 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:42:20.326023 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:42:20.326023 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 634/1271] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Sep 24 19:42:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:42:20.331285 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91279446-033b-4945-b36f-64cc68b20cb7 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:20.392931 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:20.439317 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91279446-033b-4945-b36f-64cc68b20cb7 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:20.485205 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af30e86-5f70-4ed3-8c5a-61fb9a07ecf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:20.485205 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af30e86-5f70-4ed3-8c5a-61fb9a07ecf9 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:20.485205 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af30e86-5f70-4ed3-8c5a-61fb9a07ecf9 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:20.485205 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af30e86-5f70-4ed3-8c5a-61fb9a07ecf9 None admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:20.486105 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af30e86-5f70-4ed3-8c5a-61fb9a07ecf9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:42:20.486105 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af30e86-5f70-4ed3-8c5a-61fb9a07ecf9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:20.486105 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af30e86-5f70-4ed3-8c5a-61fb9a07ecf9 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:20.490246 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 638/1272] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Sep 24 19:42:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:42:20.496610 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc040b6-a2ab-4bb1-bdda-ede5626267d6 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:20.586855 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:20.596172 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc040b6-a2ab-4bb1-bdda-ede5626267d6 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:20.629531 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52086a43-21a7-44fa-856d-b93c6fcfc4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:20.630316 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52086a43-21a7-44fa-856d-b93c6fcfc4a3 None admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:20.630590 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52086a43-21a7-44fa-856d-b93c6fcfc4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:20.630870 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52086a43-21a7-44fa-856d-b93c6fcfc4a3 None admin] PATH_INFO: `/v3/projects/5c2da88af5714e619238772bde676a42/users/55f19f1385114fa5a921999747a6666b/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:20.632730 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52086a43-21a7-44fa-856d-b93c6fcfc4a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=5c2da88af5714e619238772bde676a42, user_id=55f19f1385114fa5a921999747a6666b, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:20.634184 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52086a43-21a7-44fa-856d-b93c6fcfc4a3 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:20.738933 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 635/1273] 10.222.0.60 () {58 vars in 1439 bytes} [Sat Sep 24 19:42:20 2022] PUT /identity/v3/projects/5c2da88af5714e619238772bde676a42/users/55f19f1385114fa5a921999747a6666b/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:42:22.903893 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8f0b0-7057-464e-a3e2-a55c65f3408d None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:22.904462 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8f0b0-7057-464e-a3e2-a55c65f3408d None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:22.904462 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8f0b0-7057-464e-a3e2-a55c65f3408d None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:22.905848 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 639/1274] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:42:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:42:22.911353 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f2d44-7b75-4d3e-820b-4378b4592e23 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:22.911961 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f2d44-7b75-4d3e-820b-4378b4592e23 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:22.911961 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f2d44-7b75-4d3e-820b-4378b4592e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:22.930655 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-ad5f2d44-7b75-4d3e-820b-4378b4592e23 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:42:22.931743 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-ad5f2d44-7b75-4d3e-820b-4378b4592e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:42:23.008700 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 636/1275] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:42:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:42:23.280043 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a8f0b0-7057-464e-a3e2-a55c65f3408d None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:23.382957 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a8f0b0-7057-464e-a3e2-a55c65f3408d None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:23.400384 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:23.416472 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db80a6-e840-4135-ab4e-3c126569d1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:23.417097 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db80a6-e840-4135-ab4e-3c126569d1d4 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:23.417375 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db80a6-e840-4135-ab4e-3c126569d1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:23.417728 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db80a6-e840-4135-ab4e-3c126569d1d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:23.427515 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11db80a6-e840-4135-ab4e-3c126569d1d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:42:23.432360 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-11db80a6-e840-4135-ab4e-3c126569d1d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:42:23.432360 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:42:23.432360 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:42:23.432360 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:42:23.432360 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:42:23.432360 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:42:23.432360 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:42:23.432360 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:42:23.432360 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:42:23.432360 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:42:23.432360 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:42:23.432360 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:42:23.432360 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:42:23.432360 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:42:23.432360 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:42:23.432360 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:42:23.434366 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:42:23.434366 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:42:23.434366 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:42:23.434366 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:42:23.434366 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:42:23.434366 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:42:23.434366 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:42:23.434366 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:42:23.434366 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:42:23.434366 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:42:23.434366 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:42:23.434366 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:42:23.434366 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:42:23.434366 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:42:23.434366 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:42:23.434366 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:42:23.435256 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:42:23.435256 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:42:23.435256 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:42:23.435256 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:42:23.435256 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:42:23.435256 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:42:23.435256 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:42:23.435256 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:42:23.435256 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:42:23.435256 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:42:23.435256 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:42:23.435256 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:42:23.435256 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 640/1276] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Sep 24 19:42:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:42:23.440501 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f2d44-7b75-4d3e-820b-4378b4592e23 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:23.522030 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:23.544505 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f2d44-7b75-4d3e-820b-4378b4592e23 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:23.578623 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a14748-ee7d-4fd7-9689-089c55e1c686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:23.579225 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a14748-ee7d-4fd7-9689-089c55e1c686 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:23.579622 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a14748-ee7d-4fd7-9689-089c55e1c686 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:23.579891 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a14748-ee7d-4fd7-9689-089c55e1c686 None admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:23.580547 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a14748-ee7d-4fd7-9689-089c55e1c686 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:42:23.580846 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a14748-ee7d-4fd7-9689-089c55e1c686 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:23.582224 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a14748-ee7d-4fd7-9689-089c55e1c686 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:23.591170 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 637/1277] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Sep 24 19:42:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:42:23.596512 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db80a6-e840-4135-ab4e-3c126569d1d4 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:23.697110 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db80a6-e840-4135-ab4e-3c126569d1d4 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:23.731030 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a1d8a-243d-43af-85cb-01f592d58151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:23.731645 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a1d8a-243d-43af-85cb-01f592d58151 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:23.731923 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a1d8a-243d-43af-85cb-01f592d58151 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:23.732191 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a1d8a-243d-43af-85cb-01f592d58151 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:23.742208 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04a1d8a-243d-43af-85cb-01f592d58151 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:23.743640 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04a1d8a-243d-43af-85cb-01f592d58151 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:23.758716 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-d04a1d8a-243d-43af-85cb-01f592d58151 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:42:23.758716 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:42:23.758716 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:42:23.758716 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:42:23.758716 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:42:23.758716 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:42:23.758716 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:42:23.758716 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:42:23.758716 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:42:23.758716 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:42:23.758716 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:42:23.758716 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:42:23.758716 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:42:23.758716 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:42:23.758716 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:42:23.758716 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:42:23.764456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:42:23.764456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:42:23.764456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:42:23.764456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:42:23.764456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:42:23.764456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:42:23.764456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:42:23.764456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:42:23.764456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:42:23.764456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:42:23.764456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:42:23.764456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:42:23.764456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:42:23.764456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:42:23.764456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:42:23.764456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:42:23.764456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:42:23.765477 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:42:23.765477 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:42:23.765477 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:42:23.765477 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 641/1278] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:42:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:42:23.765816 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a14748-ee7d-4fd7-9689-089c55e1c686 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:23.867654 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a14748-ee7d-4fd7-9689-089c55e1c686 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:23.901286 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa27a6-60e5-459c-b8be-db43f22ec945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:23.901910 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa27a6-60e5-459c-b8be-db43f22ec945 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:23.902303 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa27a6-60e5-459c-b8be-db43f22ec945 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:23.902745 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa27a6-60e5-459c-b8be-db43f22ec945 None admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:23.903377 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daa27a6-60e5-459c-b8be-db43f22ec945 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:42:23.903679 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daa27a6-60e5-459c-b8be-db43f22ec945 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:23.905034 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daa27a6-60e5-459c-b8be-db43f22ec945 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:23.916356 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 638/1279] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:42:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:42:23.922674 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a1d8a-243d-43af-85cb-01f592d58151 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:23.952795 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:24.019055 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a1d8a-243d-43af-85cb-01f592d58151 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:24.053785 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40cf70d-1365-4757-b2d4-e2a32e9ea979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:24.054400 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40cf70d-1365-4757-b2d4-e2a32e9ea979 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:24.054676 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40cf70d-1365-4757-b2d4-e2a32e9ea979 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:24.054947 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40cf70d-1365-4757-b2d4-e2a32e9ea979 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:24.061684 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40cf70d-1365-4757-b2d4-e2a32e9ea979 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:24.063136 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40cf70d-1365-4757-b2d4-e2a32e9ea979 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:24.074583 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-a40cf70d-1365-4757-b2d4-e2a32e9ea979 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 24 19:42:24.074583 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:42:24.074583 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:42:24.074583 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:42:24.074583 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:42:24.074583 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:42:24.074583 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:42:24.074583 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:42:24.074583 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:42:24.074583 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:42:24.074583 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:42:24.074583 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:42:24.074583 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:42:24.074583 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:42:24.074583 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:42:24.074583 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:42:24.076304 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:42:24.076304 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:42:24.076304 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:42:24.076304 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:42:24.076304 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:42:24.076304 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:42:24.076304 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:42:24.076304 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:42:24.076304 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:42:24.076304 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:42:24.076304 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:42:24.076304 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:42:24.076304 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:42:24.076304 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:42:24.076304 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:42:24.076304 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:42:24.076304 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:42:24.076304 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:42:24.077930 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:42:24.077930 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:42:24.077930 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:42:24.077930 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:42:24.077930 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:42:24.077930 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:42:24.077930 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:42:24.077930 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:42:24.077930 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 24 19:42:24.077930 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:42:24.077930 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 642/1280] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:42:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:42:24.081700 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa27a6-60e5-459c-b8be-db43f22ec945 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:24.086072 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:24.181053 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa27a6-60e5-459c-b8be-db43f22ec945 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:24.213465 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38adafc-7ad5-46cb-9e88-b2e3f4b191c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:24.216930 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38adafc-7ad5-46cb-9e88-b2e3f4b191c6 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:24.216930 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38adafc-7ad5-46cb-9e88-b2e3f4b191c6 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:24.216930 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38adafc-7ad5-46cb-9e88-b2e3f4b191c6 None admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:24.216930 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38adafc-7ad5-46cb-9e88-b2e3f4b191c6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:42:24.216930 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38adafc-7ad5-46cb-9e88-b2e3f4b191c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:24.217630 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38adafc-7ad5-46cb-9e88-b2e3f4b191c6 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:24.234943 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 639/1281] 10.222.0.60 () {56 vars in 1143 bytes} [Sat Sep 24 19:42:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:42:24.240679 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40cf70d-1365-4757-b2d4-e2a32e9ea979 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:24.327974 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:24.337010 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40cf70d-1365-4757-b2d4-e2a32e9ea979 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:24.368912 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfae587-a888-4f15-bbf2-1638820ba49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:24.369516 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfae587-a888-4f15-bbf2-1638820ba49c None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:24.370056 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfae587-a888-4f15-bbf2-1638820ba49c None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:24.370322 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfae587-a888-4f15-bbf2-1638820ba49c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:24.437934 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfae587-a888-4f15-bbf2-1638820ba49c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:24.439298 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfae587-a888-4f15-bbf2-1638820ba49c None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:24.526566 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:24.536811 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 643/1282] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Sep 24 19:42:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 19:42:24.543340 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38adafc-7ad5-46cb-9e88-b2e3f4b191c6 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:24.606820 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:24.644872 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38adafc-7ad5-46cb-9e88-b2e3f4b191c6 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:24.678521 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bd8e5f-64fd-4de1-81e7-ffdc160e9876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:24.679141 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd8e5f-64fd-4de1-81e7-ffdc160e9876 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:24.679419 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd8e5f-64fd-4de1-81e7-ffdc160e9876 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:24.679682 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd8e5f-64fd-4de1-81e7-ffdc160e9876 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:24.690505 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bd8e5f-64fd-4de1-81e7-ffdc160e9876 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:24.691869 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bd8e5f-64fd-4de1-81e7-ffdc160e9876 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:24.706800 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-86bd8e5f-64fd-4de1-81e7-ffdc160e9876 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:42:24.706800 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:42:24.706800 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:42:24.706800 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:42:24.706800 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:42:24.706800 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:42:24.706800 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:42:24.706800 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:42:24.706800 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:42:24.706800 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:42:24.706800 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:42:24.706800 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:42:24.706800 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:42:24.706800 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:42:24.706800 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:42:24.706800 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:42:24.707962 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:42:24.707962 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:42:24.707962 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:42:24.707962 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:42:24.707962 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:42:24.707962 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:42:24.707962 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:42:24.707962 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:42:24.707962 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:42:24.707962 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:42:24.707962 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:42:24.707962 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:42:24.707962 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:42:24.707962 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:42:24.707962 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:42:24.707962 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:42:24.707962 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:42:24.709050 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:42:24.709050 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:42:24.709050 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:42:24.709050 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 640/1283] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:42:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:42:24.713661 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfae587-a888-4f15-bbf2-1638820ba49c None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:24.819755 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfae587-a888-4f15-bbf2-1638820ba49c None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:24.852624 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d2eae-b540-4c7b-8358-2ba54794fe14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:24.853218 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d2eae-b540-4c7b-8358-2ba54794fe14 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:24.853516 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d2eae-b540-4c7b-8358-2ba54794fe14 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:24.853791 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d2eae-b540-4c7b-8358-2ba54794fe14 None admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:24.854421 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6d2eae-b540-4c7b-8358-2ba54794fe14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:42:24.854719 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6d2eae-b540-4c7b-8358-2ba54794fe14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:24.856186 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6d2eae-b540-4c7b-8358-2ba54794fe14 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:24.866981 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 644/1284] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Sep 24 19:42:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:42:24.873795 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bd8e5f-64fd-4de1-81e7-ffdc160e9876 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:24.976877 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bd8e5f-64fd-4de1-81e7-ffdc160e9876 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:24.990396 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:25.010870 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f9fbc-0dae-4727-ae58-da99fd0bcda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:25.011553 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f9fbc-0dae-4727-ae58-da99fd0bcda3 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:25.012431 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f9fbc-0dae-4727-ae58-da99fd0bcda3 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:25.012698 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f9fbc-0dae-4727-ae58-da99fd0bcda3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:25.019257 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2f9fbc-0dae-4727-ae58-da99fd0bcda3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:25.020788 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2f9fbc-0dae-4727-ae58-da99fd0bcda3 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:25.033134 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-6c2f9fbc-0dae-4727-ae58-da99fd0bcda3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:42:25.033134 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:42:25.033134 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:42:25.033134 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:42:25.033134 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:42:25.033134 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:42:25.033134 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:42:25.033134 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:42:25.033134 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:42:25.033134 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:42:25.033134 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:42:25.033134 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:42:25.033134 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:42:25.033134 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:42:25.033134 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:42:25.034130 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:42:25.034130 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:42:25.034130 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:42:25.034130 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:42:25.034130 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:42:25.034130 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:42:25.034130 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:42:25.034130 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:42:25.034130 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 19:42:25.034130 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:42:25.034130 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:42:25.034130 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:42:25.034130 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:42:25.034130 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:42:25.034130 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:42:25.034130 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:42:25.034130 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:42:25.035110 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:42:25.035110 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:42:25.035110 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:42:25.035110 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:42:25.035110 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:42:25.035110 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:42:25.035110 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:42:25.035110 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 19:42:25.035110 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 641/1285] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Sep 24 19:42:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:42:25.040246 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d2eae-b540-4c7b-8358-2ba54794fe14 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:25.091406 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:25.140947 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d2eae-b540-4c7b-8358-2ba54794fe14 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:25.173140 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b575b-6a76-40e5-9266-81aa9f693f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:25.173770 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b575b-6a76-40e5-9266-81aa9f693f4e None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:25.174054 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b575b-6a76-40e5-9266-81aa9f693f4e None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:25.174328 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b575b-6a76-40e5-9266-81aa9f693f4e None admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:25.175014 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6b575b-6a76-40e5-9266-81aa9f693f4e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:42:25.175319 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6b575b-6a76-40e5-9266-81aa9f693f4e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:25.176760 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6b575b-6a76-40e5-9266-81aa9f693f4e None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:25.188858 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 645/1286] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Sep 24 19:42:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:42:25.194935 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f9fbc-0dae-4727-ae58-da99fd0bcda3 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:25.293437 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f9fbc-0dae-4727-ae58-da99fd0bcda3 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:25.326601 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4492be0a-610a-470b-a37b-5b6de6a2f638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:25.327183 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492be0a-610a-470b-a37b-5b6de6a2f638 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:25.327453 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492be0a-610a-470b-a37b-5b6de6a2f638 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:25.327714 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492be0a-610a-470b-a37b-5b6de6a2f638 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:25.328418 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4492be0a-610a-470b-a37b-5b6de6a2f638 None admin] RBAC: Adding query filter params (role.id=f022705fa6ce43828345ef50b3f7efc9, scope.project.id=5c2da88af5714e619238772bde676a42, user.id=55f19f1385114fa5a921999747a6666b) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:42:25.328716 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4492be0a-610a-470b-a37b-5b6de6a2f638 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:25.330195 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4492be0a-610a-470b-a37b-5b6de6a2f638 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:25.335966 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 642/1287] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Sep 24 19:42:25 2022] GET /identity/v3/role_assignments?user.id=55f19f1385114fa5a921999747a6666b&scope.project.id=5c2da88af5714e619238772bde676a42&role.id=f022705fa6ce43828345ef50b3f7efc9 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:42:27.530146 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d6bad-e859-4893-a1b3-51343d5f510f None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:27.530682 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d6bad-e859-4893-a1b3-51343d5f510f None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:27.530682 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d6bad-e859-4893-a1b3-51343d5f510f None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:27.532036 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 646/1288] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:42:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:42:27.537381 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ddf6ea-d7e9-43f7-a1ca-1b9b622efd8e None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:27.537847 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ddf6ea-d7e9-43f7-a1ca-1b9b622efd8e None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:27.537940 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ddf6ea-d7e9-43f7-a1ca-1b9b622efd8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:27.557186 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-35ddf6ea-d7e9-43f7-a1ca-1b9b622efd8e None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:42:27.559049 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-35ddf6ea-d7e9-43f7-a1ca-1b9b622efd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:42:27.588702 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:27.625247 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 643/1289] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:42:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:42:27.896447 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d6bad-e859-4893-a1b3-51343d5f510f None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:27.996858 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d6bad-e859-4893-a1b3-51343d5f510f None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:28.007048 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:28.029999 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d43a460-670e-4f10-b249-d0c2bebb198a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:28.030613 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43a460-670e-4f10-b249-d0c2bebb198a None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:28.030891 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43a460-670e-4f10-b249-d0c2bebb198a None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:28.031161 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43a460-670e-4f10-b249-d0c2bebb198a None admin] PATH_INFO: `/v3/services/placement` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:28.031738 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d43a460-670e-4f10-b249-d0c2bebb198a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:28.033077 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d43a460-670e-4f10-b249-d0c2bebb198a None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:28.041618 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-9d43a460-670e-4f10-b249-d0c2bebb198a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 24 19:42:28.041618 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:42:28.041618 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:42:28.041618 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:42:28.041618 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:42:28.041618 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:42:28.041618 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:42:28.041618 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:42:28.041618 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 24 19:42:28.041618 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:42:28.041618 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:42:28.041618 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:42:28.041618 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:42:28.041618 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:42:28.041618 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:42:28.041618 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:42:28.041618 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:42:28.046279 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:42:28.046279 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:42:28.046279 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:42:28.046279 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:42:28.046279 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:42:28.046279 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:42:28.046279 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:42:28.046279 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:42:28.046279 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:42:28.046279 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:42:28.046279 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:42:28.046279 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:42:28.046279 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:42:28.046279 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:42:28.046279 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:42:28.046279 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:42:28.047326 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:42:28.047326 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:42:28.047326 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:42:28.047326 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:42:28.047326 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:42:28.047326 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:42:28.047326 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:42:28.047326 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:42:28.047326 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:42:28.047326 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:42:28.047326 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:42:28.047326 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:42:28.047326 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 24 19:42:28.047326 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:42:28.047326 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 647/1290] 10.222.0.60 () {56 vars in 1117 bytes} [Sat Sep 24 19:42:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:42:28.049992 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ddf6ea-d7e9-43f7-a1ca-1b9b622efd8e None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:28.149030 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ddf6ea-d7e9-43f7-a1ca-1b9b622efd8e None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:28.182470 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba5ed6-0234-4328-9669-9c0d227e430b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:28.183064 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba5ed6-0234-4328-9669-9c0d227e430b None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:28.183478 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba5ed6-0234-4328-9669-9c0d227e430b None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:28.183809 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba5ed6-0234-4328-9669-9c0d227e430b None admin] PATH_INFO: `/v3/services` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:28.184442 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba5ed6-0234-4328-9669-9c0d227e430b None admin] RBAC: Adding query filter params (name=placement) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:42:28.184741 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba5ed6-0234-4328-9669-9c0d227e430b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:28.186133 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba5ed6-0234-4328-9669-9c0d227e430b None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:28.194144 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 644/1291] 10.222.0.60 () {56 vars in 1116 bytes} [Sat Sep 24 19:42:28 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:42:28.196957 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d43a460-670e-4f10-b249-d0c2bebb198a None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:28.295392 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d43a460-670e-4f10-b249-d0c2bebb198a None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:28.328255 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9c36b9-c1aa-4a28-a3bc-65bb3d52d115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:28.328849 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c36b9-c1aa-4a28-a3bc-65bb3d52d115 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:28.329133 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c36b9-c1aa-4a28-a3bc-65bb3d52d115 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:28.329402 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c36b9-c1aa-4a28-a3bc-65bb3d52d115 None admin] PATH_INFO: `/v3/services` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:28.330050 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9c36b9-c1aa-4a28-a3bc-65bb3d52d115 None admin] RBAC: Adding query filter params (type=placement) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:42:28.330354 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9c36b9-c1aa-4a28-a3bc-65bb3d52d115 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:28.331725 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9c36b9-c1aa-4a28-a3bc-65bb3d52d115 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:28.335977 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 648/1292] 10.222.0.60 () {56 vars in 1116 bytes} [Sat Sep 24 19:42:28 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:42:30.579909 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18872122-cf2c-489e-8aed-2375b9f197b1 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:30.580485 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18872122-cf2c-489e-8aed-2375b9f197b1 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:30.580485 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18872122-cf2c-489e-8aed-2375b9f197b1 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:30.581821 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 645/1293] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:42:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:42:30.587028 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263517b-d115-42a0-b097-4c3b6bb72b2a None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:30.589110 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263517b-d115-42a0-b097-4c3b6bb72b2a None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:30.589110 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263517b-d115-42a0-b097-4c3b6bb72b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:30.606993 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-e263517b-d115-42a0-b097-4c3b6bb72b2a None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:42:30.608371 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-e263517b-d115-42a0-b097-4c3b6bb72b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:42:30.639409 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:30.678426 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 649/1294] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:42:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:42:30.947196 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18872122-cf2c-489e-8aed-2375b9f197b1 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:30.979163 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:31.049247 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18872122-cf2c-489e-8aed-2375b9f197b1 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:31.083512 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd0634f-e19f-433b-a5df-dfffc99fb066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:31.084112 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0634f-e19f-433b-a5df-dfffc99fb066 None admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:31.084394 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0634f-e19f-433b-a5df-dfffc99fb066 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:31.084660 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0634f-e19f-433b-a5df-dfffc99fb066 None admin] PATH_INFO: `/v3/services` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:31.085298 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd0634f-e19f-433b-a5df-dfffc99fb066 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:31.086693 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd0634f-e19f-433b-a5df-dfffc99fb066 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:31.253613 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 646/1295] 10.222.0.60 () {60 vars in 1141 bytes} [Sat Sep 24 19:42:30 2022] POST /identity/v3/services => generated 246 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:42:33.424871 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a613e3-77d5-4fe5-8516-90a003ce9131 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:33.425473 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a613e3-77d5-4fe5-8516-90a003ce9131 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:33.425473 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a613e3-77d5-4fe5-8516-90a003ce9131 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:33.426796 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 650/1296] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:42:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:42:33.432322 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68071a70-f8ff-468b-8ab5-e9ac2334af08 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:33.432758 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68071a70-f8ff-468b-8ab5-e9ac2334af08 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:33.432856 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68071a70-f8ff-468b-8ab5-e9ac2334af08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:33.451984 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-68071a70-f8ff-468b-8ab5-e9ac2334af08 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:42:33.453152 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-68071a70-f8ff-468b-8ab5-e9ac2334af08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:42:33.532080 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 647/1297] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:42:33 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:42:33.800135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a613e3-77d5-4fe5-8516-90a003ce9131 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:33.903046 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a613e3-77d5-4fe5-8516-90a003ce9131 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:33.946503 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe837eb8-8279-4a02-9916-9a99c32f1095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:33.947041 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe837eb8-8279-4a02-9916-9a99c32f1095 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:33.947314 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe837eb8-8279-4a02-9916-9a99c32f1095 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:33.947580 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe837eb8-8279-4a02-9916-9a99c32f1095 None admin] PATH_INFO: `/v3/services/placement` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:33.948154 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe837eb8-8279-4a02-9916-9a99c32f1095 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:33.949487 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe837eb8-8279-4a02-9916-9a99c32f1095 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:33.959297 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-fe837eb8-8279-4a02-9916-9a99c32f1095 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 24 19:42:33.959297 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:42:33.959297 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:42:33.959297 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:42:33.959297 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:42:33.959297 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:42:33.959297 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:42:33.959297 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:42:33.959297 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 24 19:42:33.959297 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:42:33.959297 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:42:33.959297 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:42:33.959297 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:42:33.959297 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:42:33.959297 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:42:33.959297 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:42:33.959297 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:42:33.966963 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:42:33.966963 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:42:33.966963 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:42:33.966963 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:42:33.966963 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:42:33.966963 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:42:33.966963 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:42:33.966963 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:42:33.966963 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:42:33.966963 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:42:33.966963 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:42:33.966963 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:42:33.966963 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:42:33.966963 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:42:33.966963 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:42:33.966963 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:42:33.968081 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:42:33.968081 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:42:33.968081 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:42:33.968081 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:42:33.968081 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:42:33.968081 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:42:33.968081 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:42:33.968081 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:42:33.968081 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:42:33.968081 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:42:33.968081 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:42:33.968081 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:42:33.968081 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 24 19:42:33.968081 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:42:33.968081 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 651/1298] 10.222.0.60 () {56 vars in 1117 bytes} [Sat Sep 24 19:42:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:42:33.969017 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68071a70-f8ff-468b-8ab5-e9ac2334af08 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:33.984886 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:34.064142 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68071a70-f8ff-468b-8ab5-e9ac2334af08 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:34.097215 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb2722-9b93-4e91-b128-304ae3e84490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:34.097851 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb2722-9b93-4e91-b128-304ae3e84490 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:34.098127 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb2722-9b93-4e91-b128-304ae3e84490 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:34.098415 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb2722-9b93-4e91-b128-304ae3e84490 None admin] PATH_INFO: `/v3/services` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:34.099018 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb2722-9b93-4e91-b128-304ae3e84490 None admin] RBAC: Adding query filter params (name=placement) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:42:34.099320 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb2722-9b93-4e91-b128-304ae3e84490 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:34.100681 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb2722-9b93-4e91-b128-304ae3e84490 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:34.105890 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 648/1299] 10.222.0.60 () {56 vars in 1116 bytes} [Sat Sep 24 19:42:33 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:42:34.114650 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe837eb8-8279-4a02-9916-9a99c32f1095 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:34.149106 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:34.216357 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe837eb8-8279-4a02-9916-9a99c32f1095 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:34.251450 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb17e6-dc21-4669-8028-19ead3d61c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:34.252049 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb17e6-dc21-4669-8028-19ead3d61c94 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:34.252329 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb17e6-dc21-4669-8028-19ead3d61c94 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:34.252599 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb17e6-dc21-4669-8028-19ead3d61c94 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:34.253292 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb17e6-dc21-4669-8028-19ead3d61c94 None admin] RBAC: Adding query filter params (interface=public, service_id=d2dffb5b266b4620bfbbea78af323642, region_id=RegionOne) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:42:34.253627 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb17e6-dc21-4669-8028-19ead3d61c94 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:34.254970 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb17e6-dc21-4669-8028-19ead3d61c94 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:34.259803 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 652/1300] 10.222.0.60 () {56 vars in 1251 bytes} [Sat Sep 24 19:42:34 2022] GET /identity/v3/endpoints?service_id=d2dffb5b266b4620bfbbea78af323642&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:42:34.265549 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb2722-9b93-4e91-b128-304ae3e84490 None admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:34.346941 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:34.364578 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb2722-9b93-4e91-b128-304ae3e84490 None admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:34.398677 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1494ee-7185-46f7-844b-fce1e97b6db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:34.399279 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1494ee-7185-46f7-844b-fce1e97b6db7 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:34.399551 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1494ee-7185-46f7-844b-fce1e97b6db7 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:34.399814 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1494ee-7185-46f7-844b-fce1e97b6db7 None admin] PATH_INFO: `/v3/services` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:34.400404 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1494ee-7185-46f7-844b-fce1e97b6db7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:34.401777 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1494ee-7185-46f7-844b-fce1e97b6db7 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:34.409586 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 649/1301] 10.222.0.60 () {56 vars in 1087 bytes} [Sat Sep 24 19:42:34 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:42:36.601270 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae90030-d809-476c-976b-7484b2c0b22a None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:36.601861 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae90030-d809-476c-976b-7484b2c0b22a None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:36.601861 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae90030-d809-476c-976b-7484b2c0b22a None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:36.603192 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 653/1302] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:42:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:42:36.608465 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fed1c2-3ae7-4c8e-8249-ca5372b43736 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:36.608879 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fed1c2-3ae7-4c8e-8249-ca5372b43736 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:36.609012 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fed1c2-3ae7-4c8e-8249-ca5372b43736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:36.627498 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-18fed1c2-3ae7-4c8e-8249-ca5372b43736 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:42:36.628687 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-18fed1c2-3ae7-4c8e-8249-ca5372b43736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:42:36.704916 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 650/1303] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:42:36 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:42:36.976607 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae90030-d809-476c-976b-7484b2c0b22a None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:37.070161 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:37.077657 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae90030-d809-476c-976b-7484b2c0b22a None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:37.111491 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227384c8-9934-4e4a-ba3b-4ec1b04c6be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:37.112106 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227384c8-9934-4e4a-ba3b-4ec1b04c6be1 None admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:37.112381 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227384c8-9934-4e4a-ba3b-4ec1b04c6be1 None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:37.112649 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227384c8-9934-4e4a-ba3b-4ec1b04c6be1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:37.113220 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227384c8-9934-4e4a-ba3b-4ec1b04c6be1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:37.114585 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227384c8-9934-4e4a-ba3b-4ec1b04c6be1 None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:37.123547 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application [None req-227384c8-9934-4e4a-ba3b-4ec1b04c6be1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 24 19:42:37.123547 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:42:37.123547 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:42:37.123547 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:42:37.123547 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:42:37.123547 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:42:37.123547 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:42:37.123547 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:42:37.123547 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 24 19:42:37.123547 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:42:37.123547 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:42:37.123547 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:42:37.123547 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:42:37.123547 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:42:37.123547 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:42:37.123547 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:42:37.123547 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:42:37.124716 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:42:37.124716 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:42:37.124716 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:42:37.124716 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:42:37.124716 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:42:37.124716 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:42:37.124716 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:42:37.124716 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:42:37.124716 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:42:37.124716 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:42:37.124716 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:42:37.124716 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:42:37.124716 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:42:37.124716 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:42:37.124716 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:42:37.124716 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:42:37.127306 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:42:37.127306 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application with Lock( Sep 24 19:42:37.127306 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:42:37.127306 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:42:37.127306 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:42:37.127306 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:42:37.127306 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:42:37.127306 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:42:37.127306 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:42:37.127306 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:42:37.127306 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:42:37.127306 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:42:37.127306 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 24 19:42:37.127306 dv-cinder-859191-1-smb devstack@keystone.service[93400]: ERROR keystone.server.flask.application Sep 24 19:42:37.127306 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 654/1304] 10.222.0.60 () {56 vars in 1117 bytes} [Sat Sep 24 19:42:36 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:42:37.130704 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fed1c2-3ae7-4c8e-8249-ca5372b43736 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:37.206732 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:37.230698 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fed1c2-3ae7-4c8e-8249-ca5372b43736 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:37.263800 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a5d7f-ef49-4749-8f35-ae0bbc3447e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:37.264468 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a5d7f-ef49-4749-8f35-ae0bbc3447e4 None admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:37.264742 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a5d7f-ef49-4749-8f35-ae0bbc3447e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:37.265007 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a5d7f-ef49-4749-8f35-ae0bbc3447e4 None admin] PATH_INFO: `/v3/services` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:37.265651 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713a5d7f-ef49-4749-8f35-ae0bbc3447e4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:42:37.265948 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713a5d7f-ef49-4749-8f35-ae0bbc3447e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:37.267337 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713a5d7f-ef49-4749-8f35-ae0bbc3447e4 None admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:37.272438 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 651/1305] 10.222.0.60 () {56 vars in 1116 bytes} [Sat Sep 24 19:42:37 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:42:37.282853 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227384c8-9934-4e4a-ba3b-4ec1b04c6be1 None admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:37.376980 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227384c8-9934-4e4a-ba3b-4ec1b04c6be1 None admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:37.409982 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e1296a-a67f-4f40-9281-106c795a2b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:37.410710 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e1296a-a67f-4f40-9281-106c795a2b4b None admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:37.410987 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e1296a-a67f-4f40-9281-106c795a2b4b None admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:37.411255 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e1296a-a67f-4f40-9281-106c795a2b4b None admin] PATH_INFO: `/v3/endpoints` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:37.411932 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e1296a-a67f-4f40-9281-106c795a2b4b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:37.413276 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e1296a-a67f-4f40-9281-106c795a2b4b None admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:37.547900 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 655/1306] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:42:37 2022] POST /identity/v3/endpoints => generated 331 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:42:47.302095 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=30 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:47.543035 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:49:18.826080 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f4466-f401-46e9-8929-e33dcfcfc23c None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:49:18.826719 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f4466-f401-46e9-8929-e33dcfcfc23c None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:49:18.826719 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f4466-f401-46e9-8929-e33dcfcfc23c None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:49:18.828080 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 652/1307] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:49:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:49:18.834992 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad6903-d812-4647-94ca-e2ebf07a0c3f None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:49:18.835461 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad6903-d812-4647-94ca-e2ebf07a0c3f None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:49:18.835564 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad6903-d812-4647-94ca-e2ebf07a0c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:49:18.935266 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-99ad6903-d812-4647-94ca-e2ebf07a0c3f None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:49:18.937252 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-99ad6903-d812-4647-94ca-e2ebf07a0c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:49:19.063269 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 656/1308] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:49:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:49:19.370692 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63526a85-e9a2-4df2-90e6-d6451956c635 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:49:19.371658 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63526a85-e9a2-4df2-90e6-d6451956c635 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:49:19.372075 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63526a85-e9a2-4df2-90e6-d6451956c635 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:49:19.374162 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 653/1309] 10.222.0.60 () {54 vars in 964 bytes} [Sat Sep 24 19:49:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:49:19.384065 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f6578-7234-4ec8-a058-2d5c8da31ac8 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:49:19.384513 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f6578-7234-4ec8-a058-2d5c8da31ac8 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:49:19.384960 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f6578-7234-4ec8-a058-2d5c8da31ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:49:19.488257 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-8d7f6578-7234-4ec8-a058-2d5c8da31ac8 None None] MFA Rules not processed for user `fed7dee25fd54255ad24cd6ad880fa3f`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:49:19.489488 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-8d7f6578-7234-4ec8-a058-2d5c8da31ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:49:19.514298 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:49:19.585141 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 657/1310] 10.222.0.60 () {58 vars in 1061 bytes} [Sat Sep 24 19:49:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:49:19.598354 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63526a85-e9a2-4df2-90e6-d6451956c635 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:49:19.600363 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-63526a85-e9a2-4df2-90e6-d6451956c635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:49:19.729729 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63526a85-e9a2-4df2-90e6-d6451956c635 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:49:19.834023 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fa82f9-2395-410c-8255-7b6404318164 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:49:19.834693 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa82f9-2395-410c-8255-7b6404318164 service neutron] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:49:19.836305 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa82f9-2395-410c-8255-7b6404318164 service neutron] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:49:19.836597 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa82f9-2395-410c-8255-7b6404318164 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:49:19.838416 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-d7fa82f9-2395-410c-8255-7b6404318164 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:49:19.907890 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:49:19.977396 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fa82f9-2395-410c-8255-7b6404318164 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:49:19.979004 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fa82f9-2395-410c-8255-7b6404318164 service neutron] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:49:20.005317 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 654/1311] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:49:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:49:22.856890 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2df55-8341-49ff-9f77-dd61f5aa4e37 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:49:22.857474 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2df55-8341-49ff-9f77-dd61f5aa4e37 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:49:22.857474 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2df55-8341-49ff-9f77-dd61f5aa4e37 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:49:22.859753 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 658/1312] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:49:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:49:22.865311 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8fbc1-8779-4abf-be46-86868d3dae3a None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:49:22.865749 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8fbc1-8779-4abf-be46-86868d3dae3a None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:49:22.865876 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8fbc1-8779-4abf-be46-86868d3dae3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:49:22.938760 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-10b8fbc1-8779-4abf-be46-86868d3dae3a None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:49:22.939970 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-10b8fbc1-8779-4abf-be46-86868d3dae3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:49:23.040585 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 655/1313] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:49:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:49:23.325116 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c2df55-8341-49ff-9f77-dd61f5aa4e37 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:49:23.326972 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-11c2df55-8341-49ff-9f77-dd61f5aa4e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:49:23.435419 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c2df55-8341-49ff-9f77-dd61f5aa4e37 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:49:23.523172 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:49:23.525527 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b128e74-733b-4823-b858-76220bc00c94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:49:23.526132 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b128e74-733b-4823-b858-76220bc00c94 service neutron] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:49:23.526413 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b128e74-733b-4823-b858-76220bc00c94 service neutron] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:49:23.526687 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b128e74-733b-4823-b858-76220bc00c94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:49:23.528287 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-0b128e74-733b-4823-b858-76220bc00c94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:49:23.644198 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b128e74-733b-4823-b858-76220bc00c94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:49:23.645577 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b128e74-733b-4823-b858-76220bc00c94 service neutron] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:49:23.665247 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 659/1314] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:49:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:49:26.423360 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d764c-731c-4078-90cb-d21eda51b5ef None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:49:26.423914 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d764c-731c-4078-90cb-d21eda51b5ef None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:49:26.423914 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d764c-731c-4078-90cb-d21eda51b5ef None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:49:26.425239 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 656/1315] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:49:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:49:26.430948 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e0dc7-133a-4ef0-8bba-3b41f5a7f504 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:49:26.431390 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e0dc7-133a-4ef0-8bba-3b41f5a7f504 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:49:26.431480 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e0dc7-133a-4ef0-8bba-3b41f5a7f504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:49:26.508601 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-9d9e0dc7-133a-4ef0-8bba-3b41f5a7f504 None None] MFA Rules not processed for user `517c8b8a3dbb4c26bb946e9641d03bb6`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:49:26.509861 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-9d9e0dc7-133a-4ef0-8bba-3b41f5a7f504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:49:26.574217 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:49:26.628322 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 660/1316] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:49:26 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:49:26.934943 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4d764c-731c-4078-90cb-d21eda51b5ef None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:49:26.937001 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-2e4d764c-731c-4078-90cb-d21eda51b5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:49:26.946754 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:49:27.056242 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4d764c-731c-4078-90cb-d21eda51b5ef None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:49:27.135550 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5e80d-0a98-483f-afe4-3d04aa260654 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:49:27.136354 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5e80d-0a98-483f-afe4-3d04aa260654 service neutron] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:49:27.136826 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5e80d-0a98-483f-afe4-3d04aa260654 service neutron] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:49:27.137263 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5e80d-0a98-483f-afe4-3d04aa260654 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:49:27.140749 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-1ad5e80d-0a98-483f-afe4-3d04aa260654 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:49:27.211994 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:49:27.271026 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad5e80d-0a98-483f-afe4-3d04aa260654 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:49:27.273192 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad5e80d-0a98-483f-afe4-3d04aa260654 service neutron] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:49:27.300849 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 657/1317] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:49:26 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:49:30.389951 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab14e3-50b4-408a-8126-b9f0d3c6335e None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:49:30.390897 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab14e3-50b4-408a-8126-b9f0d3c6335e None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:49:30.391175 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab14e3-50b4-408a-8126-b9f0d3c6335e None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:49:30.392548 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 661/1318] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:49:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:49:30.398253 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617eda66-8fa7-4600-bf85-10823bad4b50 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:49:30.398679 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617eda66-8fa7-4600-bf85-10823bad4b50 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:49:30.398777 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617eda66-8fa7-4600-bf85-10823bad4b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:49:30.472039 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-617eda66-8fa7-4600-bf85-10823bad4b50 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:49:30.473779 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-617eda66-8fa7-4600-bf85-10823bad4b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:49:30.575377 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 658/1319] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:49:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:49:30.866314 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab14e3-50b4-408a-8126-b9f0d3c6335e None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:49:30.867822 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-c9ab14e3-50b4-408a-8126-b9f0d3c6335e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:49:30.972110 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab14e3-50b4-408a-8126-b9f0d3c6335e None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:49:31.044431 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9bbcc0-3358-4dee-afc2-16fd05b347b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:49:31.045680 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9bbcc0-3358-4dee-afc2-16fd05b347b5 service neutron] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:49:31.045956 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9bbcc0-3358-4dee-afc2-16fd05b347b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:49:31.046222 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9bbcc0-3358-4dee-afc2-16fd05b347b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:49:31.047791 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-6d9bbcc0-3358-4dee-afc2-16fd05b347b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:49:31.054475 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:49:31.272848 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9bbcc0-3358-4dee-afc2-16fd05b347b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:49:31.274208 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9bbcc0-3358-4dee-afc2-16fd05b347b5 service neutron] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:49:31.293275 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 662/1320] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:49:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:49:34.606881 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a53da-ca52-4e05-884a-f37c399e6e4b None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:49:34.607477 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a53da-ca52-4e05-884a-f37c399e6e4b None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:49:34.607477 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a53da-ca52-4e05-884a-f37c399e6e4b None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:49:34.609233 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 659/1321] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:49:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:49:34.615303 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d4755-3c16-4079-a0f7-4c42d6e700c8 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:49:34.615787 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d4755-3c16-4079-a0f7-4c42d6e700c8 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:49:34.615903 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d4755-3c16-4079-a0f7-4c42d6e700c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:49:34.699863 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-f66d4755-3c16-4079-a0f7-4c42d6e700c8 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:49:34.701177 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-f66d4755-3c16-4079-a0f7-4c42d6e700c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:49:34.763050 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:49:34.806643 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 663/1322] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:49:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:49:35.110431 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4f47b-7305-4172-8e61-36962e507f9e None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:49:35.110720 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4f47b-7305-4172-8e61-36962e507f9e None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:49:35.111086 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4f47b-7305-4172-8e61-36962e507f9e None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:49:35.112834 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 660/1323] 10.222.0.60 () {54 vars in 964 bytes} [Sat Sep 24 19:49:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:49:35.119749 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca9104-1fdf-4271-be1d-fbcd31fb95ad None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:49:35.120137 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca9104-1fdf-4271-be1d-fbcd31fb95ad None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:49:35.120479 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca9104-1fdf-4271-be1d-fbcd31fb95ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:49:35.210680 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-62ca9104-1fdf-4271-be1d-fbcd31fb95ad None None] MFA Rules not processed for user `fed7dee25fd54255ad24cd6ad880fa3f`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:49:35.211979 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-62ca9104-1fdf-4271-be1d-fbcd31fb95ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:49:35.299855 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 664/1324] 10.222.0.60 () {58 vars in 1061 bytes} [Sat Sep 24 19:49:35 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:49:35.309521 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f4f47b-7305-4172-8e61-36962e507f9e None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:49:35.311152 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-f9f4f47b-7305-4172-8e61-36962e507f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:49:35.332926 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:49:35.431913 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f4f47b-7305-4172-8e61-36962e507f9e None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:49:35.531787 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f1e299-b90e-48a3-85fc-91a5311cf557 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:49:35.532487 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1e299-b90e-48a3-85fc-91a5311cf557 service neutron] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:49:35.532763 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1e299-b90e-48a3-85fc-91a5311cf557 service neutron] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:49:35.533030 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1e299-b90e-48a3-85fc-91a5311cf557 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:49:35.534678 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-d1f1e299-b90e-48a3-85fc-91a5311cf557 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:49:35.611900 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:49:35.651887 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f1e299-b90e-48a3-85fc-91a5311cf557 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:49:35.653376 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f1e299-b90e-48a3-85fc-91a5311cf557 service neutron] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:49:35.680761 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 661/1325] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:49:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 19:49:38.185622 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91f36a-3fdf-4564-8b0a-e4b4760ce364 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:49:38.186184 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91f36a-3fdf-4564-8b0a-e4b4760ce364 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:49:38.186184 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91f36a-3fdf-4564-8b0a-e4b4760ce364 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:49:38.187601 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 665/1326] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:49:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:49:38.192964 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021c9b7-34aa-433a-b616-964e65c6f0d2 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:49:38.193760 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021c9b7-34aa-433a-b616-964e65c6f0d2 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:49:38.193760 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021c9b7-34aa-433a-b616-964e65c6f0d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:49:38.268796 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-6021c9b7-34aa-433a-b616-964e65c6f0d2 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:49:38.270088 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-6021c9b7-34aa-433a-b616-964e65c6f0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:49:38.380096 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 662/1327] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:49:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:49:38.669848 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91f36a-3fdf-4564-8b0a-e4b4760ce364 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:49:38.671654 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-af91f36a-3fdf-4564-8b0a-e4b4760ce364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:49:38.738544 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:49:38.785719 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91f36a-3fdf-4564-8b0a-e4b4760ce364 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:49:38.875879 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49211a8a-e3f1-4f9a-982f-6697c35d39bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:49:38.878339 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49211a8a-e3f1-4f9a-982f-6697c35d39bf service neutron] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:49:38.878339 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49211a8a-e3f1-4f9a-982f-6697c35d39bf service neutron] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:49:38.878339 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49211a8a-e3f1-4f9a-982f-6697c35d39bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:49:38.878694 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-49211a8a-e3f1-4f9a-982f-6697c35d39bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:49:38.993438 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:49:38.995395 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49211a8a-e3f1-4f9a-982f-6697c35d39bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:49:38.996848 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49211a8a-e3f1-4f9a-982f-6697c35d39bf service neutron] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:49:39.016051 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 666/1328] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:49:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:49:41.280953 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a9c8b-8161-41c6-a32a-9160fdbec786 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:49:41.281547 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a9c8b-8161-41c6-a32a-9160fdbec786 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:49:41.281547 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a9c8b-8161-41c6-a32a-9160fdbec786 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:49:41.282864 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 663/1329] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:49:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:49:41.288243 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f7199-1b27-46fe-9944-70272cb0dce1 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:49:41.288667 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f7199-1b27-46fe-9944-70272cb0dce1 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:49:41.288777 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f7199-1b27-46fe-9944-70272cb0dce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:49:41.364372 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-f42f7199-1b27-46fe-9944-70272cb0dce1 None None] MFA Rules not processed for user `517c8b8a3dbb4c26bb946e9641d03bb6`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:49:41.365607 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-f42f7199-1b27-46fe-9944-70272cb0dce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:49:41.472032 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 667/1330] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:49:41 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:49:41.759391 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a9c8b-8161-41c6-a32a-9160fdbec786 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:49:41.760943 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-c10a9c8b-8161-41c6-a32a-9160fdbec786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:49:41.793457 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:49:41.870203 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a9c8b-8161-41c6-a32a-9160fdbec786 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:49:41.945514 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11db502-20e3-49c4-9183-9611d6e7f384 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:49:41.946014 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11db502-20e3-49c4-9183-9611d6e7f384 service neutron] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:49:41.946295 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11db502-20e3-49c4-9183-9611d6e7f384 service neutron] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:49:41.946567 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11db502-20e3-49c4-9183-9611d6e7f384 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:49:41.948158 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-c11db502-20e3-49c4-9183-9611d6e7f384 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:49:42.029077 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:49:42.060908 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11db502-20e3-49c4-9183-9611d6e7f384 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:49:42.063035 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11db502-20e3-49c4-9183-9611d6e7f384 service neutron] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:49:42.083603 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 664/1331] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:49:41 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 19:49:44.724235 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a334ac-7c49-4910-98a0-bd0bb2b15284 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:49:44.724953 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a334ac-7c49-4910-98a0-bd0bb2b15284 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:49:44.724953 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a334ac-7c49-4910-98a0-bd0bb2b15284 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:49:44.726167 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 668/1332] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:49:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:49:44.732309 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758be71-bd91-44cb-92ce-dd7f1a8d1c72 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:49:44.733071 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758be71-bd91-44cb-92ce-dd7f1a8d1c72 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:49:44.733071 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758be71-bd91-44cb-92ce-dd7f1a8d1c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:49:44.807947 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-c758be71-bd91-44cb-92ce-dd7f1a8d1c72 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:49:44.809174 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-c758be71-bd91-44cb-92ce-dd7f1a8d1c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:49:44.908092 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 665/1333] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:49:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:49:45.187534 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a334ac-7c49-4910-98a0-bd0bb2b15284 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:49:45.189056 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-e2a334ac-7c49-4910-98a0-bd0bb2b15284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:49:45.262270 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:49:45.298093 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a334ac-7c49-4910-98a0-bd0bb2b15284 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:49:45.376867 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc7fea7-1adc-4f16-a88b-e6fb92c06bef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:49:45.377573 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc7fea7-1adc-4f16-a88b-e6fb92c06bef service neutron] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:49:45.377778 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc7fea7-1adc-4f16-a88b-e6fb92c06bef service neutron] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:49:45.378035 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc7fea7-1adc-4f16-a88b-e6fb92c06bef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:49:45.379661 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-afc7fea7-1adc-4f16-a88b-e6fb92c06bef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:49:45.497960 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc7fea7-1adc-4f16-a88b-e6fb92c06bef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:49:45.499873 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc7fea7-1adc-4f16-a88b-e6fb92c06bef service neutron] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:49:45.509560 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:49:45.517573 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 669/1334] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:49:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:49:47.794501 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67628e07-0a20-4c17-9d4b-d9b0a4ea7c06 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:49:47.795069 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67628e07-0a20-4c17-9d4b-d9b0a4ea7c06 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:49:47.795069 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67628e07-0a20-4c17-9d4b-d9b0a4ea7c06 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:49:47.796472 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 666/1335] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:49:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:49:47.801924 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a205c3-67f2-4caf-a383-2cbe0c1482e7 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:49:47.802442 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a205c3-67f2-4caf-a383-2cbe0c1482e7 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:49:47.802442 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a205c3-67f2-4caf-a383-2cbe0c1482e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:49:47.870028 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-f8a205c3-67f2-4caf-a383-2cbe0c1482e7 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:49:47.871239 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-f8a205c3-67f2-4caf-a383-2cbe0c1482e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:49:47.974390 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 670/1336] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:49:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:49:48.267088 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67628e07-0a20-4c17-9d4b-d9b0a4ea7c06 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:49:48.268626 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-67628e07-0a20-4c17-9d4b-d9b0a4ea7c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:49:48.308766 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:49:48.374686 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67628e07-0a20-4c17-9d4b-d9b0a4ea7c06 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:49:48.450026 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f21187-54a7-47ea-b929-1cfdf11a3fda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:49:48.450631 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f21187-54a7-47ea-b929-1cfdf11a3fda service neutron] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:49:48.450909 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f21187-54a7-47ea-b929-1cfdf11a3fda service neutron] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:49:48.451185 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f21187-54a7-47ea-b929-1cfdf11a3fda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:49:48.453360 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-c3f21187-54a7-47ea-b929-1cfdf11a3fda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:49:48.538410 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:49:48.565684 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f21187-54a7-47ea-b929-1cfdf11a3fda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:49:48.567289 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f21187-54a7-47ea-b929-1cfdf11a3fda service neutron] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:49:48.586888 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 667/1337] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:49:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:49:51.390474 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a5552-272e-465b-bf56-2a692b2f5c48 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:49:51.391049 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a5552-272e-465b-bf56-2a692b2f5c48 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:49:51.391049 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a5552-272e-465b-bf56-2a692b2f5c48 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:49:51.392343 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 671/1338] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:49:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:49:51.400340 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761e7ae-01d5-4e7a-94fd-35b867d2ee83 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:49:51.400883 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761e7ae-01d5-4e7a-94fd-35b867d2ee83 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:49:51.401170 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761e7ae-01d5-4e7a-94fd-35b867d2ee83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:49:51.469374 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-7761e7ae-01d5-4e7a-94fd-35b867d2ee83 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:49:51.470612 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-7761e7ae-01d5-4e7a-94fd-35b867d2ee83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:49:51.565806 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 668/1339] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:49:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:49:51.855876 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a5552-272e-465b-bf56-2a692b2f5c48 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:49:51.867158 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-6c5a5552-272e-465b-bf56-2a692b2f5c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:49:51.944728 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:49:51.977294 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a5552-272e-465b-bf56-2a692b2f5c48 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:49:52.074101 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8022d4d7-2878-40f8-b8c4-8fc70a050b16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:49:52.074719 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8022d4d7-2878-40f8-b8c4-8fc70a050b16 service neutron] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:49:52.074989 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8022d4d7-2878-40f8-b8c4-8fc70a050b16 service neutron] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:49:52.075259 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8022d4d7-2878-40f8-b8c4-8fc70a050b16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:49:52.076915 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-8022d4d7-2878-40f8-b8c4-8fc70a050b16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:49:52.191627 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8022d4d7-2878-40f8-b8c4-8fc70a050b16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:49:52.193208 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8022d4d7-2878-40f8-b8c4-8fc70a050b16 service neutron] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:49:52.211214 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 672/1340] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:49:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:49:57.193459 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b988a52-e32b-4f08-8ff1-1b9e143e601b None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:49:57.193937 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b988a52-e32b-4f08-8ff1-1b9e143e601b None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:49:57.194051 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b988a52-e32b-4f08-8ff1-1b9e143e601b None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:49:57.197269 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 669/1341] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:49:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:49:57.207401 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182672b-1022-4b1a-a422-fad0758f9d8b None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:49:57.207401 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182672b-1022-4b1a-a422-fad0758f9d8b None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:49:57.207401 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182672b-1022-4b1a-a422-fad0758f9d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:49:57.210222 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:49:57.277260 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-0182672b-1022-4b1a-a422-fad0758f9d8b None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:49:57.278517 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-0182672b-1022-4b1a-a422-fad0758f9d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:49:57.382698 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 673/1342] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:49:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:49:57.666331 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b988a52-e32b-4f08-8ff1-1b9e143e601b None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:49:57.667876 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-9b988a52-e32b-4f08-8ff1-1b9e143e601b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:49:57.722029 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:49:57.779255 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b988a52-e32b-4f08-8ff1-1b9e143e601b None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:49:57.857274 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ddf381-898e-4472-b84e-094e3d8a5b4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:49:57.858602 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ddf381-898e-4472-b84e-094e3d8a5b4d service neutron] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:49:57.859396 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ddf381-898e-4472-b84e-094e3d8a5b4d service neutron] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:49:57.859670 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ddf381-898e-4472-b84e-094e3d8a5b4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:49:57.861326 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-03ddf381-898e-4472-b84e-094e3d8a5b4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:49:57.963107 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:49:57.980755 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ddf381-898e-4472-b84e-094e3d8a5b4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:49:57.982520 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ddf381-898e-4472-b84e-094e3d8a5b4d service neutron] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:49:58.008837 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 670/1343] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:49:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:50:01.249099 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1f9c1-64fe-4a62-945b-1a827d390d86 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:50:01.249675 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1f9c1-64fe-4a62-945b-1a827d390d86 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:50:01.249767 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1f9c1-64fe-4a62-945b-1a827d390d86 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:50:01.251295 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 674/1344] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:50:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:50:01.256509 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613e4c4-bbb5-4918-a026-7844406ecf18 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:50:01.256964 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613e4c4-bbb5-4918-a026-7844406ecf18 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:50:01.257178 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613e4c4-bbb5-4918-a026-7844406ecf18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:50:01.325518 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-7613e4c4-bbb5-4918-a026-7844406ecf18 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:50:01.326894 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-7613e4c4-bbb5-4918-a026-7844406ecf18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:50:01.429875 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 671/1345] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:50:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:50:01.719893 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea1f9c1-64fe-4a62-945b-1a827d390d86 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:50:01.721433 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-5ea1f9c1-64fe-4a62-945b-1a827d390d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:50:01.850333 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:50:01.880466 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea1f9c1-64fe-4a62-945b-1a827d390d86 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:50:01.958095 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bcaf05-bb7a-4c8a-b1da-2df088f23bbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:50:01.958609 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bcaf05-bb7a-4c8a-b1da-2df088f23bbc service neutron] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:50:01.958882 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bcaf05-bb7a-4c8a-b1da-2df088f23bbc service neutron] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:50:01.959147 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bcaf05-bb7a-4c8a-b1da-2df088f23bbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:50:01.960753 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-d5bcaf05-bb7a-4c8a-b1da-2df088f23bbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:50:02.073419 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bcaf05-bb7a-4c8a-b1da-2df088f23bbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:50:02.074877 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bcaf05-bb7a-4c8a-b1da-2df088f23bbc service neutron] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:50:02.093799 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 675/1346] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:50:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:50:06.745046 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ec3bd-e71f-4647-afe1-527d339f15b0 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:50:06.745563 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ec3bd-e71f-4647-afe1-527d339f15b0 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:50:06.745676 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ec3bd-e71f-4647-afe1-527d339f15b0 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:50:06.752711 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 672/1347] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:50:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:50:06.754187 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47e89a-0534-4dbe-839f-2c3cc9f78b7e None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:50:06.754642 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47e89a-0534-4dbe-839f-2c3cc9f78b7e None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:50:06.754761 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47e89a-0534-4dbe-839f-2c3cc9f78b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:50:06.780814 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:50:06.834515 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-0a47e89a-0534-4dbe-839f-2c3cc9f78b7e None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:50:06.835746 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-0a47e89a-0534-4dbe-839f-2c3cc9f78b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:50:06.950259 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 676/1348] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:50:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:50:07.242580 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ec3bd-e71f-4647-afe1-527d339f15b0 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:50:07.244145 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-e13ec3bd-e71f-4647-afe1-527d339f15b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:50:07.303436 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:50:07.350650 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ec3bd-e71f-4647-afe1-527d339f15b0 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:50:07.428280 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f78327-5167-4cb3-b0eb-490ed623236e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:50:07.428885 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f78327-5167-4cb3-b0eb-490ed623236e service neutron] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:50:07.429161 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f78327-5167-4cb3-b0eb-490ed623236e service neutron] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:50:07.429445 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f78327-5167-4cb3-b0eb-490ed623236e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:50:07.431122 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-05f78327-5167-4cb3-b0eb-490ed623236e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:50:07.546610 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:50:07.549066 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f78327-5167-4cb3-b0eb-490ed623236e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:50:07.550552 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f78327-5167-4cb3-b0eb-490ed623236e service neutron] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:50:07.569932 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 673/1349] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:50:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:50:12.580806 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ca7e1-3175-4891-88c0-45875111dd21 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:50:12.581325 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ca7e1-3175-4891-88c0-45875111dd21 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:50:12.581325 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ca7e1-3175-4891-88c0-45875111dd21 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:50:12.582946 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 677/1350] 10.222.0.60 () {54 vars in 921 bytes} [Sat Sep 24 19:50:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:50:12.588815 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45d7b9-d56d-446d-85d9-bb754d330823 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:50:12.589806 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45d7b9-d56d-446d-85d9-bb754d330823 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:50:12.591380 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45d7b9-d56d-446d-85d9-bb754d330823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:50:12.711803 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-be45d7b9-d56d-446d-85d9-bb754d330823 None None] MFA Rules not processed for user `55f19f1385114fa5a921999747a6666b`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:50:12.712998 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-be45d7b9-d56d-446d-85d9-bb754d330823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:50:12.896266 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 674/1351] 10.222.0.60 () {58 vars in 1018 bytes} [Sat Sep 24 19:50:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:50:16.948160 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=59 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:50:17.423434 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce8245-a7a2-402f-85af-b789e0dd4124 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:50:17.424047 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce8245-a7a2-402f-85af-b789e0dd4124 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:50:17.424352 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce8245-a7a2-402f-85af-b789e0dd4124 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:50:17.425739 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 678/1352] 10.222.0.60 () {54 vars in 921 bytes} [Sat Sep 24 19:50:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:50:17.431287 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8133f7cc-6495-4bb4-80e8-e64cdd36dc4e None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:50:17.432055 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8133f7cc-6495-4bb4-80e8-e64cdd36dc4e None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:50:17.432055 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8133f7cc-6495-4bb4-80e8-e64cdd36dc4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:50:17.501065 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:50:17.539660 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-8133f7cc-6495-4bb4-80e8-e64cdd36dc4e None None] MFA Rules not processed for user `55f19f1385114fa5a921999747a6666b`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:50:17.540891 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-8133f7cc-6495-4bb4-80e8-e64cdd36dc4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:50:17.701474 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 675/1353] 10.222.0.60 () {58 vars in 1018 bytes} [Sat Sep 24 19:50:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:50:18.948739 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac685430-7416-4e0e-aa23-99b1c07d9865 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:50:18.949246 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac685430-7416-4e0e-aa23-99b1c07d9865 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:50:18.949246 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac685430-7416-4e0e-aa23-99b1c07d9865 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:50:18.951087 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 679/1354] 10.222.0.60 () {54 vars in 921 bytes} [Sat Sep 24 19:50:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:50:18.963461 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d602532-53d7-4aee-9e5b-a5bd5d85a3c0 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:50:18.964084 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d602532-53d7-4aee-9e5b-a5bd5d85a3c0 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:50:18.964084 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d602532-53d7-4aee-9e5b-a5bd5d85a3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:50:19.054404 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-4d602532-53d7-4aee-9e5b-a5bd5d85a3c0 None None] MFA Rules not processed for user `55f19f1385114fa5a921999747a6666b`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:50:19.055801 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-4d602532-53d7-4aee-9e5b-a5bd5d85a3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:50:19.109618 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:50:19.189684 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 676/1355] 10.222.0.60 () {58 vars in 1018 bytes} [Sat Sep 24 19:50:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:50:22.833983 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe275f-6f25-4e74-bb6b-e0544be74dfc None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:50:22.834518 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe275f-6f25-4e74-bb6b-e0544be74dfc None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:50:22.834518 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe275f-6f25-4e74-bb6b-e0544be74dfc None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:50:22.835864 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 680/1356] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:50:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:50:22.842003 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39956f-ebdc-40cc-8483-66c0857cfd1d None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:50:22.842515 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39956f-ebdc-40cc-8483-66c0857cfd1d None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:50:22.842796 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39956f-ebdc-40cc-8483-66c0857cfd1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:50:22.928376 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-fb39956f-ebdc-40cc-8483-66c0857cfd1d None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:50:22.929918 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-fb39956f-ebdc-40cc-8483-66c0857cfd1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:50:23.045772 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 677/1357] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:50:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:50:23.359681 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3013f241-0f4b-4fce-9789-34d656f18497 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:50:23.360192 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3013f241-0f4b-4fce-9789-34d656f18497 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:50:23.360621 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3013f241-0f4b-4fce-9789-34d656f18497 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:50:23.362453 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 681/1358] 10.222.0.60 () {54 vars in 961 bytes} [Sat Sep 24 19:50:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:50:23.376566 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78f983-3e43-4e43-be9c-6258e110f53b None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:50:23.376867 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78f983-3e43-4e43-be9c-6258e110f53b None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:50:23.377125 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78f983-3e43-4e43-be9c-6258e110f53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:50:23.401145 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:50:23.477559 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-cc78f983-3e43-4e43-be9c-6258e110f53b None None] MFA Rules not processed for user `f3b5047a59bc4547be643ffa78808a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:50:23.478763 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-cc78f983-3e43-4e43-be9c-6258e110f53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:50:23.613780 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 678/1359] 10.222.0.60 () {58 vars in 1058 bytes} [Sat Sep 24 19:50:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:50:23.621947 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3013f241-0f4b-4fce-9789-34d656f18497 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:50:23.624439 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-3013f241-0f4b-4fce-9789-34d656f18497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:50:23.811232 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3013f241-0f4b-4fce-9789-34d656f18497 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:50:23.896320 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:50:23.942554 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2fcd0-150b-4a72-af3f-ba813196f981 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5047a59bc4547be643ffa78808a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:50:23.943700 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2fcd0-150b-4a72-af3f-ba813196f981 service nova] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:50:23.944329 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2fcd0-150b-4a72-af3f-ba813196f981 service nova] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:50:23.944697 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2fcd0-150b-4a72-af3f-ba813196f981 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:50:23.947265 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-bef2fcd0-150b-4a72-af3f-ba813196f981 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:50:24.066186 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef2fcd0-150b-4a72-af3f-ba813196f981 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:50:24.067783 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef2fcd0-150b-4a72-af3f-ba813196f981 service nova] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:50:24.088244 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 682/1360] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:50:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 19:50:26.557934 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67b450-5943-42fe-9df8-4b0e414fd440 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:50:26.558653 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67b450-5943-42fe-9df8-4b0e414fd440 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:50:26.558653 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67b450-5943-42fe-9df8-4b0e414fd440 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:50:26.565121 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 679/1361] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:50:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:50:26.566349 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10dce0-809a-4ff1-999f-472d88cddad7 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:50:26.566929 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10dce0-809a-4ff1-999f-472d88cddad7 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:50:26.566929 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10dce0-809a-4ff1-999f-472d88cddad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:50:26.667318 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-7b10dce0-809a-4ff1-999f-472d88cddad7 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:50:26.668531 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-7b10dce0-809a-4ff1-999f-472d88cddad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:50:26.719288 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:50:26.788314 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 683/1362] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:50:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:50:27.083609 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f67b450-5943-42fe-9df8-4b0e414fd440 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:50:27.085396 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-4f67b450-5943-42fe-9df8-4b0e414fd440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:50:27.171942 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:50:27.298021 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f67b450-5943-42fe-9df8-4b0e414fd440 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:50:27.435328 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ec04b2-c46c-4eb6-9718-e541b04e8ff4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5047a59bc4547be643ffa78808a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:50:27.436048 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec04b2-c46c-4eb6-9718-e541b04e8ff4 service nova] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:50:27.436324 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec04b2-c46c-4eb6-9718-e541b04e8ff4 service nova] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:50:27.436588 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec04b2-c46c-4eb6-9718-e541b04e8ff4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:50:27.438224 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-e6ec04b2-c46c-4eb6-9718-e541b04e8ff4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:50:27.463356 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:50:27.533830 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ec04b2-c46c-4eb6-9718-e541b04e8ff4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:50:27.535446 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ec04b2-c46c-4eb6-9718-e541b04e8ff4 service nova] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:50:27.554580 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 680/1363] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:50:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:50:30.289303 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06b44e-5921-41ad-8216-9d99b41bc4cb None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:50:30.289921 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06b44e-5921-41ad-8216-9d99b41bc4cb None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:50:30.289921 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06b44e-5921-41ad-8216-9d99b41bc4cb None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:50:30.291403 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 684/1364] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:50:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:50:30.297263 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3677c-d7b0-40b4-83ce-5c26e2604f75 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:50:30.297829 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3677c-d7b0-40b4-83ce-5c26e2604f75 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:50:30.297829 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3677c-d7b0-40b4-83ce-5c26e2604f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:50:30.378756 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-82d3677c-d7b0-40b4-83ce-5c26e2604f75 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:50:30.379971 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-82d3677c-d7b0-40b4-83ce-5c26e2604f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:50:30.487533 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:50:30.497927 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 681/1365] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:50:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:50:30.792143 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9719f-ad68-4b14-8c75-61f2cfe1a8a6 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:50:30.792665 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9719f-ad68-4b14-8c75-61f2cfe1a8a6 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:50:30.793116 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9719f-ad68-4b14-8c75-61f2cfe1a8a6 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:50:30.795079 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 685/1366] 10.222.0.60 () {54 vars in 961 bytes} [Sat Sep 24 19:50:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:50:30.801073 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a002e-f7e3-43af-95cb-94dfa3092961 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:50:30.801603 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a002e-f7e3-43af-95cb-94dfa3092961 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:50:30.802024 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a002e-f7e3-43af-95cb-94dfa3092961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:50:30.897992 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-3b8a002e-f7e3-43af-95cb-94dfa3092961 None None] MFA Rules not processed for user `f3b5047a59bc4547be643ffa78808a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:50:30.902198 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-3b8a002e-f7e3-43af-95cb-94dfa3092961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:50:31.062358 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce9719f-ad68-4b14-8c75-61f2cfe1a8a6 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:50:31.064092 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-dce9719f-ad68-4b14-8c75-61f2cfe1a8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:50:31.068159 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 682/1367] 10.222.0.60 () {58 vars in 1058 bytes} [Sat Sep 24 19:50:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:50:31.225923 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce9719f-ad68-4b14-8c75-61f2cfe1a8a6 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:50:31.250250 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:50:31.360220 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbbdc64-c214-41e3-a421-af3cf7eeb402 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5047a59bc4547be643ffa78808a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:50:31.360896 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbbdc64-c214-41e3-a421-af3cf7eeb402 service nova] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:50:31.361269 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbbdc64-c214-41e3-a421-af3cf7eeb402 service nova] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:50:31.361669 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbbdc64-c214-41e3-a421-af3cf7eeb402 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:50:31.363395 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-3dbbdc64-c214-41e3-a421-af3cf7eeb402 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:50:31.390240 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3f9d8-6f98-4af5-9173-9413c78b7627 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:50:31.390778 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3f9d8-6f98-4af5-9173-9413c78b7627 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:50:31.390778 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3f9d8-6f98-4af5-9173-9413c78b7627 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:50:31.392306 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 683/1368] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:50:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:50:31.397307 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23208d62-c68a-4971-99e2-ab18bb584b9d None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:50:31.397626 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23208d62-c68a-4971-99e2-ab18bb584b9d None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:50:31.397926 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23208d62-c68a-4971-99e2-ab18bb584b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:50:31.463616 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:50:31.470837 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbbdc64-c214-41e3-a421-af3cf7eeb402 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:50:31.471874 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-23208d62-c68a-4971-99e2-ab18bb584b9d None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:50:31.472709 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbbdc64-c214-41e3-a421-af3cf7eeb402 service nova] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:50:31.473095 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-23208d62-c68a-4971-99e2-ab18bb584b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:50:31.493042 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 686/1369] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:50:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 19:50:31.585221 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 684/1370] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:50:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:50:31.930106 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad444d3-5222-480b-baa2-730d8d6356ef None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:50:31.930106 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad444d3-5222-480b-baa2-730d8d6356ef None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:50:31.936303 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad444d3-5222-480b-baa2-730d8d6356ef None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:50:31.938975 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 687/1371] 10.222.0.60 () {54 vars in 963 bytes} [Sat Sep 24 19:50:31 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:50:31.945148 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c954c4-c5d9-4292-8114-f40d285fe8ff None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:50:31.945517 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c954c4-c5d9-4292-8114-f40d285fe8ff None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:50:31.945889 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c954c4-c5d9-4292-8114-f40d285fe8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:50:32.042564 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-61c954c4-c5d9-4292-8114-f40d285fe8ff None None] MFA Rules not processed for user `e9057442a6cd4b45acdd588d432d8318`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:50:32.044636 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-61c954c4-c5d9-4292-8114-f40d285fe8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:50:32.157871 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:50:32.172194 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 685/1372] 10.222.0.60 () {58 vars in 1060 bytes} [Sat Sep 24 19:50:31 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:50:32.181055 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad444d3-5222-480b-baa2-730d8d6356ef None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:50:32.182726 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-2ad444d3-5222-480b-baa2-730d8d6356ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:50:32.217385 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:50:32.301755 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad444d3-5222-480b-baa2-730d8d6356ef None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:50:32.395951 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd77fb-c9b7-4893-bbb4-13bfb1ea6a0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:50:32.396815 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd77fb-c9b7-4893-bbb4-13bfb1ea6a0c service cinder] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:50:32.397097 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd77fb-c9b7-4893-bbb4-13bfb1ea6a0c service cinder] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:50:32.397462 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd77fb-c9b7-4893-bbb4-13bfb1ea6a0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:50:32.399547 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-17cd77fb-c9b7-4893-bbb4-13bfb1ea6a0c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:50:32.491439 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:50:32.528776 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd77fb-c9b7-4893-bbb4-13bfb1ea6a0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:50:32.530422 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd77fb-c9b7-4893-bbb4-13bfb1ea6a0c service cinder] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:50:32.561640 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 688/1373] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:50:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:50:34.063051 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75ac2b-5bfe-44b9-b42e-40f39e7a8482 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:50:34.063597 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75ac2b-5bfe-44b9-b42e-40f39e7a8482 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:50:34.063597 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75ac2b-5bfe-44b9-b42e-40f39e7a8482 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:50:34.064943 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 686/1374] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:50:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:50:34.070520 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68870855-2f9d-4e62-ad85-59b74f7b97f3 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:50:34.071032 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68870855-2f9d-4e62-ad85-59b74f7b97f3 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:50:34.071116 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68870855-2f9d-4e62-ad85-59b74f7b97f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:50:34.148619 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-68870855-2f9d-4e62-ad85-59b74f7b97f3 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:50:34.149890 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-68870855-2f9d-4e62-ad85-59b74f7b97f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:50:34.272468 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 689/1375] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:50:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:50:34.568945 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75ac2b-5bfe-44b9-b42e-40f39e7a8482 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:50:34.570628 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-bf75ac2b-5bfe-44b9-b42e-40f39e7a8482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:50:34.753312 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75ac2b-5bfe-44b9-b42e-40f39e7a8482 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:50:34.832161 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:50:34.885487 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6cccca-5bb9-4504-93cd-e7877f49dbad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5047a59bc4547be643ffa78808a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:50:34.886170 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6cccca-5bb9-4504-93cd-e7877f49dbad service nova] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:50:34.886453 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6cccca-5bb9-4504-93cd-e7877f49dbad service nova] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:50:34.886720 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6cccca-5bb9-4504-93cd-e7877f49dbad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:50:34.889373 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-de6cccca-5bb9-4504-93cd-e7877f49dbad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:50:34.989989 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6cccca-5bb9-4504-93cd-e7877f49dbad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:50:34.991599 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6cccca-5bb9-4504-93cd-e7877f49dbad service nova] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:50:35.015620 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 687/1376] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:50:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:50:37.394959 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ac4e5-169c-4cbb-8087-7f2b5830fc19 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:50:37.395497 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ac4e5-169c-4cbb-8087-7f2b5830fc19 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:50:37.395497 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ac4e5-169c-4cbb-8087-7f2b5830fc19 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:50:37.397013 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 690/1377] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:50:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:50:37.402295 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b0783-4e78-4bff-b433-43f2cc32b41e None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:50:37.402793 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b0783-4e78-4bff-b433-43f2cc32b41e None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:50:37.402886 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b0783-4e78-4bff-b433-43f2cc32b41e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:50:37.476694 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-db5b0783-4e78-4bff-b433-43f2cc32b41e None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:50:37.477928 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-db5b0783-4e78-4bff-b433-43f2cc32b41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:50:37.510868 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:50:37.582352 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 688/1378] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:50:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:50:37.877604 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ac4e5-169c-4cbb-8087-7f2b5830fc19 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:50:37.879037 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-de1ac4e5-169c-4cbb-8087-7f2b5830fc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:50:37.919948 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:50:38.057807 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ac4e5-169c-4cbb-8087-7f2b5830fc19 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:50:38.185555 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:50:38.191290 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5f50a-0ce3-4647-ae5d-38a0749cea9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5047a59bc4547be643ffa78808a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:50:38.191974 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5f50a-0ce3-4647-ae5d-38a0749cea9e service nova] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:50:38.192314 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5f50a-0ce3-4647-ae5d-38a0749cea9e service nova] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:50:38.192646 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5f50a-0ce3-4647-ae5d-38a0749cea9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:50:38.194479 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-33d5f50a-0ce3-4647-ae5d-38a0749cea9e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:50:38.328636 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d5f50a-0ce3-4647-ae5d-38a0749cea9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:50:38.331900 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d5f50a-0ce3-4647-ae5d-38a0749cea9e service nova] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:50:38.368244 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 691/1379] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:50:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:50:40.870692 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b236cb9-61ac-4110-a0cd-d33ff1f6e525 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:50:40.871227 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b236cb9-61ac-4110-a0cd-d33ff1f6e525 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:50:40.871227 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b236cb9-61ac-4110-a0cd-d33ff1f6e525 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:50:40.873828 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 689/1380] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:50:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:50:40.879223 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087de7aa-3a7b-4d05-b2af-a4c29c956773 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:50:40.879663 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087de7aa-3a7b-4d05-b2af-a4c29c956773 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:50:40.879755 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087de7aa-3a7b-4d05-b2af-a4c29c956773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:50:40.958603 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-087de7aa-3a7b-4d05-b2af-a4c29c956773 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:50:40.960122 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-087de7aa-3a7b-4d05-b2af-a4c29c956773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:50:41.031430 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:50:41.073369 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 692/1381] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:50:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:50:41.376548 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b236cb9-61ac-4110-a0cd-d33ff1f6e525 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:50:41.378154 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-8b236cb9-61ac-4110-a0cd-d33ff1f6e525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:50:41.546670 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b236cb9-61ac-4110-a0cd-d33ff1f6e525 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:50:41.560887 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:50:41.680259 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65919a32-41bd-43ac-b21c-bb47aa4ebb7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5047a59bc4547be643ffa78808a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:50:41.680879 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65919a32-41bd-43ac-b21c-bb47aa4ebb7d service nova] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:50:41.681153 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65919a32-41bd-43ac-b21c-bb47aa4ebb7d service nova] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:50:41.681447 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65919a32-41bd-43ac-b21c-bb47aa4ebb7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:50:41.683062 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-65919a32-41bd-43ac-b21c-bb47aa4ebb7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:50:41.783911 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65919a32-41bd-43ac-b21c-bb47aa4ebb7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:50:41.785475 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65919a32-41bd-43ac-b21c-bb47aa4ebb7d service nova] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:50:41.804699 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 690/1382] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:50:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:50:44.178092 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0eaf24-6e62-45c0-9ce5-78e7656d4fb2 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:50:44.178837 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0eaf24-6e62-45c0-9ce5-78e7656d4fb2 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:50:44.178837 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0eaf24-6e62-45c0-9ce5-78e7656d4fb2 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:50:44.180065 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 693/1383] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:50:44.186242 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea27be3-e044-4c59-87b1-00703ac37378 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:50:44.186720 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea27be3-e044-4c59-87b1-00703ac37378 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:50:44.187207 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea27be3-e044-4c59-87b1-00703ac37378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:50:44.213427 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:50:44.263697 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-fea27be3-e044-4c59-87b1-00703ac37378 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:50:44.264917 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-fea27be3-e044-4c59-87b1-00703ac37378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:50:44.367493 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 691/1384] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:50:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:50:44.654277 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0eaf24-6e62-45c0-9ce5-78e7656d4fb2 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:50:44.655852 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-8e0eaf24-6e62-45c0-9ce5-78e7656d4fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:50:44.826063 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0eaf24-6e62-45c0-9ce5-78e7656d4fb2 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:50:44.879294 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:50:44.957128 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd21822-a37d-41ec-8498-d059fa368170 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5047a59bc4547be643ffa78808a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:50:44.957764 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd21822-a37d-41ec-8498-d059fa368170 service nova] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:50:44.958184 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd21822-a37d-41ec-8498-d059fa368170 service nova] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:50:44.958482 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd21822-a37d-41ec-8498-d059fa368170 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:50:44.960188 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-7bd21822-a37d-41ec-8498-d059fa368170 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:50:45.063309 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd21822-a37d-41ec-8498-d059fa368170 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:50:45.064903 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd21822-a37d-41ec-8498-d059fa368170 service nova] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:50:45.082891 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 694/1385] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:50:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:50:47.327935 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444ab69-c4b5-4daa-9589-a8e9fab7074f None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:50:47.328537 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444ab69-c4b5-4daa-9589-a8e9fab7074f None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:50:47.328823 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444ab69-c4b5-4daa-9589-a8e9fab7074f None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:50:47.330504 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 692/1386] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:50:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:50:47.336068 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb3a81-2391-40a5-96f4-39d062581273 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:50:47.336564 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb3a81-2391-40a5-96f4-39d062581273 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:50:47.336671 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb3a81-2391-40a5-96f4-39d062581273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:50:47.404536 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-05bb3a81-2391-40a5-96f4-39d062581273 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:50:47.405802 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-05bb3a81-2391-40a5-96f4-39d062581273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:50:47.414412 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:50:47.523337 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 695/1387] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:50:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:50:47.825768 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444ab69-c4b5-4daa-9589-a8e9fab7074f None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:50:47.827301 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-2444ab69-c4b5-4daa-9589-a8e9fab7074f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:50:47.938846 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:50:47.999268 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444ab69-c4b5-4daa-9589-a8e9fab7074f None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:50:48.136375 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ff967-f164-4dd6-8676-2678cb4fccc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5047a59bc4547be643ffa78808a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:50:48.137708 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ff967-f164-4dd6-8676-2678cb4fccc8 service nova] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:50:48.138144 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ff967-f164-4dd6-8676-2678cb4fccc8 service nova] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:50:48.138421 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ff967-f164-4dd6-8676-2678cb4fccc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:50:48.140044 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-0e3ff967-f164-4dd6-8676-2678cb4fccc8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:50:48.208174 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:50:48.245813 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3ff967-f164-4dd6-8676-2678cb4fccc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:50:48.248109 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3ff967-f164-4dd6-8676-2678cb4fccc8 service nova] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:50:48.278912 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 693/1388] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:50:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:50:48.663888 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03dcc4-ef16-411b-a8ef-d2e4c0b9b3d1 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:50:48.664476 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03dcc4-ef16-411b-a8ef-d2e4c0b9b3d1 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:50:48.664476 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03dcc4-ef16-411b-a8ef-d2e4c0b9b3d1 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:50:48.665833 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 696/1389] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:50:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:50:48.672472 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcfb275-6f4f-4bea-8525-c098fb9e41b0 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:50:48.673009 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcfb275-6f4f-4bea-8525-c098fb9e41b0 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:50:48.673009 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcfb275-6f4f-4bea-8525-c098fb9e41b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:50:48.749113 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-ffcfb275-6f4f-4bea-8525-c098fb9e41b0 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:50:48.750341 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-ffcfb275-6f4f-4bea-8525-c098fb9e41b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:50:48.858854 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 694/1390] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:50:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:50:49.170407 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc5bda-3680-43a5-999f-93bfbcc6b0c1 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:50:49.170678 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc5bda-3680-43a5-999f-93bfbcc6b0c1 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:50:49.170980 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc5bda-3680-43a5-999f-93bfbcc6b0c1 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:50:49.173408 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 697/1391] 10.222.0.60 () {54 vars in 962 bytes} [Sat Sep 24 19:50:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:50:49.181485 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b9333-af32-4332-a073-1de2a15bfc91 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:50:49.181965 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b9333-af32-4332-a073-1de2a15bfc91 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:50:49.182237 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b9333-af32-4332-a073-1de2a15bfc91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:50:49.233169 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:50:49.268736 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-d67b9333-af32-4332-a073-1de2a15bfc91 None None] MFA Rules not processed for user `aaf6ec7f5b4f490aa22a8e3bea91da39`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:50:49.269995 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-d67b9333-af32-4332-a073-1de2a15bfc91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:50:49.351620 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 695/1392] 10.222.0.60 () {58 vars in 1059 bytes} [Sat Sep 24 19:50:49 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:50:49.361979 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc5bda-3680-43a5-999f-93bfbcc6b0c1 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:50:49.363713 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-39fc5bda-3680-43a5-999f-93bfbcc6b0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:50:49.477373 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc5bda-3680-43a5-999f-93bfbcc6b0c1 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:50:49.517658 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:50:49.557637 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04deb7-33f9-4d4f-a16d-66cea165efbd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaf6ec7f5b4f490aa22a8e3bea91da39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:50:49.558257 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04deb7-33f9-4d4f-a16d-66cea165efbd service glance] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:50:49.558632 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04deb7-33f9-4d4f-a16d-66cea165efbd service glance] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:50:49.558905 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04deb7-33f9-4d4f-a16d-66cea165efbd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:50:49.560596 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-6c04deb7-33f9-4d4f-a16d-66cea165efbd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:50:49.688984 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c04deb7-33f9-4d4f-a16d-66cea165efbd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:50:49.690457 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c04deb7-33f9-4d4f-a16d-66cea165efbd service glance] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:50:49.710854 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 698/1393] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:50:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:50:50.687384 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d5c309-2842-43ce-ae09-0ada5f7bd443 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:50:50.688237 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d5c309-2842-43ce-ae09-0ada5f7bd443 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:50:50.688237 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d5c309-2842-43ce-ae09-0ada5f7bd443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:50:50.723300 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc85b8-a65a-44d9-86e7-7b81e10e9ed6 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:50:50.723877 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc85b8-a65a-44d9-86e7-7b81e10e9ed6 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:50:50.723877 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc85b8-a65a-44d9-86e7-7b81e10e9ed6 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:50:50.725392 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 699/1394] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:50:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:50:50.731772 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799d310-7954-4167-8e23-f91b0d984171 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:50:50.732000 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799d310-7954-4167-8e23-f91b0d984171 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:50:50.732276 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799d310-7954-4167-8e23-f91b0d984171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:50:50.780791 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-a7d5c309-2842-43ce-ae09-0ada5f7bd443 None None] MFA Rules not processed for user `fd597f74abdf49288ea0d92642c6a5a2`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:50:50.782279 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-a7d5c309-2842-43ce-ae09-0ada5f7bd443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:50:50.813162 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-c799d310-7954-4167-8e23-f91b0d984171 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:50:50.814467 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-c799d310-7954-4167-8e23-f91b0d984171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:50:50.833888 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:50:50.874216 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:50:50.882693 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 696/1395] 10.222.0.60 () {58 vars in 1009 bytes} [Sat Sep 24 19:50:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:50:50.933234 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 700/1396] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:50:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:50:50.936043 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624738e-26cf-4f48-9123-f207ca0c337d None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:50:50.936866 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624738e-26cf-4f48-9123-f207ca0c337d None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:50:50.937247 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624738e-26cf-4f48-9123-f207ca0c337d None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:50:50.939229 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 697/1397] 10.222.0.60 () {54 vars in 943 bytes} [Sat Sep 24 19:50:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:50:50.945428 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6f884-7ced-44e6-a825-3de251364aef None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:50:50.945816 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6f884-7ced-44e6-a825-3de251364aef None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:50:50.946161 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6f884-7ced-44e6-a825-3de251364aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:50:51.033970 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-96d6f884-7ced-44e6-a825-3de251364aef None None] MFA Rules not processed for user `ebd94cd16acc45e6ac2997204297fb75`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:50:51.035117 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-96d6f884-7ced-44e6-a825-3de251364aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:50:51.124555 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:50:51.168136 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 701/1398] 10.222.0.60 () {58 vars in 1040 bytes} [Sat Sep 24 19:50:50 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:50:51.177903 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c624738e-26cf-4f48-9123-f207ca0c337d None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:50:51.179558 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-c624738e-26cf-4f48-9123-f207ca0c337d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:50:51.228403 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6f884-7ced-44e6-a825-3de251364aef None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:50:51.230381 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-96d6f884-7ced-44e6-a825-3de251364aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:50:51.329659 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c624738e-26cf-4f48-9123-f207ca0c337d None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:50:51.343965 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6f884-7ced-44e6-a825-3de251364aef None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:50:51.416186 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:50:51.445811 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38706ec-15e2-4440-8c05-4f4bd84f2701 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd94cd16acc45e6ac2997204297fb75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:50:51.446603 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38706ec-15e2-4440-8c05-4f4bd84f2701 service swift] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:50:51.446882 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38706ec-15e2-4440-8c05-4f4bd84f2701 service swift] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:50:51.447158 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38706ec-15e2-4440-8c05-4f4bd84f2701 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:50:51.449607 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-b38706ec-15e2-4440-8c05-4f4bd84f2701 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:50:51.461704 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:50:51.476391 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f5287-2680-4e44-9cd6-689a4f5bb8be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5047a59bc4547be643ffa78808a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:50:51.477017 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f5287-2680-4e44-9cd6-689a4f5bb8be service nova] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:50:51.477349 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f5287-2680-4e44-9cd6-689a4f5bb8be service nova] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:50:51.477661 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f5287-2680-4e44-9cd6-689a4f5bb8be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:50:51.479337 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-254f5287-2680-4e44-9cd6-689a4f5bb8be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:50:51.547876 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38706ec-15e2-4440-8c05-4f4bd84f2701 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:50:51.549673 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38706ec-15e2-4440-8c05-4f4bd84f2701 service swift] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:50:51.560274 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 698/1399] 10.222.0.60 () {60 vars in 1384 bytes} [Sat Sep 24 19:50:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 24 19:50:51.588136 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254f5287-2680-4e44-9cd6-689a4f5bb8be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:50:51.589827 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254f5287-2680-4e44-9cd6-689a4f5bb8be service nova] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:50:51.609150 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 702/1400] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:50:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:50:54.100286 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5264a3c-360d-40b8-9dd3-2cc15b5d2dea None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:50:54.100917 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5264a3c-360d-40b8-9dd3-2cc15b5d2dea None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:50:54.100917 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5264a3c-360d-40b8-9dd3-2cc15b5d2dea None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:50:54.103861 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 699/1401] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:50:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:50:54.110572 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ac5fa-1ebc-49f3-a9ca-68124c394a76 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:50:54.111110 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ac5fa-1ebc-49f3-a9ca-68124c394a76 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:50:54.111110 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ac5fa-1ebc-49f3-a9ca-68124c394a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:50:54.202148 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-2a0ac5fa-1ebc-49f3-a9ca-68124c394a76 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:50:54.203611 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-2a0ac5fa-1ebc-49f3-a9ca-68124c394a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:50:54.285682 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:50:54.330247 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 703/1402] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:50:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:50:54.647185 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5264a3c-360d-40b8-9dd3-2cc15b5d2dea None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:50:54.649177 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-a5264a3c-360d-40b8-9dd3-2cc15b5d2dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:50:54.811450 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:50:54.851765 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5264a3c-360d-40b8-9dd3-2cc15b5d2dea None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:50:54.990340 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e05499-4b55-4969-b660-d0a0233174f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5047a59bc4547be643ffa78808a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:50:54.990989 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e05499-4b55-4969-b660-d0a0233174f4 service nova] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:50:54.991336 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e05499-4b55-4969-b660-d0a0233174f4 service nova] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:50:54.991677 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e05499-4b55-4969-b660-d0a0233174f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:50:54.993469 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-a9e05499-4b55-4969-b660-d0a0233174f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:50:55.091080 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:50:55.110435 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e05499-4b55-4969-b660-d0a0233174f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:50:55.112219 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e05499-4b55-4969-b660-d0a0233174f4 service nova] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:50:55.135611 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 700/1403] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:50:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:50:57.550890 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002f508-f904-426b-b3d2-ffd80b700a18 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:50:57.550890 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002f508-f904-426b-b3d2-ffd80b700a18 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:50:57.550890 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002f508-f904-426b-b3d2-ffd80b700a18 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:50:57.550890 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 704/1404] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:50:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:50:57.556184 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7cde75-eb9b-412d-b68f-c5b0962b6c0a None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:50:57.556689 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7cde75-eb9b-412d-b68f-c5b0962b6c0a None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:50:57.556689 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7cde75-eb9b-412d-b68f-c5b0962b6c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:50:57.646796 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-9a7cde75-eb9b-412d-b68f-c5b0962b6c0a None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:50:57.648095 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-9a7cde75-eb9b-412d-b68f-c5b0962b6c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:50:57.787942 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 701/1405] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:50:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:50:58.100839 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5002f508-f904-426b-b3d2-ffd80b700a18 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:50:58.102432 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-5002f508-f904-426b-b3d2-ffd80b700a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:50:58.314094 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5002f508-f904-426b-b3d2-ffd80b700a18 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:50:58.374895 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:50:58.458595 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f85e6-cb42-41c4-9b95-628c2ce079fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5047a59bc4547be643ffa78808a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:50:58.459311 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f85e6-cb42-41c4-9b95-628c2ce079fa service nova] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:50:58.459648 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f85e6-cb42-41c4-9b95-628c2ce079fa service nova] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:50:58.460000 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f85e6-cb42-41c4-9b95-628c2ce079fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:50:58.461820 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-5a9f85e6-cb42-41c4-9b95-628c2ce079fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:50:58.569752 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f85e6-cb42-41c4-9b95-628c2ce079fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:50:58.571483 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f85e6-cb42-41c4-9b95-628c2ce079fa service nova] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:50:58.593991 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 705/1406] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:50:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:51:01.039661 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed61537-0f41-4085-88ba-25664e11b798 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:51:01.040205 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed61537-0f41-4085-88ba-25664e11b798 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:51:01.040205 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed61537-0f41-4085-88ba-25664e11b798 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:51:01.041668 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 702/1407] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:51:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:51:01.047509 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f54b4-3b81-4f39-8977-66d94e1a20eb None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:51:01.048024 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f54b4-3b81-4f39-8977-66d94e1a20eb None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:51:01.048121 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f54b4-3b81-4f39-8977-66d94e1a20eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:51:01.132537 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-245f54b4-3b81-4f39-8977-66d94e1a20eb None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:51:01.133834 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-245f54b4-3b81-4f39-8977-66d94e1a20eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:51:01.137307 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:51:01.252394 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 706/1408] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:51:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:51:01.566479 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed61537-0f41-4085-88ba-25664e11b798 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:51:01.568194 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-0ed61537-0f41-4085-88ba-25664e11b798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:51:01.642736 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:51:01.775092 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed61537-0f41-4085-88ba-25664e11b798 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:51:01.942429 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b125a32-3c17-4abc-a5ca-564515b8dd2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5047a59bc4547be643ffa78808a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:51:01.942951 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b125a32-3c17-4abc-a5ca-564515b8dd2b service nova] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:51:01.943228 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b125a32-3c17-4abc-a5ca-564515b8dd2b service nova] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:51:01.943492 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b125a32-3c17-4abc-a5ca-564515b8dd2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:51:01.945144 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-0b125a32-3c17-4abc-a5ca-564515b8dd2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:51:01.966185 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:51:02.056689 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b125a32-3c17-4abc-a5ca-564515b8dd2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:51:02.058448 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b125a32-3c17-4abc-a5ca-564515b8dd2b service nova] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:51:02.079084 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 703/1409] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:51:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:51:11.250237 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=41 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:51:12.076340 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=37 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:51:16.833868 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf509cd-03e6-4c00-a4f6-99e9a9f4e9a7 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:51:16.834470 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf509cd-03e6-4c00-a4f6-99e9a9f4e9a7 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:51:16.834675 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf509cd-03e6-4c00-a4f6-99e9a9f4e9a7 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:51:16.836135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 707/1410] 10.222.0.60 () {54 vars in 918 bytes} [Sat Sep 24 19:51:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:51:16.842562 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5a86b-7944-4f77-860d-0db0096d8e6b None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:51:16.843022 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5a86b-7944-4f77-860d-0db0096d8e6b None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:51:16.843294 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5a86b-7944-4f77-860d-0db0096d8e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:51:16.927628 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-c1b5a86b-7944-4f77-860d-0db0096d8e6b None None] MFA Rules not processed for user `55f19f1385114fa5a921999747a6666b`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:51:16.928869 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-c1b5a86b-7944-4f77-860d-0db0096d8e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:51:17.047362 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 704/1411] 10.222.0.60 () {58 vars in 1015 bytes} [Sat Sep 24 19:51:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:51:17.062729 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57948d10-7555-405f-afdc-fb4690b9f39b None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:51:17.063030 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57948d10-7555-405f-afdc-fb4690b9f39b None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:51:17.063271 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57948d10-7555-405f-afdc-fb4690b9f39b None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:51:17.064607 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 708/1412] 10.222.0.60 () {54 vars in 918 bytes} [Sat Sep 24 19:51:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:51:17.070009 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941cc4f-d536-48d9-962d-1db18bf57da9 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:51:17.070299 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941cc4f-d536-48d9-962d-1db18bf57da9 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:51:17.070578 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941cc4f-d536-48d9-962d-1db18bf57da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:51:17.149626 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:51:17.153422 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-5941cc4f-d536-48d9-962d-1db18bf57da9 None None] MFA Rules not processed for user `f3b5047a59bc4547be643ffa78808a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:51:17.154665 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-5941cc4f-d536-48d9-962d-1db18bf57da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:51:17.286617 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 705/1413] 10.222.0.60 () {58 vars in 1015 bytes} [Sat Sep 24 19:51:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:51:19.957303 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4112a-535f-451a-8b8a-5ef7b3392544 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:51:19.957889 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4112a-535f-451a-8b8a-5ef7b3392544 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:51:19.957889 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4112a-535f-451a-8b8a-5ef7b3392544 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:51:19.959132 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 709/1414] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 19:51:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:51:19.964587 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460dc0a4-dddb-48a9-acd2-28403a4b4c95 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:51:19.965698 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460dc0a4-dddb-48a9-acd2-28403a4b4c95 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:51:19.965816 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460dc0a4-dddb-48a9-acd2-28403a4b4c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:51:20.039920 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-460dc0a4-dddb-48a9-acd2-28403a4b4c95 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:51:20.041137 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-460dc0a4-dddb-48a9-acd2-28403a4b4c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:51:20.102380 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:51:20.152165 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 706/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 19:51:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:51:20.451798 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd4112a-535f-451a-8b8a-5ef7b3392544 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:51:20.453336 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-3dd4112a-535f-451a-8b8a-5ef7b3392544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:51:20.617339 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd4112a-535f-451a-8b8a-5ef7b3392544 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:51:20.701952 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:51:20.749081 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f7847-2996-4e68-8e16-b87699ef634c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5047a59bc4547be643ffa78808a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:51:20.749758 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f7847-2996-4e68-8e16-b87699ef634c service nova] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:51:20.750120 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f7847-2996-4e68-8e16-b87699ef634c service nova] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:51:20.750429 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f7847-2996-4e68-8e16-b87699ef634c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:51:20.752078 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-166f7847-2996-4e68-8e16-b87699ef634c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:51:20.851367 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166f7847-2996-4e68-8e16-b87699ef634c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:51:20.854309 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166f7847-2996-4e68-8e16-b87699ef634c service nova] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:51:20.873749 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 710/1416] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:51:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:51:22.061804 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de59df3-fe0b-41bb-b199-9ca463cfc54a None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:51:22.062400 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de59df3-fe0b-41bb-b199-9ca463cfc54a None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:51:22.062400 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de59df3-fe0b-41bb-b199-9ca463cfc54a None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:51:22.063675 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 707/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 19:51:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:51:22.070277 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed8f049-2b82-45b3-a073-83377cfc8c96 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:51:22.070806 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed8f049-2b82-45b3-a073-83377cfc8c96 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:51:22.070806 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed8f049-2b82-45b3-a073-83377cfc8c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:51:22.152581 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-2ed8f049-2b82-45b3-a073-83377cfc8c96 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:51:22.154499 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-2ed8f049-2b82-45b3-a073-83377cfc8c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:51:22.182982 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:51:22.276431 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 711/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 19:51:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:51:22.437785 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de59df3-fe0b-41bb-b199-9ca463cfc54a None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:51:22.439125 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-7de59df3-fe0b-41bb-b199-9ca463cfc54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:51:22.602815 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de59df3-fe0b-41bb-b199-9ca463cfc54a None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:51:22.648021 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:51:22.733998 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c480cb-8710-4a62-99b4-ebc3bbccd120 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5047a59bc4547be643ffa78808a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:51:22.734593 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c480cb-8710-4a62-99b4-ebc3bbccd120 service nova] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:51:22.735039 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c480cb-8710-4a62-99b4-ebc3bbccd120 service nova] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:51:22.735508 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c480cb-8710-4a62-99b4-ebc3bbccd120 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:51:22.737248 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-d5c480cb-8710-4a62-99b4-ebc3bbccd120 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:51:22.834390 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c480cb-8710-4a62-99b4-ebc3bbccd120 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:51:22.836206 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c480cb-8710-4a62-99b4-ebc3bbccd120 service nova] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:51:22.856122 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 708/1419] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:51:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:51:24.183482 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49d990-0a5f-4040-a7d2-b184408a1d6a None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:51:24.184062 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49d990-0a5f-4040-a7d2-b184408a1d6a None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:51:24.184062 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49d990-0a5f-4040-a7d2-b184408a1d6a None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:51:24.185441 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 712/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 19:51:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:51:24.192813 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146575a-f611-4d81-b2f1-328e90579995 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:51:24.193345 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146575a-f611-4d81-b2f1-328e90579995 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:51:24.193429 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146575a-f611-4d81-b2f1-328e90579995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:51:24.249641 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:51:24.272083 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-8146575a-f611-4d81-b2f1-328e90579995 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:51:24.273754 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-8146575a-f611-4d81-b2f1-328e90579995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:51:24.380609 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 709/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 19:51:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:51:24.541077 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad49d990-0a5f-4040-a7d2-b184408a1d6a None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:51:24.542660 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-ad49d990-0a5f-4040-a7d2-b184408a1d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:51:24.702803 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad49d990-0a5f-4040-a7d2-b184408a1d6a None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:51:24.716115 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:51:24.822301 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9ce2c9-30c2-44a6-beed-85b25e4ab8b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5047a59bc4547be643ffa78808a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:51:24.823028 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ce2c9-30c2-44a6-beed-85b25e4ab8b6 service nova] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:51:24.823320 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ce2c9-30c2-44a6-beed-85b25e4ab8b6 service nova] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:51:24.823596 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ce2c9-30c2-44a6-beed-85b25e4ab8b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:51:24.825716 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-7c9ce2c9-30c2-44a6-beed-85b25e4ab8b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:51:24.926930 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9ce2c9-30c2-44a6-beed-85b25e4ab8b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:51:24.928502 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9ce2c9-30c2-44a6-beed-85b25e4ab8b6 service nova] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:51:24.947846 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 713/1422] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:51:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:51:26.082546 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e352c-e611-49e4-ae19-7d7e1e0aac14 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:51:26.083233 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e352c-e611-49e4-ae19-7d7e1e0aac14 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:51:26.083233 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e352c-e611-49e4-ae19-7d7e1e0aac14 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:51:26.084498 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 710/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 19:51:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:51:26.091037 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d26d3-a864-4077-b1f4-f07f10fd01e9 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:51:26.091526 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d26d3-a864-4077-b1f4-f07f10fd01e9 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:51:26.091649 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d26d3-a864-4077-b1f4-f07f10fd01e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:51:26.111989 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:51:26.169974 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-9d6d26d3-a864-4077-b1f4-f07f10fd01e9 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:51:26.171342 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-9d6d26d3-a864-4077-b1f4-f07f10fd01e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:51:26.270706 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 714/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 19:51:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:51:26.432177 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e352c-e611-49e4-ae19-7d7e1e0aac14 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:51:26.434119 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-6e3e352c-e611-49e4-ae19-7d7e1e0aac14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:51:26.550063 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:51:26.587228 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e352c-e611-49e4-ae19-7d7e1e0aac14 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:51:26.708359 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be28796-e026-4b57-bb90-5746347210d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5047a59bc4547be643ffa78808a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:51:26.708908 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be28796-e026-4b57-bb90-5746347210d4 service nova] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:51:26.709180 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be28796-e026-4b57-bb90-5746347210d4 service nova] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:51:26.709439 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be28796-e026-4b57-bb90-5746347210d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:51:26.711139 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-0be28796-e026-4b57-bb90-5746347210d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:51:26.794113 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:51:26.809913 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be28796-e026-4b57-bb90-5746347210d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:51:26.811581 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be28796-e026-4b57-bb90-5746347210d4 service nova] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:51:26.830991 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 711/1425] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:51:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:51:28.026824 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4b3f7-2db7-439f-b9c5-93ac6c266417 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:51:28.027367 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4b3f7-2db7-439f-b9c5-93ac6c266417 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:51:28.027909 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4b3f7-2db7-439f-b9c5-93ac6c266417 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:51:28.029406 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 715/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 19:51:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:51:28.035945 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4927347-f296-47a1-bfc3-dc746f35e350 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:51:28.036433 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4927347-f296-47a1-bfc3-dc746f35e350 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:51:28.036531 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4927347-f296-47a1-bfc3-dc746f35e350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:51:28.112013 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-c4927347-f296-47a1-bfc3-dc746f35e350 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:51:28.113199 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-c4927347-f296-47a1-bfc3-dc746f35e350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:51:28.209546 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 712/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 19:51:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:51:28.359676 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c4b3f7-2db7-439f-b9c5-93ac6c266417 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:51:28.361255 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-80c4b3f7-2db7-439f-b9c5-93ac6c266417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:51:28.445900 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:51:28.507951 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c4b3f7-2db7-439f-b9c5-93ac6c266417 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:51:28.621646 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddca72b-6aaf-412b-8fe8-5c5fad648280 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5047a59bc4547be643ffa78808a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:51:28.622169 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddca72b-6aaf-412b-8fe8-5c5fad648280 service nova] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:51:28.622448 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddca72b-6aaf-412b-8fe8-5c5fad648280 service nova] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:51:28.622720 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddca72b-6aaf-412b-8fe8-5c5fad648280 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:51:28.624301 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-fddca72b-6aaf-412b-8fe8-5c5fad648280 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:51:28.673120 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:51:28.712679 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddca72b-6aaf-412b-8fe8-5c5fad648280 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:51:28.714290 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddca72b-6aaf-412b-8fe8-5c5fad648280 service nova] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:51:28.733601 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 716/1428] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:51:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:51:29.914010 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab195806-e8c8-43bc-bfec-2ba8da171415 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:51:29.914562 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab195806-e8c8-43bc-bfec-2ba8da171415 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:51:29.914674 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab195806-e8c8-43bc-bfec-2ba8da171415 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:51:29.916191 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 713/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 19:51:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:51:29.924127 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5d018-d6ef-4274-9870-146ea401573b None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:51:29.924660 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5d018-d6ef-4274-9870-146ea401573b None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:51:29.924660 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5d018-d6ef-4274-9870-146ea401573b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:51:30.001902 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-8cf5d018-d6ef-4274-9870-146ea401573b None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:51:30.003029 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-8cf5d018-d6ef-4274-9870-146ea401573b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:51:30.110248 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 717/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 19:51:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:51:30.263380 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab195806-e8c8-43bc-bfec-2ba8da171415 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:51:30.264870 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-ab195806-e8c8-43bc-bfec-2ba8da171415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:51:30.315988 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:51:30.416115 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab195806-e8c8-43bc-bfec-2ba8da171415 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:51:30.539271 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde79bc8-0616-424d-a815-2d829f6c35d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5047a59bc4547be643ffa78808a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:51:30.539924 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde79bc8-0616-424d-a815-2d829f6c35d0 service nova] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:51:30.540198 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde79bc8-0616-424d-a815-2d829f6c35d0 service nova] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:51:30.540461 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde79bc8-0616-424d-a815-2d829f6c35d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:51:30.542110 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-fde79bc8-0616-424d-a815-2d829f6c35d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:51:30.549565 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:51:30.641104 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde79bc8-0616-424d-a815-2d829f6c35d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:51:30.642864 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde79bc8-0616-424d-a815-2d829f6c35d0 service nova] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:51:30.663306 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 714/1431] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:51:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:51:31.803270 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584e92f-2cf5-4d1b-9a61-fe6d3f0e41dd None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:51:31.803892 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584e92f-2cf5-4d1b-9a61-fe6d3f0e41dd None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:51:31.803892 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584e92f-2cf5-4d1b-9a61-fe6d3f0e41dd None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:51:31.805163 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 718/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 19:51:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:51:31.811789 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc4cf5-3213-45e2-aa7e-943f658742b4 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:51:31.812407 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc4cf5-3213-45e2-aa7e-943f658742b4 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:51:31.812407 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc4cf5-3213-45e2-aa7e-943f658742b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:51:31.890673 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-80dc4cf5-3213-45e2-aa7e-943f658742b4 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:51:31.891886 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-80dc4cf5-3213-45e2-aa7e-943f658742b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:51:31.962114 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:51:31.991473 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 715/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 19:51:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:51:32.149115 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1584e92f-2cf5-4d1b-9a61-fe6d3f0e41dd None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:51:32.150847 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-1584e92f-2cf5-4d1b-9a61-fe6d3f0e41dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:51:32.169123 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:51:32.320561 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1584e92f-2cf5-4d1b-9a61-fe6d3f0e41dd None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:51:32.414458 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:51:32.442688 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fef4f9-1fa5-4c2e-9e5c-b5af01f73105 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5047a59bc4547be643ffa78808a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:51:32.443299 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fef4f9-1fa5-4c2e-9e5c-b5af01f73105 service nova] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:51:32.443603 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fef4f9-1fa5-4c2e-9e5c-b5af01f73105 service nova] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:51:32.443870 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fef4f9-1fa5-4c2e-9e5c-b5af01f73105 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:51:32.445481 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-75fef4f9-1fa5-4c2e-9e5c-b5af01f73105 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:51:32.543625 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fef4f9-1fa5-4c2e-9e5c-b5af01f73105 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:51:32.545211 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fef4f9-1fa5-4c2e-9e5c-b5af01f73105 service nova] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:51:32.564385 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 719/1434] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:51:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:51:33.722850 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bcf97e-a757-48c5-9b57-8f17af616087 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:51:33.723447 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bcf97e-a757-48c5-9b57-8f17af616087 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:51:33.723447 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bcf97e-a757-48c5-9b57-8f17af616087 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:51:33.724763 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 716/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 19:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:51:33.732050 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16efd6b2-e2fc-41e7-87b7-b88e900b0db6 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:51:33.733665 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16efd6b2-e2fc-41e7-87b7-b88e900b0db6 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:51:33.733665 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16efd6b2-e2fc-41e7-87b7-b88e900b0db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:51:33.816202 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-16efd6b2-e2fc-41e7-87b7-b88e900b0db6 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:51:33.817433 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-16efd6b2-e2fc-41e7-87b7-b88e900b0db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:51:33.871818 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:51:33.928765 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 720/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 19:51:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:51:34.082739 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bcf97e-a757-48c5-9b57-8f17af616087 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:51:34.084289 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-53bcf97e-a757-48c5-9b57-8f17af616087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:51:34.247739 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bcf97e-a757-48c5-9b57-8f17af616087 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:51:34.306046 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:51:34.373851 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc59e41-fbe2-40cd-a30d-da643a65202c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5047a59bc4547be643ffa78808a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:51:34.374470 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc59e41-fbe2-40cd-a30d-da643a65202c service nova] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:51:34.374745 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc59e41-fbe2-40cd-a30d-da643a65202c service nova] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:51:34.375013 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc59e41-fbe2-40cd-a30d-da643a65202c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:51:34.376666 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-bdc59e41-fbe2-40cd-a30d-da643a65202c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:51:34.475970 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc59e41-fbe2-40cd-a30d-da643a65202c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:51:34.477635 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc59e41-fbe2-40cd-a30d-da643a65202c service nova] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:51:34.497178 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 717/1437] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:51:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:51:35.662834 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc2999-2c3e-42b5-ab94-7fdc5d4490fd None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:51:35.663533 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc2999-2c3e-42b5-ab94-7fdc5d4490fd None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:51:35.663533 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc2999-2c3e-42b5-ab94-7fdc5d4490fd None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:51:35.664726 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 721/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 19:51:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:51:35.672892 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d92f18-25a7-43ef-a524-55a8509b530a None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:51:35.673430 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d92f18-25a7-43ef-a524-55a8509b530a None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:51:35.673430 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d92f18-25a7-43ef-a524-55a8509b530a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:51:35.766640 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-c4d92f18-25a7-43ef-a524-55a8509b530a None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:51:35.767870 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-c4d92f18-25a7-43ef-a524-55a8509b530a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:51:35.770100 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:51:35.877245 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 718/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 19:51:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:51:36.040282 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefc2999-2c3e-42b5-ab94-7fdc5d4490fd None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:51:36.041830 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-cefc2999-2c3e-42b5-ab94-7fdc5d4490fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:51:36.200368 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefc2999-2c3e-42b5-ab94-7fdc5d4490fd None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:51:36.230657 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:51:36.326691 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9af0b2-da48-4625-87fa-831d5793d0a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5047a59bc4547be643ffa78808a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:51:36.326947 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9af0b2-da48-4625-87fa-831d5793d0a8 service nova] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:51:36.327084 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9af0b2-da48-4625-87fa-831d5793d0a8 service nova] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:51:36.327618 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9af0b2-da48-4625-87fa-831d5793d0a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:51:36.329282 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-ae9af0b2-da48-4625-87fa-831d5793d0a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:51:36.426150 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9af0b2-da48-4625-87fa-831d5793d0a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:51:36.427753 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9af0b2-da48-4625-87fa-831d5793d0a8 service nova] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:51:36.447362 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 722/1440] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:51:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:51:38.608826 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6498f99-00e9-4c11-aa97-caa430ef822e None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:51:38.609430 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6498f99-00e9-4c11-aa97-caa430ef822e None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:51:38.609430 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6498f99-00e9-4c11-aa97-caa430ef822e None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:51:38.611856 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 719/1441] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 19:51:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:51:38.617228 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81568c8c-afb0-4372-92ee-2219007cc999 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:51:38.617738 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81568c8c-afb0-4372-92ee-2219007cc999 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:51:38.617862 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81568c8c-afb0-4372-92ee-2219007cc999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:51:38.668575 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:51:38.697357 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-81568c8c-afb0-4372-92ee-2219007cc999 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:51:38.699350 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-81568c8c-afb0-4372-92ee-2219007cc999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:51:38.803490 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 723/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 19:51:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:51:39.093874 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6498f99-00e9-4c11-aa97-caa430ef822e None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:51:39.095397 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-d6498f99-00e9-4c11-aa97-caa430ef822e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:51:39.206593 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6498f99-00e9-4c11-aa97-caa430ef822e None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:51:39.242177 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:51:39.289536 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cda3d2-01d0-48b5-b3c5-03f10f1478bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:51:39.290144 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cda3d2-01d0-48b5-b3c5-03f10f1478bf service neutron] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:51:39.290420 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cda3d2-01d0-48b5-b3c5-03f10f1478bf service neutron] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:51:39.290688 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cda3d2-01d0-48b5-b3c5-03f10f1478bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:51:39.292348 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-b5cda3d2-01d0-48b5-b3c5-03f10f1478bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:51:39.407880 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cda3d2-01d0-48b5-b3c5-03f10f1478bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:51:39.409231 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cda3d2-01d0-48b5-b3c5-03f10f1478bf service neutron] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:51:39.429583 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 720/1443] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:51:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:51:41.797580 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e54b7-8e9b-4ab2-9ab6-24cd0f77a423 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:51:41.798250 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e54b7-8e9b-4ab2-9ab6-24cd0f77a423 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:51:41.798250 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e54b7-8e9b-4ab2-9ab6-24cd0f77a423 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:51:41.799513 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 724/1444] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 19:51:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:51:41.805343 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93743f31-7de5-4b74-a362-1608776ce7c9 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:51:41.806114 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93743f31-7de5-4b74-a362-1608776ce7c9 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:51:41.806114 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93743f31-7de5-4b74-a362-1608776ce7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:51:41.879585 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-93743f31-7de5-4b74-a362-1608776ce7c9 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:51:41.880797 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-93743f31-7de5-4b74-a362-1608776ce7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:51:41.894609 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:51:41.988928 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 721/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 19:51:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:51:42.277470 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e54b7-8e9b-4ab2-9ab6-24cd0f77a423 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:51:42.279022 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-fe1e54b7-8e9b-4ab2-9ab6-24cd0f77a423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:51:42.411589 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e54b7-8e9b-4ab2-9ab6-24cd0f77a423 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:51:42.425549 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:51:42.493434 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e17295-7a6c-4517-a0d2-51e953fab463 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:51:42.494418 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e17295-7a6c-4517-a0d2-51e953fab463 service neutron] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:51:42.494879 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e17295-7a6c-4517-a0d2-51e953fab463 service neutron] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:51:42.495376 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e17295-7a6c-4517-a0d2-51e953fab463 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:51:42.498175 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-22e17295-7a6c-4517-a0d2-51e953fab463 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:51:42.632690 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e17295-7a6c-4517-a0d2-51e953fab463 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:51:42.634146 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e17295-7a6c-4517-a0d2-51e953fab463 service neutron] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:51:42.653854 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 725/1446] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:51:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:51:45.254957 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5636fe-4c99-47e4-b49c-79fa77f41735 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:51:45.255536 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5636fe-4c99-47e4-b49c-79fa77f41735 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:51:45.255536 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5636fe-4c99-47e4-b49c-79fa77f41735 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:51:45.256850 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 722/1447] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 19:51:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:51:45.263082 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8aa5a-cf47-4d99-ba14-86d8f7d5c911 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:51:45.263559 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8aa5a-cf47-4d99-ba14-86d8f7d5c911 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:51:45.263655 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8aa5a-cf47-4d99-ba14-86d8f7d5c911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:51:45.321451 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:51:45.342439 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-f6f8aa5a-cf47-4d99-ba14-86d8f7d5c911 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:51:45.343755 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-f6f8aa5a-cf47-4d99-ba14-86d8f7d5c911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:51:45.454225 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 726/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 19:51:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:51:45.746054 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5636fe-4c99-47e4-b49c-79fa77f41735 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:51:45.747594 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-1f5636fe-4c99-47e4-b49c-79fa77f41735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:51:45.856993 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5636fe-4c99-47e4-b49c-79fa77f41735 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:51:45.900499 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:51:46.071654 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db85344-3240-4e26-b2f9-43cc3a1d2744 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:51:46.072269 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db85344-3240-4e26-b2f9-43cc3a1d2744 service neutron] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:51:46.072545 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db85344-3240-4e26-b2f9-43cc3a1d2744 service neutron] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:51:46.072817 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db85344-3240-4e26-b2f9-43cc3a1d2744 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:51:46.075804 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-3db85344-3240-4e26-b2f9-43cc3a1d2744 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:51:46.193287 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db85344-3240-4e26-b2f9-43cc3a1d2744 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:51:46.194761 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db85344-3240-4e26-b2f9-43cc3a1d2744 service neutron] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:51:46.215135 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 723/1449] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:51:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:51:48.662490 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c2ca1-9e4a-4c97-8fb6-7c44b8c00393 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:51:48.663065 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c2ca1-9e4a-4c97-8fb6-7c44b8c00393 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:51:48.663065 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c2ca1-9e4a-4c97-8fb6-7c44b8c00393 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:51:48.664384 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 727/1450] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 19:51:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:51:48.671292 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3edbfb-aea3-4cea-8365-3b114df5ceca None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:51:48.671834 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3edbfb-aea3-4cea-8365-3b114df5ceca None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:51:48.671834 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3edbfb-aea3-4cea-8365-3b114df5ceca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:51:48.742101 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-3e3edbfb-aea3-4cea-8365-3b114df5ceca None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:51:48.743320 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-3e3edbfb-aea3-4cea-8365-3b114df5ceca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:51:48.770231 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:51:48.848975 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 724/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 19:51:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:51:49.139551 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239c2ca1-9e4a-4c97-8fb6-7c44b8c00393 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:51:49.141104 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-239c2ca1-9e4a-4c97-8fb6-7c44b8c00393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:51:49.265893 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239c2ca1-9e4a-4c97-8fb6-7c44b8c00393 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:51:49.293441 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:51:49.364868 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c9bc1-3551-48f7-b08c-31cf7e4da544 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:51:49.365404 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c9bc1-3551-48f7-b08c-31cf7e4da544 service neutron] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:51:49.365707 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c9bc1-3551-48f7-b08c-31cf7e4da544 service neutron] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:51:49.365975 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c9bc1-3551-48f7-b08c-31cf7e4da544 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:51:49.367560 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-b64c9bc1-3551-48f7-b08c-31cf7e4da544 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:51:49.501456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64c9bc1-3551-48f7-b08c-31cf7e4da544 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:51:49.502927 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64c9bc1-3551-48f7-b08c-31cf7e4da544 service neutron] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:51:49.523005 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 728/1452] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:51:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:51:51.959274 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9de310-0ac0-41d3-8cb8-162d9e1d1766 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:51:51.959804 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9de310-0ac0-41d3-8cb8-162d9e1d1766 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:51:51.959804 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9de310-0ac0-41d3-8cb8-162d9e1d1766 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:51:51.961067 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 725/1453] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 19:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:51:51.967729 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b8152-291a-4b07-8035-05753f0bbc05 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:51:51.968261 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b8152-291a-4b07-8035-05753f0bbc05 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:51:51.968261 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b8152-291a-4b07-8035-05753f0bbc05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:51:52.039348 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:51:52.042263 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-2f5b8152-291a-4b07-8035-05753f0bbc05 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:51:52.043485 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-2f5b8152-291a-4b07-8035-05753f0bbc05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:51:52.148521 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 729/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 19:51:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:51:52.440439 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9de310-0ac0-41d3-8cb8-162d9e1d1766 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:51:52.442085 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-6c9de310-0ac0-41d3-8cb8-162d9e1d1766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:51:52.550126 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9de310-0ac0-41d3-8cb8-162d9e1d1766 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:51:52.605564 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:51:52.634431 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b181cc76-e313-480d-95db-1ce9f9bdff46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:51:52.635060 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181cc76-e313-480d-95db-1ce9f9bdff46 service neutron] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:51:52.635333 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181cc76-e313-480d-95db-1ce9f9bdff46 service neutron] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:51:52.635697 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181cc76-e313-480d-95db-1ce9f9bdff46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:51:52.637327 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-b181cc76-e313-480d-95db-1ce9f9bdff46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:51:52.762252 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b181cc76-e313-480d-95db-1ce9f9bdff46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:51:52.763619 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b181cc76-e313-480d-95db-1ce9f9bdff46 service neutron] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:51:52.783682 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 726/1455] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:51:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:51:55.125340 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9b772-bc4b-405f-8684-c668face52ae None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:51:55.125952 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9b772-bc4b-405f-8684-c668face52ae None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:51:55.125952 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9b772-bc4b-405f-8684-c668face52ae None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:51:55.127263 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 730/1456] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 19:51:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:51:55.132598 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c071a-1075-45ca-9919-ae4625bb9dfd None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:51:55.132982 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c071a-1075-45ca-9919-ae4625bb9dfd None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:51:55.133133 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c071a-1075-45ca-9919-ae4625bb9dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:51:55.205773 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-8d7c071a-1075-45ca-9919-ae4625bb9dfd None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:51:55.207000 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-8d7c071a-1075-45ca-9919-ae4625bb9dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:51:55.243310 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:51:55.313436 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 727/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 19:51:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:51:55.602915 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d9b772-bc4b-405f-8684-c668face52ae None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:51:55.605660 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-96d9b772-bc4b-405f-8684-c668face52ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:51:55.717077 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d9b772-bc4b-405f-8684-c668face52ae None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:51:55.750164 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:51:55.803290 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f37a6-be2d-48a8-ae39-4cf793a7e996 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:51:55.803994 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f37a6-be2d-48a8-ae39-4cf793a7e996 service neutron] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:51:55.804277 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f37a6-be2d-48a8-ae39-4cf793a7e996 service neutron] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:51:55.804551 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f37a6-be2d-48a8-ae39-4cf793a7e996 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:51:55.806288 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-9f5f37a6-be2d-48a8-ae39-4cf793a7e996 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:51:55.922887 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5f37a6-be2d-48a8-ae39-4cf793a7e996 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:51:55.924231 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5f37a6-be2d-48a8-ae39-4cf793a7e996 service neutron] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:51:55.943785 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 731/1458] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:51:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:51:58.201354 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565178fb-7eaa-49a1-ac33-501ab26f879d None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:51:58.202007 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565178fb-7eaa-49a1-ac33-501ab26f879d None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:51:58.202007 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565178fb-7eaa-49a1-ac33-501ab26f879d None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:51:58.203896 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 728/1459] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 19:51:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:51:58.209765 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa49e09-f03a-4655-a64a-37f57ef74cd0 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:51:58.210285 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa49e09-f03a-4655-a64a-37f57ef74cd0 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:51:58.210385 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa49e09-f03a-4655-a64a-37f57ef74cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:51:58.283828 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-9aa49e09-f03a-4655-a64a-37f57ef74cd0 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:51:58.285054 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-9aa49e09-f03a-4655-a64a-37f57ef74cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:51:58.294654 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:51:58.386860 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 732/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 19:51:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:51:58.679626 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565178fb-7eaa-49a1-ac33-501ab26f879d None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:51:58.681148 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-565178fb-7eaa-49a1-ac33-501ab26f879d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:51:58.801988 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565178fb-7eaa-49a1-ac33-501ab26f879d None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:51:58.868513 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:51:58.887529 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e5155-c464-4d9e-873f-2185e946cd53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:51:58.888131 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e5155-c464-4d9e-873f-2185e946cd53 service neutron] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:51:58.888405 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e5155-c464-4d9e-873f-2185e946cd53 service neutron] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:51:58.888671 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e5155-c464-4d9e-873f-2185e946cd53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:51:58.890328 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-c68e5155-c464-4d9e-873f-2185e946cd53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:51:59.008892 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68e5155-c464-4d9e-873f-2185e946cd53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:51:59.011008 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68e5155-c464-4d9e-873f-2185e946cd53 service neutron] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:51:59.030885 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 729/1461] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:51:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:52:01.320653 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b6aed-14b6-4c97-aec7-9d32bd3e69aa None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:52:01.321221 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b6aed-14b6-4c97-aec7-9d32bd3e69aa None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:52:01.321221 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b6aed-14b6-4c97-aec7-9d32bd3e69aa None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:52:01.322702 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 733/1462] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 19:52:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:52:01.328308 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd6bc0-c938-454a-bde8-7bee19217808 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:52:01.328759 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd6bc0-c938-454a-bde8-7bee19217808 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:52:01.328864 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd6bc0-c938-454a-bde8-7bee19217808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:52:01.396248 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-a7bd6bc0-c938-454a-bde8-7bee19217808 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:52:01.397514 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-a7bd6bc0-c938-454a-bde8-7bee19217808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:52:01.436696 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:52:01.496798 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 730/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 19:52:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:52:01.787668 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48b6aed-14b6-4c97-aec7-9d32bd3e69aa None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:52:01.789256 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-a48b6aed-14b6-4c97-aec7-9d32bd3e69aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:52:01.899802 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48b6aed-14b6-4c97-aec7-9d32bd3e69aa None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:52:01.939175 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:52:01.977518 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c16c6c-7034-46b5-881c-55bbc494ecc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:52:01.978118 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c16c6c-7034-46b5-881c-55bbc494ecc8 service neutron] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:52:01.978699 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c16c6c-7034-46b5-881c-55bbc494ecc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:52:01.979200 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c16c6c-7034-46b5-881c-55bbc494ecc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:52:01.980801 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-b4c16c6c-7034-46b5-881c-55bbc494ecc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:52:02.091072 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c16c6c-7034-46b5-881c-55bbc494ecc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:52:02.092579 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c16c6c-7034-46b5-881c-55bbc494ecc8 service neutron] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:52:02.111304 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 734/1464] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:52:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:52:04.312180 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735df8be-b9f5-413f-85e6-2e0da018cb61 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:52:04.312732 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735df8be-b9f5-413f-85e6-2e0da018cb61 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:52:04.312732 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735df8be-b9f5-413f-85e6-2e0da018cb61 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:52:04.314114 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 731/1465] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 19:52:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:52:04.319598 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec1ac7-d102-4401-b5dc-c17811a96438 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:52:04.320016 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec1ac7-d102-4401-b5dc-c17811a96438 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:52:04.320187 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec1ac7-d102-4401-b5dc-c17811a96438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:52:04.390844 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-01ec1ac7-d102-4401-b5dc-c17811a96438 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:52:04.392057 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-01ec1ac7-d102-4401-b5dc-c17811a96438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:52:04.410943 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:52:04.493770 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 735/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 19:52:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:52:04.778964 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735df8be-b9f5-413f-85e6-2e0da018cb61 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:52:04.780500 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-735df8be-b9f5-413f-85e6-2e0da018cb61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:52:04.890622 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735df8be-b9f5-413f-85e6-2e0da018cb61 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:52:04.958711 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:52:04.965133 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b9e59-fec3-400f-8fd1-991697521ab3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:52:04.965759 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b9e59-fec3-400f-8fd1-991697521ab3 service neutron] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:52:04.966035 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b9e59-fec3-400f-8fd1-991697521ab3 service neutron] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:52:04.966293 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b9e59-fec3-400f-8fd1-991697521ab3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:52:04.967875 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-9e9b9e59-fec3-400f-8fd1-991697521ab3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:52:05.096591 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9b9e59-fec3-400f-8fd1-991697521ab3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:52:05.098085 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9b9e59-fec3-400f-8fd1-991697521ab3 service neutron] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:52:05.118024 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 732/1467] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:52:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:52:07.426981 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761a789-549d-4061-9655-05f0c772cf7f None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:52:07.427645 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761a789-549d-4061-9655-05f0c772cf7f None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:52:07.427645 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761a789-549d-4061-9655-05f0c772cf7f None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:52:07.428876 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 736/1468] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 19:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:52:07.434691 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf88e05-158a-48b0-9b87-acc4b3684f3b None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:52:07.435222 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf88e05-158a-48b0-9b87-acc4b3684f3b None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:52:07.435355 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf88e05-158a-48b0-9b87-acc4b3684f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:52:07.504484 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-adf88e05-158a-48b0-9b87-acc4b3684f3b None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:52:07.505729 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-adf88e05-158a-48b0-9b87-acc4b3684f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:52:07.554799 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:52:07.609054 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 733/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 19:52:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:52:07.897193 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5761a789-549d-4061-9655-05f0c772cf7f None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:52:07.898758 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-5761a789-549d-4061-9655-05f0c772cf7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:52:08.007699 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5761a789-549d-4061-9655-05f0c772cf7f None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:52:08.056158 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:52:08.083776 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17310fe-40a0-4cc4-8f07-991b9b5b4029 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:52:08.084383 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17310fe-40a0-4cc4-8f07-991b9b5b4029 service neutron] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:52:08.084661 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17310fe-40a0-4cc4-8f07-991b9b5b4029 service neutron] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:52:08.084933 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17310fe-40a0-4cc4-8f07-991b9b5b4029 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:52:08.087310 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-d17310fe-40a0-4cc4-8f07-991b9b5b4029 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:52:08.201910 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17310fe-40a0-4cc4-8f07-991b9b5b4029 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:52:08.203344 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17310fe-40a0-4cc4-8f07-991b9b5b4029 service neutron] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:52:08.222786 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 737/1470] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:52:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:52:17.607604 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=22 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:52:18.220195 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=66 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:52:28.714519 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701f99d-3e37-4619-bdd9-f70a2c8d384a None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:52:28.715317 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701f99d-3e37-4619-bdd9-f70a2c8d384a None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:52:28.715317 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701f99d-3e37-4619-bdd9-f70a2c8d384a None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:52:28.717546 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 734/1471] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:52:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:52:28.722413 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08aef5-4c64-4319-84b3-89fb09a93b72 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:52:28.722908 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08aef5-4c64-4319-84b3-89fb09a93b72 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:52:28.723015 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08aef5-4c64-4319-84b3-89fb09a93b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:52:28.795126 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-3b08aef5-4c64-4319-84b3-89fb09a93b72 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:52:28.798792 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-3b08aef5-4c64-4319-84b3-89fb09a93b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:52:28.903489 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 738/1472] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:52:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:52:29.210671 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7b3cc-ec6a-4ce2-b709-2d87559914ca None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:52:29.210957 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7b3cc-ec6a-4ce2-b709-2d87559914ca None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:52:29.211227 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7b3cc-ec6a-4ce2-b709-2d87559914ca None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:52:29.212670 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 735/1473] 10.222.0.60 () {54 vars in 962 bytes} [Sat Sep 24 19:52:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:52:29.217635 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ecbcc-6f45-4b7b-a27b-f4c9618da6e5 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:52:29.217922 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ecbcc-6f45-4b7b-a27b-f4c9618da6e5 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:52:29.218193 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ecbcc-6f45-4b7b-a27b-f4c9618da6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:52:29.295342 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-527ecbcc-6f45-4b7b-a27b-f4c9618da6e5 None None] MFA Rules not processed for user `aaf6ec7f5b4f490aa22a8e3bea91da39`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:52:29.296565 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-527ecbcc-6f45-4b7b-a27b-f4c9618da6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:52:29.318317 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:52:29.377211 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 739/1474] 10.222.0.60 () {58 vars in 1059 bytes} [Sat Sep 24 19:52:29 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:52:29.386677 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7b3cc-ec6a-4ce2-b709-2d87559914ca None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:52:29.388225 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-94c7b3cc-ec6a-4ce2-b709-2d87559914ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:52:29.497122 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7b3cc-ec6a-4ce2-b709-2d87559914ca None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:52:29.575718 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db9d3ae-f024-4213-9b77-2288e4f09343 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaf6ec7f5b4f490aa22a8e3bea91da39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:52:29.576321 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9d3ae-f024-4213-9b77-2288e4f09343 service glance] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:52:29.576599 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9d3ae-f024-4213-9b77-2288e4f09343 service glance] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:52:29.576868 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9d3ae-f024-4213-9b77-2288e4f09343 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:52:29.578491 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-7db9d3ae-f024-4213-9b77-2288e4f09343 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:52:29.635806 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:52:29.691475 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db9d3ae-f024-4213-9b77-2288e4f09343 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:52:29.692912 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db9d3ae-f024-4213-9b77-2288e4f09343 service glance] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:52:29.712739 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 736/1475] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:52:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:52:32.011909 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922328a-6d10-4184-808c-f1f2aac6aa76 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:52:32.012464 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922328a-6d10-4184-808c-f1f2aac6aa76 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:52:32.012464 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922328a-6d10-4184-808c-f1f2aac6aa76 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:52:32.015463 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 740/1476] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:52:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:52:32.025732 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dcb4bc-138b-4533-b2ad-1ce46505635e None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:52:32.026303 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dcb4bc-138b-4533-b2ad-1ce46505635e None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:52:32.026303 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dcb4bc-138b-4533-b2ad-1ce46505635e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:52:32.099961 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-87dcb4bc-138b-4533-b2ad-1ce46505635e None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:52:32.101433 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-87dcb4bc-138b-4533-b2ad-1ce46505635e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:52:32.204867 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 737/1477] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:52:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:52:32.479790 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8922328a-6d10-4184-808c-f1f2aac6aa76 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:52:32.481343 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-8922328a-6d10-4184-808c-f1f2aac6aa76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:52:32.605064 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8922328a-6d10-4184-808c-f1f2aac6aa76 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:52:32.653397 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:52:32.699032 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab748f-7a1e-4b4f-8336-dda81e375cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:52:32.699658 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab748f-7a1e-4b4f-8336-dda81e375cd3 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:52:32.699933 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab748f-7a1e-4b4f-8336-dda81e375cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:52:32.700200 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab748f-7a1e-4b4f-8336-dda81e375cd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:52:32.700921 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ab748f-7a1e-4b4f-8336-dda81e375cd3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:52:32.702672 dv-cinder-859191-1-smb devstack@keystone.service[93400]: WARNING py.warnings [None req-e1ab748f-7a1e-4b4f-8336-dda81e375cd3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 19:52:32.702672 dv-cinder-859191-1-smb devstack@keystone.service[93400]: warnings.warn(msg) Sep 24 19:52:32.702672 dv-cinder-859191-1-smb devstack@keystone.service[93400]: Sep 24 19:52:32.703801 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ab748f-7a1e-4b4f-8336-dda81e375cd3 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:52:32.732339 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 741/1478] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Sep 24 19:52:32 2022] GET /identity/v3/projects => generated 2553 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:52:34.926089 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60c81b-5625-459f-a40f-09d7c9fbce0b None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:52:34.926608 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60c81b-5625-459f-a40f-09d7c9fbce0b None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:52:34.926608 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60c81b-5625-459f-a40f-09d7c9fbce0b None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:52:34.927881 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 738/1479] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:52:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:52:34.933135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f689b-1c4c-431f-a976-689e4e91bbd2 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:52:34.933625 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f689b-1c4c-431f-a976-689e4e91bbd2 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:52:34.933725 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f689b-1c4c-431f-a976-689e4e91bbd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:52:35.002421 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-434f689b-1c4c-431f-a976-689e4e91bbd2 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:52:35.003644 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-434f689b-1c4c-431f-a976-689e4e91bbd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:52:35.099972 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 742/1480] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:52:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:52:35.392907 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d60c81b-5625-459f-a40f-09d7c9fbce0b None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:52:35.394469 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-0d60c81b-5625-459f-a40f-09d7c9fbce0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:52:35.405324 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:52:35.543902 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d60c81b-5625-459f-a40f-09d7c9fbce0b None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:52:35.623933 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:52:35.657368 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7d7f59-923a-4ebf-9e0b-f987cb4f8c82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5047a59bc4547be643ffa78808a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:52:35.657938 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d7f59-923a-4ebf-9e0b-f987cb4f8c82 service nova] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:52:35.658215 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d7f59-923a-4ebf-9e0b-f987cb4f8c82 service nova] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:52:35.658483 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d7f59-923a-4ebf-9e0b-f987cb4f8c82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:52:35.660075 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-8b7d7f59-923a-4ebf-9e0b-f987cb4f8c82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:52:35.755615 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7d7f59-923a-4ebf-9e0b-f987cb4f8c82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:52:35.757222 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7d7f59-923a-4ebf-9e0b-f987cb4f8c82 service nova] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:52:35.777245 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 739/1481] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:52:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:52:38.115802 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4befc9-7e37-4b40-8703-ec9703d621fb None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:52:38.116418 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4befc9-7e37-4b40-8703-ec9703d621fb None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:52:38.116418 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4befc9-7e37-4b40-8703-ec9703d621fb None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:52:38.118328 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 743/1482] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:52:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:52:38.123617 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b1923-97c0-4d46-bdb9-eeec40f855b8 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:52:38.124034 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b1923-97c0-4d46-bdb9-eeec40f855b8 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:52:38.124152 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b1923-97c0-4d46-bdb9-eeec40f855b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:52:38.190127 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-c86b1923-97c0-4d46-bdb9-eeec40f855b8 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:52:38.191339 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-c86b1923-97c0-4d46-bdb9-eeec40f855b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:52:38.237247 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:52:38.287340 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 740/1483] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:52:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:52:38.578267 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4befc9-7e37-4b40-8703-ec9703d621fb None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:52:38.579855 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-8d4befc9-7e37-4b40-8703-ec9703d621fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:52:38.604669 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:52:38.692875 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4befc9-7e37-4b40-8703-ec9703d621fb None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:52:38.769885 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb665d0-6673-4ca6-ae6f-5c099fea3e9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:52:38.770492 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb665d0-6673-4ca6-ae6f-5c099fea3e9d service neutron] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:52:38.770777 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb665d0-6673-4ca6-ae6f-5c099fea3e9d service neutron] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:52:38.771049 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb665d0-6673-4ca6-ae6f-5c099fea3e9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:52:38.772747 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-1bb665d0-6673-4ca6-ae6f-5c099fea3e9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:52:38.849759 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:52:38.885422 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb665d0-6673-4ca6-ae6f-5c099fea3e9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:52:38.886898 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb665d0-6673-4ca6-ae6f-5c099fea3e9d service neutron] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:52:38.906377 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 744/1484] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:52:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:52:41.125241 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c79f6-aa3a-4178-998c-458f9b7f8fcf None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:52:41.125846 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c79f6-aa3a-4178-998c-458f9b7f8fcf None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:52:41.125846 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c79f6-aa3a-4178-998c-458f9b7f8fcf None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:52:41.127134 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 741/1485] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:52:41.132377 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e3a22-b432-4b2e-9bd7-778ffa425510 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:52:41.132942 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e3a22-b432-4b2e-9bd7-778ffa425510 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:52:41.133137 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e3a22-b432-4b2e-9bd7-778ffa425510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:52:41.201896 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-e60e3a22-b432-4b2e-9bd7-778ffa425510 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:52:41.203126 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-e60e3a22-b432-4b2e-9bd7-778ffa425510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:52:41.300628 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 745/1486] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:52:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:52:41.589345 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c79f6-aa3a-4178-998c-458f9b7f8fcf None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:52:41.590895 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-401c79f6-aa3a-4178-998c-458f9b7f8fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:52:41.702493 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c79f6-aa3a-4178-998c-458f9b7f8fcf None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:52:41.777537 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:52:41.779019 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5bdbb-2aa8-4c8f-94c9-c7d46b33da2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:52:41.779822 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5bdbb-2aa8-4c8f-94c9-c7d46b33da2d service neutron] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:52:41.780099 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5bdbb-2aa8-4c8f-94c9-c7d46b33da2d service neutron] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:52:41.780365 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5bdbb-2aa8-4c8f-94c9-c7d46b33da2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:52:41.782121 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-d2a5bdbb-2aa8-4c8f-94c9-c7d46b33da2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:52:41.908992 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a5bdbb-2aa8-4c8f-94c9-c7d46b33da2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:52:41.910606 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a5bdbb-2aa8-4c8f-94c9-c7d46b33da2d service neutron] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:52:41.931528 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 742/1487] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:52:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:52:44.192628 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a41b4f4-cd8e-4e92-abcf-1e6acab46d20 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:52:44.193210 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a41b4f4-cd8e-4e92-abcf-1e6acab46d20 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:52:44.193210 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a41b4f4-cd8e-4e92-abcf-1e6acab46d20 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:52:44.194548 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 746/1488] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:52:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:52:44.200913 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82bc1a9-250d-467f-b859-5a08a6486a67 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:52:44.201360 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82bc1a9-250d-467f-b859-5a08a6486a67 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:52:44.201456 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82bc1a9-250d-467f-b859-5a08a6486a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:52:44.269061 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-b82bc1a9-250d-467f-b859-5a08a6486a67 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:52:44.270303 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-b82bc1a9-250d-467f-b859-5a08a6486a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:52:44.326668 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:52:44.370977 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 743/1489] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:52:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:52:44.662047 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a41b4f4-cd8e-4e92-abcf-1e6acab46d20 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:52:44.668142 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-9a41b4f4-cd8e-4e92-abcf-1e6acab46d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:52:44.703646 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:52:44.772857 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a41b4f4-cd8e-4e92-abcf-1e6acab46d20 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:52:44.848627 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce691ed2-29ae-4bd7-91be-b8a81d241019 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:52:44.849230 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce691ed2-29ae-4bd7-91be-b8a81d241019 service neutron] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:52:44.849533 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce691ed2-29ae-4bd7-91be-b8a81d241019 service neutron] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:52:44.850078 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce691ed2-29ae-4bd7-91be-b8a81d241019 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:52:44.852370 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-ce691ed2-29ae-4bd7-91be-b8a81d241019 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:52:44.935781 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:52:44.964742 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce691ed2-29ae-4bd7-91be-b8a81d241019 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:52:44.966651 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce691ed2-29ae-4bd7-91be-b8a81d241019 service neutron] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:52:44.986147 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 747/1490] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:52:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:52:47.615461 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e61d9-cd96-4d11-a5af-68c8c51fd37e None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:52:47.616066 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e61d9-cd96-4d11-a5af-68c8c51fd37e None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:52:47.616066 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e61d9-cd96-4d11-a5af-68c8c51fd37e None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:52:47.618072 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 744/1491] 10.222.0.60 () {54 vars in 927 bytes} [Sat Sep 24 19:52:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:52:47.623545 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a199fb2-1ae6-41a4-a0fc-35aa8e5b11ac None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:52:47.624012 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a199fb2-1ae6-41a4-a0fc-35aa8e5b11ac None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:52:47.624112 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a199fb2-1ae6-41a4-a0fc-35aa8e5b11ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:52:47.694144 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-3a199fb2-1ae6-41a4-a0fc-35aa8e5b11ac None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:52:47.696188 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-3a199fb2-1ae6-41a4-a0fc-35aa8e5b11ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:52:47.798040 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 748/1492] 10.222.0.60 () {58 vars in 1024 bytes} [Sat Sep 24 19:52:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:52:48.093170 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e61d9-cd96-4d11-a5af-68c8c51fd37e None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:52:48.094807 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-615e61d9-cd96-4d11-a5af-68c8c51fd37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:52:48.202508 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e61d9-cd96-4d11-a5af-68c8c51fd37e None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:52:48.276597 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203459f1-32da-40ee-9c5e-68688a25ba16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:52:48.277200 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203459f1-32da-40ee-9c5e-68688a25ba16 service neutron] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:52:48.277477 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203459f1-32da-40ee-9c5e-68688a25ba16 service neutron] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:52:48.277781 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203459f1-32da-40ee-9c5e-68688a25ba16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:52:48.279587 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-203459f1-32da-40ee-9c5e-68688a25ba16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:52:48.289168 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:52:48.392153 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203459f1-32da-40ee-9c5e-68688a25ba16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:52:48.393593 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203459f1-32da-40ee-9c5e-68688a25ba16 service neutron] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:52:48.412023 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 745/1493] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:52:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:52:57.796454 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=82 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:52:58.409625 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=50 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:54:13.215758 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201e873-4582-4dcb-a988-3320b4839d9c None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:54:13.216401 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201e873-4582-4dcb-a988-3320b4839d9c None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:54:13.216401 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201e873-4582-4dcb-a988-3320b4839d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:54:13.292867 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-4201e873-4582-4dcb-a988-3320b4839d9c None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:54:13.294101 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-4201e873-4582-4dcb-a988-3320b4839d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:54:13.395031 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 749/1494] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:54:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:54:13.403620 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488c084-a224-48d7-bab2-2bc59a7e1a3b None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:54:13.404158 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488c084-a224-48d7-bab2-2bc59a7e1a3b None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:54:13.404158 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488c084-a224-48d7-bab2-2bc59a7e1a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:54:13.480070 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-5488c084-a224-48d7-bab2-2bc59a7e1a3b None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:54:13.481270 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-5488c084-a224-48d7-bab2-2bc59a7e1a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:54:13.576892 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 746/1495] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:54:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:54:13.581431 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201e873-4582-4dcb-a988-3320b4839d9c None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:54:13.582807 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-4201e873-4582-4dcb-a988-3320b4839d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:54:13.594779 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201e873-4582-4dcb-a988-3320b4839d9c None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:54:13.656494 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:54:13.691089 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9adce2-9406-4443-a48f-052cf5b43ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:54:13.691694 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9adce2-9406-4443-a48f-052cf5b43ebe admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:54:13.691970 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9adce2-9406-4443-a48f-052cf5b43ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:54:13.692241 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9adce2-9406-4443-a48f-052cf5b43ebe admin admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:54:13.692923 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9adce2-9406-4443-a48f-052cf5b43ebe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:54:13.693593 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9adce2-9406-4443-a48f-052cf5b43ebe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:54:13.694989 dv-cinder-859191-1-smb devstack@keystone.service[93400]: WARNING py.warnings [None req-3e9adce2-9406-4443-a48f-052cf5b43ebe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 19:54:13.694989 dv-cinder-859191-1-smb devstack@keystone.service[93400]: warnings.warn(msg) Sep 24 19:54:13.694989 dv-cinder-859191-1-smb devstack@keystone.service[93400]: Sep 24 19:54:13.696169 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9adce2-9406-4443-a48f-052cf5b43ebe admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:54:13.707479 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 750/1496] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 19:54:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:54:13.716392 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488c084-a224-48d7-bab2-2bc59a7e1a3b None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:54:13.726489 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488c084-a224-48d7-bab2-2bc59a7e1a3b None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:54:13.787978 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:54:13.822268 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986ad8e-e646-4dc0-8098-ca0d28ecd76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:54:13.823055 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986ad8e-e646-4dc0-8098-ca0d28ecd76f admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:54:13.823562 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986ad8e-e646-4dc0-8098-ca0d28ecd76f admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:54:13.823853 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986ad8e-e646-4dc0-8098-ca0d28ecd76f admin admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:54:13.824769 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a986ad8e-e646-4dc0-8098-ca0d28ecd76f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:54:13.826631 dv-cinder-859191-1-smb devstack@keystone.service[93399]: WARNING py.warnings [None req-a986ad8e-e646-4dc0-8098-ca0d28ecd76f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 19:54:13.826631 dv-cinder-859191-1-smb devstack@keystone.service[93399]: warnings.warn(msg) Sep 24 19:54:13.826631 dv-cinder-859191-1-smb devstack@keystone.service[93399]: Sep 24 19:54:13.827873 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a986ad8e-e646-4dc0-8098-ca0d28ecd76f admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:54:13.987826 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 747/1497] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 19:54:13 2022] POST /identity/v3/projects => generated 377 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:54:13.992874 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9adce2-9406-4443-a48f-052cf5b43ebe admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:54:13.994413 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-3e9adce2-9406-4443-a48f-052cf5b43ebe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:54:14.028835 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9adce2-9406-4443-a48f-052cf5b43ebe admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:54:14.121833 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00d0e7-a47d-4bbd-9854-f78565d8a52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:54:14.122358 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00d0e7-a47d-4bbd-9854-f78565d8a52b admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:54:14.122640 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00d0e7-a47d-4bbd-9854-f78565d8a52b admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:54:14.122917 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00d0e7-a47d-4bbd-9854-f78565d8a52b admin admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:54:14.123554 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc00d0e7-a47d-4bbd-9854-f78565d8a52b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:54:14.124554 dv-cinder-859191-1-smb devstack@keystone.service[93400]: WARNING py.warnings [None req-dc00d0e7-a47d-4bbd-9854-f78565d8a52b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 19:54:14.124554 dv-cinder-859191-1-smb devstack@keystone.service[93400]: warnings.warn(msg) Sep 24 19:54:14.124554 dv-cinder-859191-1-smb devstack@keystone.service[93400]: Sep 24 19:54:14.125817 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc00d0e7-a47d-4bbd-9854-f78565d8a52b admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:54:14.268796 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 751/1498] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:54:13 2022] POST /identity/v3/users => generated 289 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:54:14.273010 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986ad8e-e646-4dc0-8098-ca0d28ecd76f admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:54:14.274608 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-a986ad8e-e646-4dc0-8098-ca0d28ecd76f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:54:14.336077 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986ad8e-e646-4dc0-8098-ca0d28ecd76f admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:54:14.420138 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:54:14.430367 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf6563d-9e69-445e-9d26-a43e8e7f9ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:54:14.431703 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6563d-9e69-445e-9d26-a43e8e7f9ab3 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:54:14.431703 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6563d-9e69-445e-9d26-a43e8e7f9ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:54:14.431703 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6563d-9e69-445e-9d26-a43e8e7f9ab3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:54:14.432486 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf6563d-9e69-445e-9d26-a43e8e7f9ab3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:54:14.433511 dv-cinder-859191-1-smb devstack@keystone.service[93399]: WARNING py.warnings [None req-cdf6563d-9e69-445e-9d26-a43e8e7f9ab3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 19:54:14.433511 dv-cinder-859191-1-smb devstack@keystone.service[93399]: warnings.warn(msg) Sep 24 19:54:14.433511 dv-cinder-859191-1-smb devstack@keystone.service[93399]: Sep 24 19:54:14.434385 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf6563d-9e69-445e-9d26-a43e8e7f9ab3 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:54:14.447590 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 748/1499] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:54:14.451764 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00d0e7-a47d-4bbd-9854-f78565d8a52b admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:54:14.453262 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-dc00d0e7-a47d-4bbd-9854-f78565d8a52b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:54:14.464548 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00d0e7-a47d-4bbd-9854-f78565d8a52b admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:54:14.489552 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:54:14.561448 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb56bc34-d663-44c0-a41d-cfb76288161d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:54:14.562102 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56bc34-d663-44c0-a41d-cfb76288161d admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:54:14.562377 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56bc34-d663-44c0-a41d-cfb76288161d admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:54:14.562647 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56bc34-d663-44c0-a41d-cfb76288161d admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:54:14.563283 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb56bc34-d663-44c0-a41d-cfb76288161d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:54:14.564269 dv-cinder-859191-1-smb devstack@keystone.service[93400]: WARNING py.warnings [None req-fb56bc34-d663-44c0-a41d-cfb76288161d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 19:54:14.564269 dv-cinder-859191-1-smb devstack@keystone.service[93400]: warnings.warn(msg) Sep 24 19:54:14.564269 dv-cinder-859191-1-smb devstack@keystone.service[93400]: Sep 24 19:54:14.565143 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb56bc34-d663-44c0-a41d-cfb76288161d admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:54:14.578242 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 752/1500] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:54:14.582396 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf6563d-9e69-445e-9d26-a43e8e7f9ab3 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:54:14.583879 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-cdf6563d-9e69-445e-9d26-a43e8e7f9ab3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:54:14.617608 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf6563d-9e69-445e-9d26-a43e8e7f9ab3 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:54:14.712105 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d2813-d325-4a2f-a80b-7eb2aa06a4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:54:14.712888 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d2813-d325-4a2f-a80b-7eb2aa06a4e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:54:14.713082 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d2813-d325-4a2f-a80b-7eb2aa06a4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:54:14.713333 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d2813-d325-4a2f-a80b-7eb2aa06a4e8 admin admin] PATH_INFO: `/v3/projects/01c05fbb318345659a3612056919fe03/users/ecfd95675f104ad9afb1111558494f36/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:54:14.736898 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583d2813-d325-4a2f-a80b-7eb2aa06a4e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01c05fbb318345659a3612056919fe03, user_id=ecfd95675f104ad9afb1111558494f36, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:54:14.737956 dv-cinder-859191-1-smb devstack@keystone.service[93399]: WARNING py.warnings [None req-583d2813-d325-4a2f-a80b-7eb2aa06a4e8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 19:54:14.737956 dv-cinder-859191-1-smb devstack@keystone.service[93399]: warnings.warn(msg) Sep 24 19:54:14.737956 dv-cinder-859191-1-smb devstack@keystone.service[93399]: Sep 24 19:54:14.739862 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583d2813-d325-4a2f-a80b-7eb2aa06a4e8 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:54:14.840662 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 749/1501] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:54:14 2022] PUT /identity/v3/projects/01c05fbb318345659a3612056919fe03/users/ecfd95675f104ad9afb1111558494f36/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 19:54:14.853886 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e449ea7-9bbd-49c3-be2e-f59f30f1f67b None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:54:14.854174 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e449ea7-9bbd-49c3-be2e-f59f30f1f67b None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:54:14.854446 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e449ea7-9bbd-49c3-be2e-f59f30f1f67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:54:14.911216 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-0e449ea7-9bbd-49c3-be2e-f59f30f1f67b None None] MFA Rules not processed for user `ecfd95675f104ad9afb1111558494f36`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:54:14.912423 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-0e449ea7-9bbd-49c3-be2e-f59f30f1f67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:54:14.990610 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 753/1502] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:54:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:54:15.004191 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2972a47-bbca-4b01-8f6d-e0603cad8bf3 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:54:15.004473 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2972a47-bbca-4b01-8f6d-e0603cad8bf3 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:54:15.004743 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2972a47-bbca-4b01-8f6d-e0603cad8bf3 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:54:15.006089 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 750/1503] 10.222.0.60 () {54 vars in 963 bytes} [Sat Sep 24 19:54:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:54:15.011449 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ccd4a-9018-4bc9-9689-cdedfbc2a5f1 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:54:15.011733 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ccd4a-9018-4bc9-9689-cdedfbc2a5f1 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:54:15.012002 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ccd4a-9018-4bc9-9689-cdedfbc2a5f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:54:15.044006 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:54:15.088773 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-c77ccd4a-9018-4bc9-9689-cdedfbc2a5f1 None None] MFA Rules not processed for user `e9057442a6cd4b45acdd588d432d8318`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:54:15.090074 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-c77ccd4a-9018-4bc9-9689-cdedfbc2a5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:54:15.167452 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 754/1504] 10.222.0.60 () {58 vars in 1060 bytes} [Sat Sep 24 19:54:15 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:54:15.175131 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2972a47-bbca-4b01-8f6d-e0603cad8bf3 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:54:15.176638 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-f2972a47-bbca-4b01-8f6d-e0603cad8bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:54:15.228238 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:54:15.284402 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2972a47-bbca-4b01-8f6d-e0603cad8bf3 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:54:15.360794 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c56b148-4f54-4330-9013-8d59a6f60c07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:54:15.361395 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56b148-4f54-4330-9013-8d59a6f60c07 service cinder] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:54:15.361768 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56b148-4f54-4330-9013-8d59a6f60c07 service cinder] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:54:15.362037 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56b148-4f54-4330-9013-8d59a6f60c07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:54:15.363623 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-3c56b148-4f54-4330-9013-8d59a6f60c07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:54:15.464820 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c56b148-4f54-4330-9013-8d59a6f60c07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:54:15.466285 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c56b148-4f54-4330-9013-8d59a6f60c07 service cinder] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:54:15.469788 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:54:15.483882 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 751/1505] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:54:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:54:15.530637 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04f8f8-43ab-4186-87f7-9d608a85f0c3 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:54:15.531059 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04f8f8-43ab-4186-87f7-9d608a85f0c3 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:54:15.531197 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04f8f8-43ab-4186-87f7-9d608a85f0c3 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:54:15.532478 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 755/1506] 10.222.0.60 () {52 vars in 830 bytes} [Sat Sep 24 19:54:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:54:15.536001 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c56b148-4f54-4330-9013-8d59a6f60c07 service cinder] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:54:15.537226 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-3c56b148-4f54-4330-9013-8d59a6f60c07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:54:15.636128 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c56b148-4f54-4330-9013-8d59a6f60c07 service cinder] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:54:15.729995 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dcfd92-07ed-44c9-8262-f5d6ca33e6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:54:15.730622 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcfd92-07ed-44c9-8262-f5d6ca33e6f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:54:15.730893 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcfd92-07ed-44c9-8262-f5d6ca33e6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:54:15.731159 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcfd92-07ed-44c9-8262-f5d6ca33e6f3 admin admin] PATH_INFO: `/v3/users/ecfd95675f104ad9afb1111558494f36` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:54:15.744249 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dcfd92-07ed-44c9-8262-f5d6ca33e6f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecfd95675f104ad9afb1111558494f36)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:54:15.745275 dv-cinder-859191-1-smb devstack@keystone.service[93399]: WARNING py.warnings [None req-e8dcfd92-07ed-44c9-8262-f5d6ca33e6f3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 19:54:15.745275 dv-cinder-859191-1-smb devstack@keystone.service[93399]: warnings.warn(msg) Sep 24 19:54:15.745275 dv-cinder-859191-1-smb devstack@keystone.service[93399]: Sep 24 19:54:15.746503 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dcfd92-07ed-44c9-8262-f5d6ca33e6f3 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:54:15.756053 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:54:15.993188 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-e8dcfd92-07ed-44c9-8262-f5d6ca33e6f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecfd95675f104ad9afb1111558494f36'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:54:16.088257 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-e8dcfd92-07ed-44c9-8262-f5d6ca33e6f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecfd95675f104ad9afb1111558494f36'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:54:16.088765 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-e8dcfd92-07ed-44c9-8262-f5d6ca33e6f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecfd95675f104ad9afb1111558494f36'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:54:16.089180 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-e8dcfd92-07ed-44c9-8262-f5d6ca33e6f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecfd95675f104ad9afb1111558494f36'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:54:16.112993 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-e8dcfd92-07ed-44c9-8262-f5d6ca33e6f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecfd95675f104ad9afb1111558494f36'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:54:16.132358 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 752/1507] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 19:54:15 2022] DELETE /identity/v3/users/ecfd95675f104ad9afb1111558494f36 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:54:16.136794 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba168a-08ff-4a65-80ce-4d2e54547b06 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:54:16.137111 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba168a-08ff-4a65-80ce-4d2e54547b06 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:54:16.137387 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba168a-08ff-4a65-80ce-4d2e54547b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:54:16.194081 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-40ba168a-08ff-4a65-80ce-4d2e54547b06 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:54:16.195822 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-40ba168a-08ff-4a65-80ce-4d2e54547b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:54:16.270883 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:54:16.283328 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 756/1508] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:54:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:54:16.294463 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dcfd92-07ed-44c9-8262-f5d6ca33e6f3 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:54:16.295670 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-e8dcfd92-07ed-44c9-8262-f5d6ca33e6f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:54:16.397834 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dcfd92-07ed-44c9-8262-f5d6ca33e6f3 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:54:16.452484 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:54:16.470701 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f075bd12-82bb-45ed-a972-e85b5e9d190e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:54:16.471567 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075bd12-82bb-45ed-a972-e85b5e9d190e service neutron] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:54:16.471815 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075bd12-82bb-45ed-a972-e85b5e9d190e service neutron] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:54:16.472081 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075bd12-82bb-45ed-a972-e85b5e9d190e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:54:16.473688 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-f075bd12-82bb-45ed-a972-e85b5e9d190e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:54:16.586484 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f075bd12-82bb-45ed-a972-e85b5e9d190e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:54:16.587915 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f075bd12-82bb-45ed-a972-e85b5e9d190e service neutron] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:54:16.606398 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 753/1509] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:54:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:54:17.087346 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba168a-08ff-4a65-80ce-4d2e54547b06 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:54:17.088623 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-40ba168a-08ff-4a65-80ce-4d2e54547b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:54:17.100213 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba168a-08ff-4a65-80ce-4d2e54547b06 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:54:17.199369 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a5033c-386a-42aa-b7ed-f3665078cfc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:54:17.200001 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5033c-386a-42aa-b7ed-f3665078cfc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:54:17.200276 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5033c-386a-42aa-b7ed-f3665078cfc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:54:17.200548 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5033c-386a-42aa-b7ed-f3665078cfc4 admin admin] PATH_INFO: `/v3/projects/01c05fbb318345659a3612056919fe03` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:54:17.210295 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a5033c-386a-42aa-b7ed-f3665078cfc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01c05fbb318345659a3612056919fe03)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:54:17.211304 dv-cinder-859191-1-smb devstack@keystone.service[93400]: WARNING py.warnings [None req-98a5033c-386a-42aa-b7ed-f3665078cfc4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 19:54:17.211304 dv-cinder-859191-1-smb devstack@keystone.service[93400]: warnings.warn(msg) Sep 24 19:54:17.211304 dv-cinder-859191-1-smb devstack@keystone.service[93400]: Sep 24 19:54:17.212491 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a5033c-386a-42aa-b7ed-f3665078cfc4 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:54:17.355297 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-98a5033c-386a-42aa-b7ed-f3665078cfc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01c05fbb318345659a3612056919fe03', 'request_id': 'req-98a5033c-386a-42aa-b7ed-f3665078cfc4'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:54:17.430977 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-98a5033c-386a-42aa-b7ed-f3665078cfc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01c05fbb318345659a3612056919fe03', 'request_id': 'req-98a5033c-386a-42aa-b7ed-f3665078cfc4'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:54:17.437379 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-98a5033c-386a-42aa-b7ed-f3665078cfc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01c05fbb318345659a3612056919fe03', 'request_id': 'req-98a5033c-386a-42aa-b7ed-f3665078cfc4'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:54:17.467123 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-98a5033c-386a-42aa-b7ed-f3665078cfc4 admin admin] The token cache is being invalidate because project 01c05fbb318345659a3612056919fe03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 19:54:17.467405 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-98a5033c-386a-42aa-b7ed-f3665078cfc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:54:17.467923 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-98a5033c-386a-42aa-b7ed-f3665078cfc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:54:17.469225 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 757/1510] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 19:54:17 2022] DELETE /identity/v3/projects/01c05fbb318345659a3612056919fe03 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:54:26.604190 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=62 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:54:27.465139 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:55:53.414885 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc55de-5d71-4ab5-9b47-b9fceb66f7e7 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:55:53.415547 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc55de-5d71-4ab5-9b47-b9fceb66f7e7 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:55:53.415547 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc55de-5d71-4ab5-9b47-b9fceb66f7e7 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:55:53.416845 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 754/1511] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 19:55:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:55:53.421935 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187ed4a-84e9-4901-bcdf-cbcfdc5e01ce None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:55:53.422399 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187ed4a-84e9-4901-bcdf-cbcfdc5e01ce None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:55:53.422503 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187ed4a-84e9-4901-bcdf-cbcfdc5e01ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:55:53.504158 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-4187ed4a-84e9-4901-bcdf-cbcfdc5e01ce None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:55:53.505349 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-4187ed4a-84e9-4901-bcdf-cbcfdc5e01ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:55:53.607907 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 758/1512] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 19:55:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:55:53.760848 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becc55de-5d71-4ab5-9b47-b9fceb66f7e7 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:55:53.763713 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-becc55de-5d71-4ab5-9b47-b9fceb66f7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:55:53.882375 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becc55de-5d71-4ab5-9b47-b9fceb66f7e7 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:55:53.887936 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e760e-4f24-4181-bd21-feddd4cbe140 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5047a59bc4547be643ffa78808a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:55:53.888531 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e760e-4f24-4181-bd21-feddd4cbe140 service nova] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:55:53.888805 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e760e-4f24-4181-bd21-feddd4cbe140 service nova] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:55:53.889072 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e760e-4f24-4181-bd21-feddd4cbe140 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:55:53.897173 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e760e-4f24-4181-bd21-feddd4cbe140 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:55:53.898770 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e760e-4f24-4181-bd21-feddd4cbe140 service nova] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:55:53.908755 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 755/1513] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:55:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:55:54.979994 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0471cd-26ed-460a-a8f1-ab52b11b44c4 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:55:54.980646 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0471cd-26ed-460a-a8f1-ab52b11b44c4 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:55:54.980646 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0471cd-26ed-460a-a8f1-ab52b11b44c4 None None] PATH_INFO: `/v3` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:55:54.982033 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 759/1514] 10.222.0.33 () {54 vars in 925 bytes} [Sat Sep 24 19:55:54 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:55:54.982283 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0789245-262a-45ac-bdf5-fb182f84ff3b None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:55:54.982697 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0789245-262a-45ac-bdf5-fb182f84ff3b None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:55:54.982885 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0789245-262a-45ac-bdf5-fb182f84ff3b None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:55:54.984226 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 756/1515] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 19:55:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:55:54.987699 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24387fe6-ce85-48b7-a7aa-6bf9109d0683 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:55:54.987981 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24387fe6-ce85-48b7-a7aa-6bf9109d0683 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:55:54.988257 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24387fe6-ce85-48b7-a7aa-6bf9109d0683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:55:54.990671 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b3628-889f-42ae-b683-ebc5b397bf86 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:55:54.990957 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b3628-889f-42ae-b683-ebc5b397bf86 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:55:54.991225 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b3628-889f-42ae-b683-ebc5b397bf86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:55:55.010246 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-315b3628-889f-42ae-b683-ebc5b397bf86 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:55:55.012099 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-315b3628-889f-42ae-b683-ebc5b397bf86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:55:55.020140 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 757/1516] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 19:55:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:55:55.057208 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-24387fe6-ce85-48b7-a7aa-6bf9109d0683 None None] MFA Rules not processed for user `55f19f1385114fa5a921999747a6666b`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:55:55.058499 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-24387fe6-ce85-48b7-a7aa-6bf9109d0683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:55:55.088195 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:55:55.130645 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 760/1517] 10.222.0.33 () {58 vars in 1015 bytes} [Sat Sep 24 19:55:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:55:55.173474 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b3628-889f-42ae-b683-ebc5b397bf86 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:55:55.186401 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b3628-889f-42ae-b683-ebc5b397bf86 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:55:55.191881 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5694bae1-40b4-41a4-b2e1-44a88e3110f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5047a59bc4547be643ffa78808a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:55:55.192476 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694bae1-40b4-41a4-b2e1-44a88e3110f5 service nova] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:55:55.192768 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694bae1-40b4-41a4-b2e1-44a88e3110f5 service nova] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:55:55.193032 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694bae1-40b4-41a4-b2e1-44a88e3110f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:55:55.201624 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5694bae1-40b4-41a4-b2e1-44a88e3110f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:55:55.203194 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5694bae1-40b4-41a4-b2e1-44a88e3110f5 service nova] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:55:55.212400 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 758/1518] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:55:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:56:04.095519 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2f759-25c9-4bca-822b-d76e761f0dba None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:56:04.096054 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2f759-25c9-4bca-822b-d76e761f0dba None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:56:04.096158 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2f759-25c9-4bca-822b-d76e761f0dba None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:56:04.097622 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 761/1519] 10.222.0.60 () {54 vars in 961 bytes} [Sat Sep 24 19:56:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:56:04.102782 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422213f7-8147-42ce-89b5-24de25f8c335 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:56:04.103222 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422213f7-8147-42ce-89b5-24de25f8c335 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:56:04.103368 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422213f7-8147-42ce-89b5-24de25f8c335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:56:04.125695 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-422213f7-8147-42ce-89b5-24de25f8c335 None None] MFA Rules not processed for user `55f19f1385114fa5a921999747a6666b`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:56:04.126892 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-422213f7-8147-42ce-89b5-24de25f8c335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:56:04.135529 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 759/1520] 10.222.0.60 () {58 vars in 1058 bytes} [Sat Sep 24 19:56:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:56:04.143383 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2f759-25c9-4bca-822b-d76e761f0dba None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:56:04.157144 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2f759-25c9-4bca-822b-d76e761f0dba None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:56:04.162169 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb931924-2cef-430b-91df-f5f4f1582252 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f19f1385114fa5a921999747a6666b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:56:04.162756 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb931924-2cef-430b-91df-f5f4f1582252 service placement] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:56:04.163036 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb931924-2cef-430b-91df-f5f4f1582252 service placement] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:56:04.163303 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb931924-2cef-430b-91df-f5f4f1582252 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:56:04.171940 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb931924-2cef-430b-91df-f5f4f1582252 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:56:04.173526 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb931924-2cef-430b-91df-f5f4f1582252 service placement] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:56:04.183058 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 762/1521] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:56:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:56:06.703737 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df673d-8ceb-4367-9018-54c50534b37f None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:56:06.704250 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df673d-8ceb-4367-9018-54c50534b37f None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:56:06.704250 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df673d-8ceb-4367-9018-54c50534b37f None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:56:06.705654 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 760/1522] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 19:56:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:56:06.711833 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d2990-ed10-41ad-979b-e0433cada8c6 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:56:06.712300 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d2990-ed10-41ad-979b-e0433cada8c6 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:56:06.712399 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d2990-ed10-41ad-979b-e0433cada8c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:56:06.732339 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-106d2990-ed10-41ad-979b-e0433cada8c6 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:56:06.733546 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-106d2990-ed10-41ad-979b-e0433cada8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:56:06.741237 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 763/1523] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 19:56:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:56:06.897677 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df673d-8ceb-4367-9018-54c50534b37f None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:56:06.912476 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df673d-8ceb-4367-9018-54c50534b37f None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:56:06.917910 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f48b5-adcb-4258-a333-03ed1e253612 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5047a59bc4547be643ffa78808a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:56:06.918550 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f48b5-adcb-4258-a333-03ed1e253612 service nova] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:56:06.919012 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f48b5-adcb-4258-a333-03ed1e253612 service nova] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:56:06.919197 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f48b5-adcb-4258-a333-03ed1e253612 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:56:06.927054 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5f48b5-adcb-4258-a333-03ed1e253612 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:56:06.928674 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5f48b5-adcb-4258-a333-03ed1e253612 service nova] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:56:06.938078 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 761/1524] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:56:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:56:08.012488 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777ddd2-ff28-453b-a848-bf4c2bde62a9 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:56:08.013053 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777ddd2-ff28-453b-a848-bf4c2bde62a9 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:56:08.013053 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777ddd2-ff28-453b-a848-bf4c2bde62a9 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:56:08.014320 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 764/1525] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 19:56:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:56:08.020656 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac0164-170c-4b5e-af86-6a3b6df8a334 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:56:08.021147 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac0164-170c-4b5e-af86-6a3b6df8a334 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:56:08.021264 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac0164-170c-4b5e-af86-6a3b6df8a334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:56:08.040934 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-6cac0164-170c-4b5e-af86-6a3b6df8a334 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:56:08.042204 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-6cac0164-170c-4b5e-af86-6a3b6df8a334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:56:08.051073 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 762/1526] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 19:56:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:56:08.204875 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777ddd2-ff28-453b-a848-bf4c2bde62a9 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:56:08.219920 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777ddd2-ff28-453b-a848-bf4c2bde62a9 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:56:08.225268 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01476d61-c602-426d-8a2e-a858e4517091 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5047a59bc4547be643ffa78808a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:56:08.225910 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01476d61-c602-426d-8a2e-a858e4517091 service nova] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:56:08.226188 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01476d61-c602-426d-8a2e-a858e4517091 service nova] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:56:08.226458 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01476d61-c602-426d-8a2e-a858e4517091 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:56:08.234624 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01476d61-c602-426d-8a2e-a858e4517091 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:56:08.236219 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01476d61-c602-426d-8a2e-a858e4517091 service nova] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:56:08.245475 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 765/1527] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:56:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:56:12.310157 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4213f84-a400-4052-bead-fffe6f3c6ff0 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:56:12.310713 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4213f84-a400-4052-bead-fffe6f3c6ff0 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:56:12.310713 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4213f84-a400-4052-bead-fffe6f3c6ff0 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:56:12.312120 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 763/1528] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 19:56:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:56:12.317552 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696cc16-b509-4972-b835-57358273006d None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:56:12.317982 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696cc16-b509-4972-b835-57358273006d None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:56:12.318131 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696cc16-b509-4972-b835-57358273006d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:56:12.337666 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-6696cc16-b509-4972-b835-57358273006d None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:56:12.338843 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-6696cc16-b509-4972-b835-57358273006d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:56:12.347377 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 766/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 19:56:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:56:12.632424 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4213f84-a400-4052-bead-fffe6f3c6ff0 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:56:12.634140 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-a4213f84-a400-4052-bead-fffe6f3c6ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:56:12.703613 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:56:12.718265 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4213f84-a400-4052-bead-fffe6f3c6ff0 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:56:12.724724 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9980c0-64d2-47d7-9e4c-4b8eef023218 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:56:12.724724 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9980c0-64d2-47d7-9e4c-4b8eef023218 service neutron] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:56:12.724724 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9980c0-64d2-47d7-9e4c-4b8eef023218 service neutron] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:56:12.724724 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9980c0-64d2-47d7-9e4c-4b8eef023218 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:56:12.731934 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9980c0-64d2-47d7-9e4c-4b8eef023218 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:56:12.733356 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9980c0-64d2-47d7-9e4c-4b8eef023218 service neutron] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:56:12.742582 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 764/1530] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:56:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:56:14.886300 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a11fa3-ae8f-4fae-8fbb-300cdc8d62e5 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:56:14.886879 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a11fa3-ae8f-4fae-8fbb-300cdc8d62e5 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:56:14.886879 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a11fa3-ae8f-4fae-8fbb-300cdc8d62e5 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:56:14.888296 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 767/1531] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 19:56:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:56:14.893665 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aee068-44d0-43f3-9d36-357e8ffa0422 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:56:14.899200 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aee068-44d0-43f3-9d36-357e8ffa0422 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:56:14.899200 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aee068-44d0-43f3-9d36-357e8ffa0422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:56:14.913848 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-52aee068-44d0-43f3-9d36-357e8ffa0422 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:56:14.914966 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-52aee068-44d0-43f3-9d36-357e8ffa0422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:56:14.923572 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 765/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 19:56:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:56:15.229151 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a11fa3-ae8f-4fae-8fbb-300cdc8d62e5 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:56:15.240440 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a11fa3-ae8f-4fae-8fbb-300cdc8d62e5 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:56:15.243975 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf2ac64-a520-4b15-83b9-a1de600849fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:56:15.244567 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf2ac64-a520-4b15-83b9-a1de600849fb service neutron] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:56:15.244849 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf2ac64-a520-4b15-83b9-a1de600849fb service neutron] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:56:15.245123 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf2ac64-a520-4b15-83b9-a1de600849fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:56:15.254438 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf2ac64-a520-4b15-83b9-a1de600849fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:56:15.255849 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf2ac64-a520-4b15-83b9-a1de600849fb service neutron] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:56:15.266129 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 768/1533] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:56:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:56:18.977302 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da243d0c-a4d0-494b-80ac-3714a541a1fe None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:56:18.978009 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da243d0c-a4d0-494b-80ac-3714a541a1fe None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:56:18.978009 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da243d0c-a4d0-494b-80ac-3714a541a1fe None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:56:18.979259 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 766/1534] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 19:56:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:56:18.984927 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f3583-881b-452e-bbff-72997f77364f None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:56:18.985334 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f3583-881b-452e-bbff-72997f77364f None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:56:18.985470 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f3583-881b-452e-bbff-72997f77364f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:56:19.004766 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-2c3f3583-881b-452e-bbff-72997f77364f None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:56:19.005985 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-2c3f3583-881b-452e-bbff-72997f77364f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:56:19.013662 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 769/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 19:56:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:56:19.320630 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da243d0c-a4d0-494b-80ac-3714a541a1fe None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:56:19.322366 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-da243d0c-a4d0-494b-80ac-3714a541a1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:56:19.400388 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da243d0c-a4d0-494b-80ac-3714a541a1fe None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:56:19.404069 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba71603-f628-4c33-9568-926d71750a2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:56:19.404815 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba71603-f628-4c33-9568-926d71750a2f service cinder] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:56:19.405098 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba71603-f628-4c33-9568-926d71750a2f service cinder] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:56:19.405403 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba71603-f628-4c33-9568-926d71750a2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:56:19.414698 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba71603-f628-4c33-9568-926d71750a2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:56:19.416152 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba71603-f628-4c33-9568-926d71750a2f service cinder] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:56:19.426277 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 767/1536] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:56:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:56:21.575895 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb14098-bf3e-4b88-8fe2-79c9977a6d42 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:56:21.577140 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb14098-bf3e-4b88-8fe2-79c9977a6d42 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:56:21.577140 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb14098-bf3e-4b88-8fe2-79c9977a6d42 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:56:21.577861 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 770/1537] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 19:56:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:56:21.583573 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e893e3-b047-427a-aab7-5d9b2919ac93 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:56:21.584010 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e893e3-b047-427a-aab7-5d9b2919ac93 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:56:21.584113 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e893e3-b047-427a-aab7-5d9b2919ac93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:56:21.604202 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-45e893e3-b047-427a-aab7-5d9b2919ac93 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:56:21.605411 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-45e893e3-b047-427a-aab7-5d9b2919ac93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:56:21.614285 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 768/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 19:56:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:56:21.931702 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb14098-bf3e-4b88-8fe2-79c9977a6d42 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:56:21.933455 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-7eb14098-bf3e-4b88-8fe2-79c9977a6d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:56:21.947200 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb14098-bf3e-4b88-8fe2-79c9977a6d42 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:56:21.950637 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88eda0e-bc1b-4352-9c81-6295017a0d81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:56:21.951298 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88eda0e-bc1b-4352-9c81-6295017a0d81 service cinder] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:56:21.951580 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88eda0e-bc1b-4352-9c81-6295017a0d81 service cinder] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:56:21.951867 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88eda0e-bc1b-4352-9c81-6295017a0d81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:56:21.960547 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88eda0e-bc1b-4352-9c81-6295017a0d81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:56:21.961984 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88eda0e-bc1b-4352-9c81-6295017a0d81 service cinder] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:56:21.971519 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 771/1539] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:56:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:56:31.599034 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=50 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:56:31.967347 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=50 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:57:57.086105 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad36ddc-9b26-4f71-88fa-95a10588b71e None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:57.086710 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad36ddc-9b26-4f71-88fa-95a10588b71e None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:57.086710 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad36ddc-9b26-4f71-88fa-95a10588b71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:57.113717 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-4ad36ddc-9b26-4f71-88fa-95a10588b71e None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:57:57.115352 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-4ad36ddc-9b26-4f71-88fa-95a10588b71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:57:57.128561 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 769/1540] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:57:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:57:57.138164 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65daed1b-79c5-4928-b713-51b78eb8835d None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:57.149020 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65daed1b-79c5-4928-b713-51b78eb8835d None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:57.149020 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65daed1b-79c5-4928-b713-51b78eb8835d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:57.149228 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152ba4d-dd25-4636-bceb-b8f5564af970 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:57.149228 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152ba4d-dd25-4636-bceb-b8f5564af970 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:57.149228 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152ba4d-dd25-4636-bceb-b8f5564af970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:57.175026 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-65daed1b-79c5-4928-b713-51b78eb8835d None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:57:57.176226 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-65daed1b-79c5-4928-b713-51b78eb8835d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:57:57.206012 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 772/1541] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:57:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:57:57.208240 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca72c38-389a-4b84-90b2-539396513418 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:57.208526 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca72c38-389a-4b84-90b2-539396513418 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:57.208799 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca72c38-389a-4b84-90b2-539396513418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:57.211266 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-0152ba4d-dd25-4636-bceb-b8f5564af970 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:57:57.213194 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-0152ba4d-dd25-4636-bceb-b8f5564af970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:57:57.228630 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 770/1542] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:57:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:57:57.237384 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66deab2e-94eb-4ad5-93ee-66203b66def4 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:57.237707 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66deab2e-94eb-4ad5-93ee-66203b66def4 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:57.237983 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66deab2e-94eb-4ad5-93ee-66203b66def4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:57.252091 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-eca72c38-389a-4b84-90b2-539396513418 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:57:57.258777 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-eca72c38-389a-4b84-90b2-539396513418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:57:57.266460 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-66deab2e-94eb-4ad5-93ee-66203b66def4 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:57:57.267585 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-66deab2e-94eb-4ad5-93ee-66203b66def4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:57:57.282683 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 771/1543] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:57:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:57:57.284480 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45ddb9-8692-4435-a333-ef9654a09bc4 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:57.284766 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45ddb9-8692-4435-a333-ef9654a09bc4 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:57.285036 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45ddb9-8692-4435-a333-ef9654a09bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:57.287201 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 773/1544] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:57:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:57:57.288460 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34299e90-63ec-417a-8c20-2bb54103993d None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:57.288742 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34299e90-63ec-417a-8c20-2bb54103993d None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:57.289014 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34299e90-63ec-417a-8c20-2bb54103993d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:57.320034 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-bd45ddb9-8692-4435-a333-ef9654a09bc4 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:57:57.321232 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-bd45ddb9-8692-4435-a333-ef9654a09bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:57:57.321366 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-34299e90-63ec-417a-8c20-2bb54103993d None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:57:57.322488 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-34299e90-63ec-417a-8c20-2bb54103993d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:57:57.341140 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 772/1545] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:57:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:57:57.343324 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 774/1546] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:57:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:57:57.344390 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd45ddb9-8692-4435-a333-ef9654a09bc4 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:57:57.345419 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34299e90-63ec-417a-8c20-2bb54103993d None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:57:57.364641 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd45ddb9-8692-4435-a333-ef9654a09bc4 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:57:57.366263 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34299e90-63ec-417a-8c20-2bb54103993d None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:57:57.375414 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21845e6-13a8-4932-a524-37fddb1f6d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:57:57.375611 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ccab6-926a-4c8a-b119-5e667b8bcb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:57:57.376187 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ccab6-926a-4c8a-b119-5e667b8bcb8d admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:57.376465 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ccab6-926a-4c8a-b119-5e667b8bcb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:57.376734 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ccab6-926a-4c8a-b119-5e667b8bcb8d admin admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:57.377147 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21845e6-13a8-4932-a524-37fddb1f6d57 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:57.377571 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ccab6-926a-4c8a-b119-5e667b8bcb8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:57:57.377879 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ccab6-926a-4c8a-b119-5e667b8bcb8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:57:57.378112 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21845e6-13a8-4932-a524-37fddb1f6d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:57.378575 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21845e6-13a8-4932-a524-37fddb1f6d57 admin admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:57.379481 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21845e6-13a8-4932-a524-37fddb1f6d57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:57:57.380006 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21845e6-13a8-4932-a524-37fddb1f6d57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:57:57.380355 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ccab6-926a-4c8a-b119-5e667b8bcb8d admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:57:57.381181 dv-cinder-859191-1-smb devstack@keystone.service[93399]: WARNING py.warnings [None req-d21845e6-13a8-4932-a524-37fddb1f6d57 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 19:57:57.381181 dv-cinder-859191-1-smb devstack@keystone.service[93399]: warnings.warn(msg) Sep 24 19:57:57.381181 dv-cinder-859191-1-smb devstack@keystone.service[93399]: Sep 24 19:57:57.382147 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21845e6-13a8-4932-a524-37fddb1f6d57 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:57:57.393278 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 775/1547] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 19:57:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:57:57.394429 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 773/1548] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 19:57:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:57:57.395252 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21845e6-13a8-4932-a524-37fddb1f6d57 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:57:57.395367 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a20ba-51a1-44e3-ba41-4cf012006997 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:57.395956 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a20ba-51a1-44e3-ba41-4cf012006997 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:57.396443 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a20ba-51a1-44e3-ba41-4cf012006997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:57.412726 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21845e6-13a8-4932-a524-37fddb1f6d57 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:57:57.418707 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-4f9a20ba-51a1-44e3-ba41-4cf012006997 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:57:57.419913 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-4f9a20ba-51a1-44e3-ba41-4cf012006997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:57:57.423929 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987e8ae9-c0bf-4b74-8261-b15ade9e4a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:57:57.424731 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e8ae9-c0bf-4b74-8261-b15ade9e4a22 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:57.425112 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e8ae9-c0bf-4b74-8261-b15ade9e4a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:57.425528 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e8ae9-c0bf-4b74-8261-b15ade9e4a22 admin admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:57.426211 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987e8ae9-c0bf-4b74-8261-b15ade9e4a22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:57:57.426515 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987e8ae9-c0bf-4b74-8261-b15ade9e4a22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:57:57.428175 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987e8ae9-c0bf-4b74-8261-b15ade9e4a22 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:57:57.429932 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 776/1549] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:57:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:57:57.430962 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96523d19-1a61-474d-86d8-2b972dfa2165 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:57.431245 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96523d19-1a61-474d-86d8-2b972dfa2165 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:57.431522 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96523d19-1a61-474d-86d8-2b972dfa2165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:57.442065 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 774/1550] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 19:57:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:57:57.443312 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5cd32b-8882-4e2b-8ddf-307b38a77530 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:57.443598 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5cd32b-8882-4e2b-8ddf-307b38a77530 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:57.443893 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5cd32b-8882-4e2b-8ddf-307b38a77530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:57.451056 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-96523d19-1a61-474d-86d8-2b972dfa2165 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:57:57.452246 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-96523d19-1a61-474d-86d8-2b972dfa2165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:57:57.460298 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 777/1551] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:57:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:57:57.461654 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72e616-3a44-4015-9c0e-113f33575677 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:57.461935 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72e616-3a44-4015-9c0e-113f33575677 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:57.462265 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72e616-3a44-4015-9c0e-113f33575677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:57.466867 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-fd5cd32b-8882-4e2b-8ddf-307b38a77530 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:57:57.468048 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-fd5cd32b-8882-4e2b-8ddf-307b38a77530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:57:57.475837 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 775/1552] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:57:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:57:57.476857 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5cd32b-8882-4e2b-8ddf-307b38a77530 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:57:57.482469 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-da72e616-3a44-4015-9c0e-113f33575677 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:57:57.483653 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-da72e616-3a44-4015-9c0e-113f33575677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:57:57.486951 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5cd32b-8882-4e2b-8ddf-307b38a77530 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:57:57.491536 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 778/1553] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:57:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:57:57.491768 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d80b52-066b-4121-9159-c8ba05e0acc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:57:57.492128 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d80b52-066b-4121-9159-c8ba05e0acc5 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:57.492401 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d80b52-066b-4121-9159-c8ba05e0acc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:57.492666 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d80b52-066b-4121-9159-c8ba05e0acc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:57.493284 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d80b52-066b-4121-9159-c8ba05e0acc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:57:57.494503 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72e616-3a44-4015-9c0e-113f33575677 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:57:57.495215 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d80b52-066b-4121-9159-c8ba05e0acc5 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:57:57.504900 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72e616-3a44-4015-9c0e-113f33575677 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:57:57.509509 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65674e87-ae6d-4a0c-9bb4-b63c9088f408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:57:57.510109 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65674e87-ae6d-4a0c-9bb4-b63c9088f408 admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:57.510387 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65674e87-ae6d-4a0c-9bb4-b63c9088f408 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:57.510659 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65674e87-ae6d-4a0c-9bb4-b63c9088f408 admin admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:57.511857 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65674e87-ae6d-4a0c-9bb4-b63c9088f408 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:57:57.512859 dv-cinder-859191-1-smb devstack@keystone.service[93400]: WARNING py.warnings [None req-65674e87-ae6d-4a0c-9bb4-b63c9088f408 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 19:57:57.512859 dv-cinder-859191-1-smb devstack@keystone.service[93400]: warnings.warn(msg) Sep 24 19:57:57.512859 dv-cinder-859191-1-smb devstack@keystone.service[93400]: Sep 24 19:57:57.514076 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65674e87-ae6d-4a0c-9bb4-b63c9088f408 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:57:57.619444 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 776/1554] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 19:57:57 2022] POST /identity/v3/projects => generated 391 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:57:57.621113 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae0429-87dd-450f-b6bf-da7a00d754c3 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:57.621408 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae0429-87dd-450f-b6bf-da7a00d754c3 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:57.621714 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae0429-87dd-450f-b6bf-da7a00d754c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:57.645802 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 779/1555] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 19:57:57 2022] POST /identity/v3/projects => generated 363 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:57:57.646029 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-07ae0429-87dd-450f-b6bf-da7a00d754c3 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:57:57.646029 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-07ae0429-87dd-450f-b6bf-da7a00d754c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:57:57.646197 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7f61c-d8a5-490e-bb32-555ed6a2e8e6 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:57.646197 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7f61c-d8a5-490e-bb32-555ed6a2e8e6 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:57.646197 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7f61c-d8a5-490e-bb32-555ed6a2e8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:57.665121 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-c9b7f61c-d8a5-490e-bb32-555ed6a2e8e6 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:57:57.669099 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-c9b7f61c-d8a5-490e-bb32-555ed6a2e8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:57:57.716715 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 777/1556] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:57:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:57:57.718278 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae0429-87dd-450f-b6bf-da7a00d754c3 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:57:57.728368 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae0429-87dd-450f-b6bf-da7a00d754c3 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:57:57.734410 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0743571b-7bfd-4396-9af9-d640d70fc603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:57:57.738471 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 780/1557] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:57:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:57:57.738636 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743571b-7bfd-4396-9af9-d640d70fc603 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:57.738636 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743571b-7bfd-4396-9af9-d640d70fc603 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:57.738636 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743571b-7bfd-4396-9af9-d640d70fc603 admin admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:57.738881 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7f61c-d8a5-490e-bb32-555ed6a2e8e6 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:57:57.738969 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0743571b-7bfd-4396-9af9-d640d70fc603 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:57:57.739053 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0743571b-7bfd-4396-9af9-d640d70fc603 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:57:57.745032 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7f61c-d8a5-490e-bb32-555ed6a2e8e6 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:57:57.750400 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74352af-2c7c-4c8e-8185-777f824f59f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:57:57.751042 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74352af-2c7c-4c8e-8185-777f824f59f6 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:57.751295 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74352af-2c7c-4c8e-8185-777f824f59f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:57.751566 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74352af-2c7c-4c8e-8185-777f824f59f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:57.752202 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74352af-2c7c-4c8e-8185-777f824f59f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:57:57.752534 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74352af-2c7c-4c8e-8185-777f824f59f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:57:57.754136 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74352af-2c7c-4c8e-8185-777f824f59f6 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:57:57.766558 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 781/1558] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 19:57:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:57:57.767928 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd5754-7cdf-411a-a9b6-60b614339f31 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:57.768215 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd5754-7cdf-411a-a9b6-60b614339f31 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:57.768474 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd5754-7cdf-411a-a9b6-60b614339f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:57.788048 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-2bbd5754-7cdf-411a-a9b6-60b614339f31 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:57:57.789299 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-2bbd5754-7cdf-411a-a9b6-60b614339f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:57:57.797660 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 782/1559] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:57:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:57:57.798823 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc528d-1bca-43f3-b88f-ba5060e6a949 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:57.799273 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc528d-1bca-43f3-b88f-ba5060e6a949 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:57.799552 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc528d-1bca-43f3-b88f-ba5060e6a949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:57.818204 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-ffdc528d-1bca-43f3-b88f-ba5060e6a949 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:57:57.819363 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-ffdc528d-1bca-43f3-b88f-ba5060e6a949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:57:57.827888 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 783/1560] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:57:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:57:57.828634 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc528d-1bca-43f3-b88f-ba5060e6a949 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:57:57.835741 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 778/1561] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 19:57:57 2022] POST /identity/v3/projects => generated 375 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:57:57.836573 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0743571b-7bfd-4396-9af9-d640d70fc603 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:57:57.838395 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc528d-1bca-43f3-b88f-ba5060e6a949 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:57:57.886795 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:57:57.895341 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7841911b-5957-4838-90b1-e91bda2b50b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:57:57.895954 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841911b-5957-4838-90b1-e91bda2b50b3 admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:57.896235 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841911b-5957-4838-90b1-e91bda2b50b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:57.896507 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841911b-5957-4838-90b1-e91bda2b50b3 admin admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:57.897166 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7841911b-5957-4838-90b1-e91bda2b50b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:57:57.899107 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7841911b-5957-4838-90b1-e91bda2b50b3 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:57:57.899403 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0743571b-7bfd-4396-9af9-d640d70fc603 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:57:57.905873 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d93527-6db7-4232-8288-4bf60074bd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:57:57.910662 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d93527-6db7-4232-8288-4bf60074bd07 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:57.910662 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d93527-6db7-4232-8288-4bf60074bd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:57.910662 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d93527-6db7-4232-8288-4bf60074bd07 admin admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:57.910662 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d93527-6db7-4232-8288-4bf60074bd07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:57:57.911096 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:57:57.911198 dv-cinder-859191-1-smb devstack@keystone.service[93399]: WARNING py.warnings [None req-b4d93527-6db7-4232-8288-4bf60074bd07 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 19:57:57.911198 dv-cinder-859191-1-smb devstack@keystone.service[93399]: warnings.warn(msg) Sep 24 19:57:57.911198 dv-cinder-859191-1-smb devstack@keystone.service[93399]: Sep 24 19:57:57.911198 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d93527-6db7-4232-8288-4bf60074bd07 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:57:57.995072 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 784/1562] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:57:57 2022] POST /identity/v3/users => generated 296 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:57:57.996834 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f54e3-08ef-491c-bc67-899d78b766a3 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:57.997119 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f54e3-08ef-491c-bc67-899d78b766a3 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:57.997388 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f54e3-08ef-491c-bc67-899d78b766a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:58.012040 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 779/1563] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:57:57 2022] POST /identity/v3/users => generated 282 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:57:58.016104 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d93527-6db7-4232-8288-4bf60074bd07 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:57:58.018129 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-527f54e3-08ef-491c-bc67-899d78b766a3 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:57:58.019321 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-527f54e3-08ef-491c-bc67-899d78b766a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:57:58.026180 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d93527-6db7-4232-8288-4bf60074bd07 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:57:58.027664 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 785/1564] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:57:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:57:58.028216 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f54e3-08ef-491c-bc67-899d78b766a3 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:57:58.034054 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c243ebaf-cc0c-40af-9647-91e774f47cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:57:58.034647 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243ebaf-cc0c-40af-9647-91e774f47cef admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:58.034924 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243ebaf-cc0c-40af-9647-91e774f47cef admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:58.035194 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243ebaf-cc0c-40af-9647-91e774f47cef admin admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:58.035863 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c243ebaf-cc0c-40af-9647-91e774f47cef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:57:58.036163 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c243ebaf-cc0c-40af-9647-91e774f47cef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:57:58.037339 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f54e3-08ef-491c-bc67-899d78b766a3 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:57:58.037843 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c243ebaf-cc0c-40af-9647-91e774f47cef admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:57:58.042037 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d9793-030c-45e7-bc33-efce95771885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:57:58.042788 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d9793-030c-45e7-bc33-efce95771885 admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:58.043107 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d9793-030c-45e7-bc33-efce95771885 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:58.043450 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d9793-030c-45e7-bc33-efce95771885 admin admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:58.044090 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617d9793-030c-45e7-bc33-efce95771885 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:57:58.046133 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617d9793-030c-45e7-bc33-efce95771885 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:57:58.051130 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 780/1565] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 19:57:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:57:58.051952 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c243ebaf-cc0c-40af-9647-91e774f47cef admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:57:58.063225 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c243ebaf-cc0c-40af-9647-91e774f47cef admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:57:58.067971 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e8c6a-c21e-49fb-ab9f-ed22519171b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:57:58.068571 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e8c6a-c21e-49fb-ab9f-ed22519171b0 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:58.069181 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e8c6a-c21e-49fb-ab9f-ed22519171b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:58.069468 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e8c6a-c21e-49fb-ab9f-ed22519171b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:58.070256 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5e8c6a-c21e-49fb-ab9f-ed22519171b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:57:58.070603 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5e8c6a-c21e-49fb-ab9f-ed22519171b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:57:58.072538 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5e8c6a-c21e-49fb-ab9f-ed22519171b0 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:57:58.085300 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 781/1566] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 19:57:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:57:58.086386 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e8c6a-c21e-49fb-ab9f-ed22519171b0 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:57:58.097559 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e8c6a-c21e-49fb-ab9f-ed22519171b0 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:57:58.102135 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb19d78-4edc-47e6-be13-01a6eef505ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:57:58.109685 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb19d78-4edc-47e6-be13-01a6eef505ac admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:58.109685 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb19d78-4edc-47e6-be13-01a6eef505ac admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:58.109685 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb19d78-4edc-47e6-be13-01a6eef505ac admin admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:58.109685 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb19d78-4edc-47e6-be13-01a6eef505ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:57:58.109685 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb19d78-4edc-47e6-be13-01a6eef505ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:57:58.109685 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb19d78-4edc-47e6-be13-01a6eef505ac admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:57:58.118216 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 782/1567] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 19:57:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:57:58.118980 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb19d78-4edc-47e6-be13-01a6eef505ac admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:57:58.128948 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb19d78-4edc-47e6-be13-01a6eef505ac admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:57:58.133520 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e064ba-dcaf-4c41-8d59-ea10d3e7db31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:57:58.134144 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 786/1568] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 19:57:58 2022] POST /identity/v3/projects => generated 405 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:57:58.134273 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e064ba-dcaf-4c41-8d59-ea10d3e7db31 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:58.134444 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e064ba-dcaf-4c41-8d59-ea10d3e7db31 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:58.134826 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e064ba-dcaf-4c41-8d59-ea10d3e7db31 admin admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:58.134932 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d9793-030c-45e7-bc33-efce95771885 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:57:58.135444 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e064ba-dcaf-4c41-8d59-ea10d3e7db31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:57:58.138290 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e064ba-dcaf-4c41-8d59-ea10d3e7db31 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:57:58.200799 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d9793-030c-45e7-bc33-efce95771885 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:57:58.205449 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e362d-4f5c-4c7e-a164-3dedbb309af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:57:58.206080 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e362d-4f5c-4c7e-a164-3dedbb309af2 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:58.206359 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e362d-4f5c-4c7e-a164-3dedbb309af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:58.206626 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e362d-4f5c-4c7e-a164-3dedbb309af2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:58.207257 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6e362d-4f5c-4c7e-a164-3dedbb309af2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:57:58.208816 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6e362d-4f5c-4c7e-a164-3dedbb309af2 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:57:58.218928 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 787/1569] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:57:58 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:57:58.219725 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e362d-4f5c-4c7e-a164-3dedbb309af2 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:57:58.226587 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 783/1570] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:57:58 2022] POST /identity/v3/users => generated 288 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:57:58.226587 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e064ba-dcaf-4c41-8d59-ea10d3e7db31 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:57:58.229760 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e362d-4f5c-4c7e-a164-3dedbb309af2 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:57:58.234520 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d0e9ce-aa2e-4de0-acb7-e3158c69c105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:57:58.235998 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0e9ce-aa2e-4de0-acb7-e3158c69c105 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:58.235998 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0e9ce-aa2e-4de0-acb7-e3158c69c105 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:58.235998 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0e9ce-aa2e-4de0-acb7-e3158c69c105 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:58.236274 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d0e9ce-aa2e-4de0-acb7-e3158c69c105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:57:58.236372 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e064ba-dcaf-4c41-8d59-ea10d3e7db31 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:57:58.237813 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d0e9ce-aa2e-4de0-acb7-e3158c69c105 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:57:58.240886 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698236f2-e0ac-454a-aee5-628df6e72b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:57:58.241518 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698236f2-e0ac-454a-aee5-628df6e72b7e admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:58.241799 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698236f2-e0ac-454a-aee5-628df6e72b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:58.242066 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698236f2-e0ac-454a-aee5-628df6e72b7e admin admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:58.242696 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698236f2-e0ac-454a-aee5-628df6e72b7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:57:58.243407 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698236f2-e0ac-454a-aee5-628df6e72b7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:57:58.244632 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698236f2-e0ac-454a-aee5-628df6e72b7e admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:57:58.248627 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 788/1571] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:57:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:57:58.249435 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d0e9ce-aa2e-4de0-acb7-e3158c69c105 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:57:58.258360 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 784/1572] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 19:57:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:57:58.259228 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698236f2-e0ac-454a-aee5-628df6e72b7e admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:57:58.262003 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d0e9ce-aa2e-4de0-acb7-e3158c69c105 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:57:58.266658 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109751fa-6ffe-42fa-9793-f657e9374df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:57:58.267260 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109751fa-6ffe-42fa-9793-f657e9374df2 admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:58.267538 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109751fa-6ffe-42fa-9793-f657e9374df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:58.267848 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109751fa-6ffe-42fa-9793-f657e9374df2 admin admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:58.268466 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109751fa-6ffe-42fa-9793-f657e9374df2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:57:58.270373 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109751fa-6ffe-42fa-9793-f657e9374df2 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:57:58.271392 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698236f2-e0ac-454a-aee5-628df6e72b7e admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:57:58.276168 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806358ac-4993-4727-a168-114e0cdc2997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:57:58.276806 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806358ac-4993-4727-a168-114e0cdc2997 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:58.277078 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806358ac-4993-4727-a168-114e0cdc2997 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:58.277328 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806358ac-4993-4727-a168-114e0cdc2997 admin admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:58.277976 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806358ac-4993-4727-a168-114e0cdc2997 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:57:58.279899 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806358ac-4993-4727-a168-114e0cdc2997 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:57:58.371904 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 789/1573] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 19:57:58 2022] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:57:58.371904 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109751fa-6ffe-42fa-9793-f657e9374df2 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:57:58.394283 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 785/1574] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 19:57:58 2022] POST /identity/v3/projects => generated 383 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:57:58.394283 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806358ac-4993-4727-a168-114e0cdc2997 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:57:58.435710 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109751fa-6ffe-42fa-9793-f657e9374df2 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:57:58.466368 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806358ac-4993-4727-a168-114e0cdc2997 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:57:58.468326 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:57:58.472358 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf4fecb-d762-4493-bc4e-da7a6ed2c735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:57:58.472971 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4fecb-d762-4493-bc4e-da7a6ed2c735 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:58.473250 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4fecb-d762-4493-bc4e-da7a6ed2c735 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:58.473627 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4fecb-d762-4493-bc4e-da7a6ed2c735 admin admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:58.480306 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf4fecb-d762-4493-bc4e-da7a6ed2c735 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:57:58.480306 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf4fecb-d762-4493-bc4e-da7a6ed2c735 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:57:58.498242 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf594f09-1b29-49a8-8cef-3cd0fa2a0405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:57:58.499820 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf594f09-1b29-49a8-8cef-3cd0fa2a0405 admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:58.499820 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf594f09-1b29-49a8-8cef-3cd0fa2a0405 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:58.499820 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf594f09-1b29-49a8-8cef-3cd0fa2a0405 admin admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:58.500238 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf594f09-1b29-49a8-8cef-3cd0fa2a0405 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:57:58.502025 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf594f09-1b29-49a8-8cef-3cd0fa2a0405 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:57:58.590186 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 786/1575] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:57:58 2022] POST /identity/v3/users => generated 303 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:57:58.591035 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf4fecb-d762-4493-bc4e-da7a6ed2c735 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:57:58.592790 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 790/1576] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 19:57:58 2022] POST /identity/v3/projects => generated 381 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:57:58.593984 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf594f09-1b29-49a8-8cef-3cd0fa2a0405 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:57:58.602752 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf4fecb-d762-4493-bc4e-da7a6ed2c735 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:57:58.647240 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:57:58.663222 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf594f09-1b29-49a8-8cef-3cd0fa2a0405 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:57:58.670162 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c8ca0b-ace0-49ed-8d94-31e4c9d6c5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:57:58.670926 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8ca0b-ace0-49ed-8d94-31e4c9d6c5c0 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:58.671210 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8ca0b-ace0-49ed-8d94-31e4c9d6c5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:58.671484 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8ca0b-ace0-49ed-8d94-31e4c9d6c5c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:58.672143 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c8ca0b-ace0-49ed-8d94-31e4c9d6c5c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:57:58.674327 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c8ca0b-ace0-49ed-8d94-31e4c9d6c5c0 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:57:58.688637 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 791/1577] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:57:58 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:57:58.689591 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4160953-3cd4-4063-b1be-f6c4c7d6a352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:57:58.689755 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c8ca0b-ace0-49ed-8d94-31e4c9d6c5c0 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:57:58.690623 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4160953-3cd4-4063-b1be-f6c4c7d6a352 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:58.691818 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4160953-3cd4-4063-b1be-f6c4c7d6a352 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:58.692146 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4160953-3cd4-4063-b1be-f6c4c7d6a352 admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:58.693225 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4160953-3cd4-4063-b1be-f6c4c7d6a352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:57:58.694865 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4160953-3cd4-4063-b1be-f6c4c7d6a352 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:57:58.704934 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c8ca0b-ace0-49ed-8d94-31e4c9d6c5c0 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:57:58.706363 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 787/1578] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:57:58 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:57:58.709812 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4160953-3cd4-4063-b1be-f6c4c7d6a352 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:57:58.712898 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8a9c4-2553-44dc-9959-f7b356ff3d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:57:58.713549 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8a9c4-2553-44dc-9959-f7b356ff3d3d admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:58.713853 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8a9c4-2553-44dc-9959-f7b356ff3d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:58.714841 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8a9c4-2553-44dc-9959-f7b356ff3d3d admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:58.716075 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff8a9c4-2553-44dc-9959-f7b356ff3d3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:57:58.718730 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4160953-3cd4-4063-b1be-f6c4c7d6a352 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:57:58.718860 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff8a9c4-2553-44dc-9959-f7b356ff3d3d admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:57:58.725829 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f52ed-6804-4b81-aa0b-e66f881d935a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:57:58.726773 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f52ed-6804-4b81-aa0b-e66f881d935a admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:58.727060 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f52ed-6804-4b81-aa0b-e66f881d935a admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:58.727338 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f52ed-6804-4b81-aa0b-e66f881d935a admin admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:58.727975 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f52ed-6804-4b81-aa0b-e66f881d935a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:57:58.730655 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f52ed-6804-4b81-aa0b-e66f881d935a admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:57:58.734258 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 792/1579] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:57:58 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:57:58.734258 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8a9c4-2553-44dc-9959-f7b356ff3d3d admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:57:58.742368 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8a9c4-2553-44dc-9959-f7b356ff3d3d admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:57:58.747663 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff58085a-4417-4399-9ea2-92e353c2c59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:57:58.748275 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff58085a-4417-4399-9ea2-92e353c2c59d admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:58.748560 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff58085a-4417-4399-9ea2-92e353c2c59d admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:58.748837 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff58085a-4417-4399-9ea2-92e353c2c59d admin admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:58.749566 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff58085a-4417-4399-9ea2-92e353c2c59d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:57:58.751503 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff58085a-4417-4399-9ea2-92e353c2c59d admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:57:58.825646 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 788/1580] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 19:57:58 2022] POST /identity/v3/projects => generated 379 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:57:58.826582 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f52ed-6804-4b81-aa0b-e66f881d935a admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:57:58.844651 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 793/1581] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:57:58 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:57:58.846113 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff58085a-4417-4399-9ea2-92e353c2c59d admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:57:58.859143 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff58085a-4417-4399-9ea2-92e353c2c59d admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:57:58.900498 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f52ed-6804-4b81-aa0b-e66f881d935a admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:57:58.907570 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f13e77-329f-4470-beac-024081288fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:57:58.908324 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f13e77-329f-4470-beac-024081288fe9 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:58.908445 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f13e77-329f-4470-beac-024081288fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:58.908713 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f13e77-329f-4470-beac-024081288fe9 admin admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:58.909341 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f13e77-329f-4470-beac-024081288fe9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:57:58.911394 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f13e77-329f-4470-beac-024081288fe9 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:57:58.923142 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636998a-e201-4e67-893a-2d45ec92eb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:57:58.923855 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636998a-e201-4e67-893a-2d45ec92eb54 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:58.924208 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636998a-e201-4e67-893a-2d45ec92eb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:58.924560 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636998a-e201-4e67-893a-2d45ec92eb54 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:58.925278 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2636998a-e201-4e67-893a-2d45ec92eb54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:57:58.926974 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2636998a-e201-4e67-893a-2d45ec92eb54 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:57:58.937888 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 794/1582] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:57:58 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:57:58.938770 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636998a-e201-4e67-893a-2d45ec92eb54 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:57:58.952191 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636998a-e201-4e67-893a-2d45ec92eb54 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:57:58.958467 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b02cf-acf1-4d55-a469-0025de6ef673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:57:58.959062 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b02cf-acf1-4d55-a469-0025de6ef673 admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:58.959337 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b02cf-acf1-4d55-a469-0025de6ef673 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:58.959625 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b02cf-acf1-4d55-a469-0025de6ef673 admin admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:58.960335 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b02cf-acf1-4d55-a469-0025de6ef673 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:57:58.962523 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b02cf-acf1-4d55-a469-0025de6ef673 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:57:59.040275 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 789/1583] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:57:58 2022] POST /identity/v3/users => generated 292 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:57:59.040275 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f13e77-329f-4470-beac-024081288fe9 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:57:59.047696 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f13e77-329f-4470-beac-024081288fe9 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:57:59.052436 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b95b5-ef77-44b4-a087-727522ae4ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:57:59.053031 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b95b5-ef77-44b4-a087-727522ae4ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:59.053306 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b95b5-ef77-44b4-a087-727522ae4ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:59.053607 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b95b5-ef77-44b4-a087-727522ae4ac3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:59.054246 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04b95b5-ef77-44b4-a087-727522ae4ac3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:57:59.055911 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04b95b5-ef77-44b4-a087-727522ae4ac3 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:57:59.063189 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 795/1584] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:57:58 2022] POST /identity/v3/users => generated 291 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:57:59.067792 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b02cf-acf1-4d55-a469-0025de6ef673 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:57:59.069064 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:57:59.072508 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 790/1585] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:57:59.074131 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b95b5-ef77-44b4-a087-727522ae4ac3 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:57:59.078594 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b02cf-acf1-4d55-a469-0025de6ef673 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:57:59.083506 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd812ca-9ea8-4e72-953d-b3afbf5992f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:57:59.084237 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd812ca-9ea8-4e72-953d-b3afbf5992f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:59.084530 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd812ca-9ea8-4e72-953d-b3afbf5992f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:59.084796 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd812ca-9ea8-4e72-953d-b3afbf5992f2 admin admin] PATH_INFO: `/v3/projects/803d5cd8d67842f79d6d5e909e4b29fd/users/b418518e8d14456d81965247b5e42003/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:59.086002 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b95b5-ef77-44b4-a087-727522ae4ac3 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:57:59.091299 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f602f4e1-1e70-4e45-87f5-2ff8b268343b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:57:59.092226 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602f4e1-1e70-4e45-87f5-2ff8b268343b admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:59.092226 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602f4e1-1e70-4e45-87f5-2ff8b268343b admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:59.092516 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602f4e1-1e70-4e45-87f5-2ff8b268343b admin admin] PATH_INFO: `/v3/projects/2f682ebc17b441a6800e911f74ab1ce0/users/6a03b162171c44eb9ac697c8e64d0a9a/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:59.105824 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd812ca-9ea8-4e72-953d-b3afbf5992f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=803d5cd8d67842f79d6d5e909e4b29fd, user_id=b418518e8d14456d81965247b5e42003, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:57:59.106898 dv-cinder-859191-1-smb devstack@keystone.service[93400]: WARNING py.warnings [None req-3cd812ca-9ea8-4e72-953d-b3afbf5992f2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 19:57:59.106898 dv-cinder-859191-1-smb devstack@keystone.service[93400]: warnings.warn(msg) Sep 24 19:57:59.106898 dv-cinder-859191-1-smb devstack@keystone.service[93400]: Sep 24 19:57:59.108840 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd812ca-9ea8-4e72-953d-b3afbf5992f2 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:57:59.110610 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f602f4e1-1e70-4e45-87f5-2ff8b268343b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f682ebc17b441a6800e911f74ab1ce0, user_id=6a03b162171c44eb9ac697c8e64d0a9a, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:57:59.113323 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f602f4e1-1e70-4e45-87f5-2ff8b268343b admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:57:59.178497 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 796/1586] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:57:59 2022] PUT /identity/v3/projects/803d5cd8d67842f79d6d5e909e4b29fd/users/b418518e8d14456d81965247b5e42003/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:57:59.179369 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd812ca-9ea8-4e72-953d-b3afbf5992f2 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:57:59.206662 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 791/1587] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:57:59 2022] PUT /identity/v3/projects/2f682ebc17b441a6800e911f74ab1ce0/users/6a03b162171c44eb9ac697c8e64d0a9a/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:57:59.221376 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f602f4e1-1e70-4e45-87f5-2ff8b268343b admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:57:59.246145 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd812ca-9ea8-4e72-953d-b3afbf5992f2 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:57:59.272251 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f602f4e1-1e70-4e45-87f5-2ff8b268343b admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:57:59.277641 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd052e-3441-4819-82ce-20e64cc17562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:57:59.278254 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd052e-3441-4819-82ce-20e64cc17562 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:59.278542 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd052e-3441-4819-82ce-20e64cc17562 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:59.278802 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd052e-3441-4819-82ce-20e64cc17562 admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:59.279472 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cd052e-3441-4819-82ce-20e64cc17562 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:57:59.281066 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cd052e-3441-4819-82ce-20e64cc17562 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:57:59.287186 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:57:59.291789 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 792/1588] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:57:59.297531 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd052e-3441-4819-82ce-20e64cc17562 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:57:59.302823 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd052e-3441-4819-82ce-20e64cc17562 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:57:59.307306 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b706411f-53e9-4ae2-8064-cfc95aa4b8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:57:59.307440 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a8da0-640b-49dd-8b93-a73026b42120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:57:59.308537 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b706411f-53e9-4ae2-8064-cfc95aa4b8cd admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:59.308707 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a8da0-640b-49dd-8b93-a73026b42120 admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:59.308835 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b706411f-53e9-4ae2-8064-cfc95aa4b8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:59.308949 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a8da0-640b-49dd-8b93-a73026b42120 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:59.309193 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b706411f-53e9-4ae2-8064-cfc95aa4b8cd admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:59.309309 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a8da0-640b-49dd-8b93-a73026b42120 admin admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:59.309868 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634a8da0-640b-49dd-8b93-a73026b42120 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:57:59.309986 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b706411f-53e9-4ae2-8064-cfc95aa4b8cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:57:59.311435 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b706411f-53e9-4ae2-8064-cfc95aa4b8cd admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:57:59.311771 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634a8da0-640b-49dd-8b93-a73026b42120 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:57:59.323808 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 793/1589] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:57:59.325020 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b706411f-53e9-4ae2-8064-cfc95aa4b8cd admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:57:59.334416 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b706411f-53e9-4ae2-8064-cfc95aa4b8cd admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:57:59.339402 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0105b0c5-c0fd-4e2b-ba2e-79e818829e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:57:59.339971 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105b0c5-c0fd-4e2b-ba2e-79e818829e26 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:59.340274 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105b0c5-c0fd-4e2b-ba2e-79e818829e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:59.340541 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105b0c5-c0fd-4e2b-ba2e-79e818829e26 admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:59.341166 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0105b0c5-c0fd-4e2b-ba2e-79e818829e26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:57:59.342785 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0105b0c5-c0fd-4e2b-ba2e-79e818829e26 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:57:59.354050 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 794/1590] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:57:59.355384 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0105b0c5-c0fd-4e2b-ba2e-79e818829e26 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:57:59.364927 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0105b0c5-c0fd-4e2b-ba2e-79e818829e26 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:57:59.369708 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8794d8a1-2f3d-4575-ab02-2a172b25a25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:57:59.370802 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794d8a1-2f3d-4575-ab02-2a172b25a25c admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:59.371116 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794d8a1-2f3d-4575-ab02-2a172b25a25c admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:59.371390 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794d8a1-2f3d-4575-ab02-2a172b25a25c admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:59.372018 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8794d8a1-2f3d-4575-ab02-2a172b25a25c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:57:59.373609 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8794d8a1-2f3d-4575-ab02-2a172b25a25c admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:57:59.383573 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 795/1591] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:57:59.384514 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8794d8a1-2f3d-4575-ab02-2a172b25a25c admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:57:59.393710 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8794d8a1-2f3d-4575-ab02-2a172b25a25c admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:57:59.398251 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482f7ad-f090-4be2-8619-d1c18b10f9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:57:59.398864 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482f7ad-f090-4be2-8619-d1c18b10f9ff admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:59.399208 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482f7ad-f090-4be2-8619-d1c18b10f9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:59.399566 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482f7ad-f090-4be2-8619-d1c18b10f9ff admin admin] PATH_INFO: `/v3/projects/7a201af37a554d41bd558d3080a9d43f/users/c9eeba1b08304f6685f457d53cc68ae3/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:59.413972 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a482f7ad-f090-4be2-8619-d1c18b10f9ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a201af37a554d41bd558d3080a9d43f, user_id=c9eeba1b08304f6685f457d53cc68ae3, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:57:59.416637 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a482f7ad-f090-4be2-8619-d1c18b10f9ff admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:57:59.421584 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 797/1592] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:57:59 2022] POST /identity/v3/users => generated 290 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:57:59.421584 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39a683-efc0-4174-b2ef-6509a8409c63 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:59.421584 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39a683-efc0-4174-b2ef-6509a8409c63 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:59.421584 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39a683-efc0-4174-b2ef-6509a8409c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:59.439846 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-6e39a683-efc0-4174-b2ef-6509a8409c63 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:57:59.441068 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-6e39a683-efc0-4174-b2ef-6509a8409c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:57:59.448866 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 798/1593] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:57:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:57:59.450096 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cbcd62-7cee-4383-95d7-286c59c64a17 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:59.450382 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cbcd62-7cee-4383-95d7-286c59c64a17 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:59.450649 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cbcd62-7cee-4383-95d7-286c59c64a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:59.482783 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-81cbcd62-7cee-4383-95d7-286c59c64a17 None None] MFA Rules not processed for user `6a03b162171c44eb9ac697c8e64d0a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:57:59.483974 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-81cbcd62-7cee-4383-95d7-286c59c64a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:57:59.492861 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 796/1594] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:57:59 2022] PUT /identity/v3/projects/7a201af37a554d41bd558d3080a9d43f/users/c9eeba1b08304f6685f457d53cc68ae3/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:57:59.493743 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482f7ad-f090-4be2-8619-d1c18b10f9ff admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:57:59.557109 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:57:59.559968 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482f7ad-f090-4be2-8619-d1c18b10f9ff admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:57:59.562576 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 799/1595] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:57:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:57:59.563402 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cbcd62-7cee-4383-95d7-286c59c64a17 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:57:59.565256 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb62ca-7ede-4152-b7d3-ccb12e193e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:57:59.565971 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb62ca-7ede-4152-b7d3-ccb12e193e51 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:59.566248 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb62ca-7ede-4152-b7d3-ccb12e193e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:59.566520 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb62ca-7ede-4152-b7d3-ccb12e193e51 admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:59.567188 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcb62ca-7ede-4152-b7d3-ccb12e193e51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:57:59.568782 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcb62ca-7ede-4152-b7d3-ccb12e193e51 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:57:59.573796 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cbcd62-7cee-4383-95d7-286c59c64a17 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:57:59.578981 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167ea82-5006-4b0c-a0ae-df59afede0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:57:59.582754 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 797/1596] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:57:59.582910 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167ea82-5006-4b0c-a0ae-df59afede0f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:59.582910 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167ea82-5006-4b0c-a0ae-df59afede0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:59.582910 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167ea82-5006-4b0c-a0ae-df59afede0f1 admin admin] PATH_INFO: `/v3/projects/ecc2c27b688343738ce01c149d070388/users/03991d7560404899a64460c622cb79c7/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:59.583157 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb62ca-7ede-4152-b7d3-ccb12e193e51 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:57:59.590817 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb62ca-7ede-4152-b7d3-ccb12e193e51 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:57:59.595502 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90986a8-c0f3-4f61-bd6d-6d9a2d34660f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:57:59.596099 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90986a8-c0f3-4f61-bd6d-6d9a2d34660f admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:59.596380 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90986a8-c0f3-4f61-bd6d-6d9a2d34660f admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:59.596560 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f167ea82-5006-4b0c-a0ae-df59afede0f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecc2c27b688343738ce01c149d070388, user_id=03991d7560404899a64460c622cb79c7, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:57:59.596667 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90986a8-c0f3-4f61-bd6d-6d9a2d34660f admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:59.597269 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90986a8-c0f3-4f61-bd6d-6d9a2d34660f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:57:59.598877 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90986a8-c0f3-4f61-bd6d-6d9a2d34660f admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:57:59.599250 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f167ea82-5006-4b0c-a0ae-df59afede0f1 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:57:59.609728 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 798/1597] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:57:59.613195 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90986a8-c0f3-4f61-bd6d-6d9a2d34660f admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:57:59.620256 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90986a8-c0f3-4f61-bd6d-6d9a2d34660f admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:57:59.625180 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35835cf-146e-4889-bc9d-b2c7034eba78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:57:59.625780 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35835cf-146e-4889-bc9d-b2c7034eba78 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:59.626059 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35835cf-146e-4889-bc9d-b2c7034eba78 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:59.628489 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35835cf-146e-4889-bc9d-b2c7034eba78 admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:59.628489 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35835cf-146e-4889-bc9d-b2c7034eba78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:57:59.628489 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35835cf-146e-4889-bc9d-b2c7034eba78 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:57:59.638796 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 799/1598] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:57:59.639624 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35835cf-146e-4889-bc9d-b2c7034eba78 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:57:59.648863 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35835cf-146e-4889-bc9d-b2c7034eba78 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:57:59.654002 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082ea15-56e9-4382-b918-7a1b2bac4090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:57:59.654598 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082ea15-56e9-4382-b918-7a1b2bac4090 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:59.654873 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082ea15-56e9-4382-b918-7a1b2bac4090 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:59.655146 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082ea15-56e9-4382-b918-7a1b2bac4090 admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:59.655761 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e082ea15-56e9-4382-b918-7a1b2bac4090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:57:59.657358 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e082ea15-56e9-4382-b918-7a1b2bac4090 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:57:59.668047 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 800/1599] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:57:59.669005 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082ea15-56e9-4382-b918-7a1b2bac4090 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:57:59.682499 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 800/1600] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:57:59 2022] PUT /identity/v3/projects/ecc2c27b688343738ce01c149d070388/users/03991d7560404899a64460c622cb79c7/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:57:59.686720 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181a75b-230f-4b11-82e6-018955e46213 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:59.686720 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181a75b-230f-4b11-82e6-018955e46213 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:59.686720 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181a75b-230f-4b11-82e6-018955e46213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:59.715068 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-0181a75b-230f-4b11-82e6-018955e46213 None None] MFA Rules not processed for user `c9eeba1b08304f6685f457d53cc68ae3`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:57:59.716220 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-0181a75b-230f-4b11-82e6-018955e46213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:57:59.724885 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082ea15-56e9-4382-b918-7a1b2bac4090 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:57:59.743809 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:57:59.775085 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f5e866-3067-40b6-90a1-078add881db0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:57:59.775696 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5e866-3067-40b6-90a1-078add881db0 service neutron] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:59.775993 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5e866-3067-40b6-90a1-078add881db0 service neutron] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:59.776243 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5e866-3067-40b6-90a1-078add881db0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:59.783983 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 801/1601] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:57:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:57:59.784799 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0181a75b-230f-4b11-82e6-018955e46213 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:57:59.849022 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f5e866-3067-40b6-90a1-078add881db0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:57:59.851115 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f5e866-3067-40b6-90a1-078add881db0 service neutron] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:57:59.861798 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 801/1602] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:57:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:57:59.862669 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f5e866-3067-40b6-90a1-078add881db0 service neutron] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:57:59.864688 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0181a75b-230f-4b11-82e6-018955e46213 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:57:59.870034 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c2e3a-2b0c-4e66-a176-43a91863f1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:57:59.871321 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c2e3a-2b0c-4e66-a176-43a91863f1a4 admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:59.871750 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c2e3a-2b0c-4e66-a176-43a91863f1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:59.872096 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c2e3a-2b0c-4e66-a176-43a91863f1a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:59.872851 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294c2e3a-2b0c-4e66-a176-43a91863f1a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:57:59.873379 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f5e866-3067-40b6-90a1-078add881db0 service neutron] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:57:59.875015 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294c2e3a-2b0c-4e66-a176-43a91863f1a4 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:57:59.878301 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a850691-b825-4ee1-b07e-caab735dbf07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:57:59.878991 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a850691-b825-4ee1-b07e-caab735dbf07 admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:57:59.879269 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a850691-b825-4ee1-b07e-caab735dbf07 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:57:59.879540 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a850691-b825-4ee1-b07e-caab735dbf07 admin admin] PATH_INFO: `/v3/projects/b3eb9533b0074c75840484d37676fef4/users/5452a74785eb4748b508331ec3103890/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:57:59.894935 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a850691-b825-4ee1-b07e-caab735dbf07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3eb9533b0074c75840484d37676fef4, user_id=5452a74785eb4748b508331ec3103890, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:57:59.897678 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a850691-b825-4ee1-b07e-caab735dbf07 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:57:59.972868 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 802/1603] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:57:59 2022] PUT /identity/v3/projects/b3eb9533b0074c75840484d37676fef4/users/5452a74785eb4748b508331ec3103890/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:57:59.973646 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a850691-b825-4ee1-b07e-caab735dbf07 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:57:59.974925 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 802/1604] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 19:57:59 2022] POST /identity/v3/projects => generated 365 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:57:59.975897 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c2e3a-2b0c-4e66-a176-43a91863f1a4 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:00.043459 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:00.056862 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c2e3a-2b0c-4e66-a176-43a91863f1a4 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:00.061743 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a850691-b825-4ee1-b07e-caab735dbf07 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:00.062276 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89acdab7-155b-4b15-8976-40bf9c9d03f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:00.062941 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89acdab7-155b-4b15-8976-40bf9c9d03f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:00.063221 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89acdab7-155b-4b15-8976-40bf9c9d03f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:00.063493 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89acdab7-155b-4b15-8976-40bf9c9d03f2 admin admin] PATH_INFO: `/v3/projects/a0e26363672b412ba7fa1da4d02b2bf1/users/42301c9929b74988b159de90ad45ecc7/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:00.066866 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fb3f36-03d3-4ce2-b57d-53bc402ac63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:00.067554 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb3f36-03d3-4ce2-b57d-53bc402ac63b admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:00.067848 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb3f36-03d3-4ce2-b57d-53bc402ac63b admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:00.068122 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb3f36-03d3-4ce2-b57d-53bc402ac63b admin admin] PATH_INFO: `/v3/projects/3bd64cad3bba453c85a9ccfba9b6c6f4/users/d2c1ded5aad545148d3e30f6ce994004/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:00.078003 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89acdab7-155b-4b15-8976-40bf9c9d03f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0e26363672b412ba7fa1da4d02b2bf1, user_id=42301c9929b74988b159de90ad45ecc7, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:00.081307 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89acdab7-155b-4b15-8976-40bf9c9d03f2 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:00.083652 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fb3f36-03d3-4ce2-b57d-53bc402ac63b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bd64cad3bba453c85a9ccfba9b6c6f4, user_id=d2c1ded5aad545148d3e30f6ce994004, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:00.086790 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fb3f36-03d3-4ce2-b57d-53bc402ac63b admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:00.177281 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 803/1605] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:57:59 2022] PUT /identity/v3/projects/3bd64cad3bba453c85a9ccfba9b6c6f4/users/d2c1ded5aad545148d3e30f6ce994004/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:00.178011 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 803/1606] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:57:59 2022] PUT /identity/v3/projects/a0e26363672b412ba7fa1da4d02b2bf1/users/42301c9929b74988b159de90ad45ecc7/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:00.178114 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fb3f36-03d3-4ce2-b57d-53bc402ac63b admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:00.178222 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14740d6e-700b-4974-a1e0-5b3ba87e9510 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:00.178222 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14740d6e-700b-4974-a1e0-5b3ba87e9510 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:00.178222 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14740d6e-700b-4974-a1e0-5b3ba87e9510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:00.196429 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-14740d6e-700b-4974-a1e0-5b3ba87e9510 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:00.198012 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-14740d6e-700b-4974-a1e0-5b3ba87e9510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:00.215396 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:00.246152 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fb3f36-03d3-4ce2-b57d-53bc402ac63b admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:00.250813 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e360ce8-6193-468f-a513-802c195e082e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:00.251427 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e360ce8-6193-468f-a513-802c195e082e admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:00.251704 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e360ce8-6193-468f-a513-802c195e082e admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:00.251972 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e360ce8-6193-468f-a513-802c195e082e admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:00.257546 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e360ce8-6193-468f-a513-802c195e082e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:00.257546 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e360ce8-6193-468f-a513-802c195e082e admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:00.262120 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 804/1607] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:00.263627 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a55eb-5fcc-4177-ad7a-cd84d92a84be None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:00.264069 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a55eb-5fcc-4177-ad7a-cd84d92a84be None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:00.264198 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 804/1608] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:58:00.264281 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a55eb-5fcc-4177-ad7a-cd84d92a84be None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:00.264720 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e360ce8-6193-468f-a513-802c195e082e admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:00.265683 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 805/1609] 10.222.0.60 () {54 vars in 961 bytes} [Sat Sep 24 19:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:58:00.266989 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be43f4-b0ed-4ff5-8b7c-492ef5c77e8d None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:00.267221 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be43f4-b0ed-4ff5-8b7c-492ef5c77e8d None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:00.267587 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be43f4-b0ed-4ff5-8b7c-492ef5c77e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:00.282987 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e360ce8-6193-468f-a513-802c195e082e admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:00.287855 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e214c5-8c61-4fb8-85c8-bf4f210ba90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:00.288465 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e214c5-8c61-4fb8-85c8-bf4f210ba90d admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:00.288744 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e214c5-8c61-4fb8-85c8-bf4f210ba90d admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:00.289015 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e214c5-8c61-4fb8-85c8-bf4f210ba90d admin admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:00.289692 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e214c5-8c61-4fb8-85c8-bf4f210ba90d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:00.291638 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e214c5-8c61-4fb8-85c8-bf4f210ba90d admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:00.314889 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-89be43f4-b0ed-4ff5-8b7c-492ef5c77e8d None None] MFA Rules not processed for user `5452a74785eb4748b508331ec3103890`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:00.316194 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-89be43f4-b0ed-4ff5-8b7c-492ef5c77e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:00.390820 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 806/1610] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:00.392151 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ddc720-960d-4dcc-84b1-7245bafc86df None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:00.392445 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ddc720-960d-4dcc-84b1-7245bafc86df None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:00.392719 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ddc720-960d-4dcc-84b1-7245bafc86df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:00.413971 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-c4ddc720-960d-4dcc-84b1-7245bafc86df None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:00.415184 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-c4ddc720-960d-4dcc-84b1-7245bafc86df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:00.423624 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 807/1611] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:00.425764 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81738211-f187-4ccb-93ef-60d685032e5e None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:00.425764 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81738211-f187-4ccb-93ef-60d685032e5e None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:00.425764 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81738211-f187-4ccb-93ef-60d685032e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:00.454643 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 805/1612] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:58:00 2022] POST /identity/v3/users => generated 289 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:58:00.455613 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e214c5-8c61-4fb8-85c8-bf4f210ba90d admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:00.455760 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-81738211-f187-4ccb-93ef-60d685032e5e None None] MFA Rules not processed for user `42301c9929b74988b159de90ad45ecc7`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:00.457015 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-81738211-f187-4ccb-93ef-60d685032e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:00.468970 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e214c5-8c61-4fb8-85c8-bf4f210ba90d admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:00.474347 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e09dfb-bac5-4f39-9cb9-c8e6c4f5a8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:00.475122 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e09dfb-bac5-4f39-9cb9-c8e6c4f5a8a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:00.475506 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e09dfb-bac5-4f39-9cb9-c8e6c4f5a8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:00.475876 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e09dfb-bac5-4f39-9cb9-c8e6c4f5a8a2 admin admin] PATH_INFO: `/v3/projects/346c1395acc542a2b7dffcd15c12be45/users/014e32daafa540af92a906b9c2028db4/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:00.492379 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e09dfb-bac5-4f39-9cb9-c8e6c4f5a8a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=346c1395acc542a2b7dffcd15c12be45, user_id=014e32daafa540af92a906b9c2028db4, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:00.495948 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e09dfb-bac5-4f39-9cb9-c8e6c4f5a8a2 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:00.505872 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:00.526040 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 808/1613] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:00.527844 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e16777-2510-4d85-93f0-52a428aff278 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:00.528125 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e16777-2510-4d85-93f0-52a428aff278 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:00.528399 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e16777-2510-4d85-93f0-52a428aff278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:00.566809 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-19e16777-2510-4d85-93f0-52a428aff278 None None] MFA Rules not processed for user `f3b5047a59bc4547be643ffa78808a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:00.568015 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-19e16777-2510-4d85-93f0-52a428aff278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:00.607434 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 806/1614] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:58:00 2022] PUT /identity/v3/projects/346c1395acc542a2b7dffcd15c12be45/users/014e32daafa540af92a906b9c2028db4/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:00.609176 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e09dfb-bac5-4f39-9cb9-c8e6c4f5a8a2 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:00.613406 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-66e09dfb-bac5-4f39-9cb9-c8e6c4f5a8a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:00.640845 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 809/1615] 10.222.0.60 () {58 vars in 1058 bytes} [Sat Sep 24 19:58:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:00.642689 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e16777-2510-4d85-93f0-52a428aff278 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:00.655242 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e16777-2510-4d85-93f0-52a428aff278 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:00.686183 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e09dfb-bac5-4f39-9cb9-c8e6c4f5a8a2 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:00.690270 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b59bf2c-0b74-4ad9-9a55-c766d10f94c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:00.690881 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59bf2c-0b74-4ad9-9a55-c766d10f94c9 service neutron] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:00.691149 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59bf2c-0b74-4ad9-9a55-c766d10f94c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:00.691417 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59bf2c-0b74-4ad9-9a55-c766d10f94c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:00.724699 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b620e-9ac8-474f-9d5a-7864f1634ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:00.725313 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b620e-9ac8-474f-9d5a-7864f1634ea9 admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:00.725625 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b620e-9ac8-474f-9d5a-7864f1634ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:00.725896 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b620e-9ac8-474f-9d5a-7864f1634ea9 admin admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:00.726543 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820b620e-9ac8-474f-9d5a-7864f1634ea9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:00.728653 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820b620e-9ac8-474f-9d5a-7864f1634ea9 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:00.759671 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b59bf2c-0b74-4ad9-9a55-c766d10f94c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:00.762037 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b59bf2c-0b74-4ad9-9a55-c766d10f94c9 service neutron] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:00.771680 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 807/1616] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:58:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:58:00.772633 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b59bf2c-0b74-4ad9-9a55-c766d10f94c9 service neutron] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:00.781325 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b59bf2c-0b74-4ad9-9a55-c766d10f94c9 service neutron] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:00.785043 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab03c52-f06b-44c7-86eb-c211378097f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:00.785672 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab03c52-f06b-44c7-86eb-c211378097f8 service neutron] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:00.785951 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab03c52-f06b-44c7-86eb-c211378097f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:00.786422 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab03c52-f06b-44c7-86eb-c211378097f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:00.797067 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab03c52-f06b-44c7-86eb-c211378097f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:00.800686 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab03c52-f06b-44c7-86eb-c211378097f8 service neutron] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:00.808424 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 808/1617] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:58:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:58:00.809245 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab03c52-f06b-44c7-86eb-c211378097f8 service neutron] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:00.818250 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab03c52-f06b-44c7-86eb-c211378097f8 service neutron] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:00.822954 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05efa8-e97d-43f2-8914-a207ff2a2bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:00.826203 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05efa8-e97d-43f2-8914-a207ff2a2bcc admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:00.826203 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05efa8-e97d-43f2-8914-a207ff2a2bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:00.826203 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05efa8-e97d-43f2-8914-a207ff2a2bcc admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:00.826203 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b05efa8-e97d-43f2-8914-a207ff2a2bcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:00.827224 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b05efa8-e97d-43f2-8914-a207ff2a2bcc admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:00.844845 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 809/1618] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:58:00.844845 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6b6a1-3a0f-4e6c-b158-794b19bb1271 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:00.844845 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6b6a1-3a0f-4e6c-b158-794b19bb1271 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:00.844845 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6b6a1-3a0f-4e6c-b158-794b19bb1271 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:00.845947 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 810/1619] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 19:58:00 2022] POST /identity/v3/projects => generated 385 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:58:00.846046 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 810/1620] 10.222.0.60 () {54 vars in 961 bytes} [Sat Sep 24 19:58:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:58:00.846146 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fef3d0-8b5d-40c0-8466-7d7702db14bb None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:00.846146 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fef3d0-8b5d-40c0-8466-7d7702db14bb None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:00.846319 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af6b6a1-3a0f-4e6c-b158-794b19bb1271 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:00.846398 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fef3d0-8b5d-40c0-8466-7d7702db14bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:00.859833 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:00.867448 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-38fef3d0-8b5d-40c0-8466-7d7702db14bb None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:00.868683 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-38fef3d0-8b5d-40c0-8466-7d7702db14bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:00.938740 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af6b6a1-3a0f-4e6c-b158-794b19bb1271 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:00.944882 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8cacfc-7587-4985-a916-87cec8869b8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5047a59bc4547be643ffa78808a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:00.945972 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8cacfc-7587-4985-a916-87cec8869b8c service nova] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:00.946455 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8cacfc-7587-4985-a916-87cec8869b8c service nova] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:00.946725 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8cacfc-7587-4985-a916-87cec8869b8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:00.951830 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:00.974015 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 811/1621] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:00.974015 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fef3d0-8b5d-40c0-8466-7d7702db14bb None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:00.992087 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fef3d0-8b5d-40c0-8466-7d7702db14bb None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:00.998598 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4cdf71-2011-4eef-852e-ca102c04a324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:00.999316 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4cdf71-2011-4eef-852e-ca102c04a324 admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:01.002059 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4cdf71-2011-4eef-852e-ca102c04a324 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:01.002059 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4cdf71-2011-4eef-852e-ca102c04a324 admin admin] PATH_INFO: `/v3/projects/d192367176274be3a4da001a74932740/users/24b94c44a3c14798bf7fdb95d9b682b2/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:01.016615 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4cdf71-2011-4eef-852e-ca102c04a324 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d192367176274be3a4da001a74932740, user_id=24b94c44a3c14798bf7fdb95d9b682b2, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:01.019571 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4cdf71-2011-4eef-852e-ca102c04a324 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:01.025068 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8cacfc-7587-4985-a916-87cec8869b8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:01.027475 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8cacfc-7587-4985-a916-87cec8869b8c service nova] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:01.036938 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 811/1622] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:58:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:58:01.037734 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8cacfc-7587-4985-a916-87cec8869b8c service nova] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:01.051607 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8cacfc-7587-4985-a916-87cec8869b8c service nova] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:01.058019 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd94617f-112c-42da-a584-7df765e6b02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:01.058644 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94617f-112c-42da-a584-7df765e6b02f admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:01.059311 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94617f-112c-42da-a584-7df765e6b02f admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:01.059311 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94617f-112c-42da-a584-7df765e6b02f admin admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:01.060447 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd94617f-112c-42da-a584-7df765e6b02f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:01.062505 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd94617f-112c-42da-a584-7df765e6b02f admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:01.135827 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 812/1623] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:58:00 2022] PUT /identity/v3/projects/d192367176274be3a4da001a74932740/users/24b94c44a3c14798bf7fdb95d9b682b2/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:01.138097 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f2127-d243-463b-a3f8-cf1232735166 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:01.138769 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f2127-d243-463b-a3f8-cf1232735166 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:01.139225 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f2127-d243-463b-a3f8-cf1232735166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:01.170562 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 812/1624] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:58:01 2022] POST /identity/v3/users => generated 293 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:58:01.171941 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd94617f-112c-42da-a584-7df765e6b02f admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:01.183579 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-a33f2127-d243-463b-a3f8-cf1232735166 None None] MFA Rules not processed for user `f3b5047a59bc4547be643ffa78808a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:01.186297 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-a33f2127-d243-463b-a3f8-cf1232735166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:01.286089 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd94617f-112c-42da-a584-7df765e6b02f admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:01.372610 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 813/1625] 10.222.0.60 () {58 vars in 1058 bytes} [Sat Sep 24 19:58:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:01.373652 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33f2127-d243-463b-a3f8-cf1232735166 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:01.381042 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:01.391052 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df551cf-6699-40db-882d-e00cc6dacd81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:01.391949 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df551cf-6699-40db-882d-e00cc6dacd81 service neutron] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:01.392323 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df551cf-6699-40db-882d-e00cc6dacd81 service neutron] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:01.392838 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df551cf-6699-40db-882d-e00cc6dacd81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:01.504345 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33f2127-d243-463b-a3f8-cf1232735166 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:01.517967 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9551c01-9caf-4c6a-9e89-df4b52a92ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:01.518642 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9551c01-9caf-4c6a-9e89-df4b52a92ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:01.519025 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9551c01-9caf-4c6a-9e89-df4b52a92ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:01.520275 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9551c01-9caf-4c6a-9e89-df4b52a92ce6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:01.521047 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9551c01-9caf-4c6a-9e89-df4b52a92ce6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:01.525526 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9551c01-9caf-4c6a-9e89-df4b52a92ce6 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:01.530620 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df551cf-6699-40db-882d-e00cc6dacd81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:01.531196 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df551cf-6699-40db-882d-e00cc6dacd81 service neutron] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:01.547214 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 814/1626] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:58:01.547876 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 813/1627] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:58:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:58:01.548370 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9551c01-9caf-4c6a-9e89-df4b52a92ce6 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:01.549356 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df551cf-6699-40db-882d-e00cc6dacd81 service neutron] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:01.560078 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9551c01-9caf-4c6a-9e89-df4b52a92ce6 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:01.566278 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31429e26-ebff-45e6-a793-3a67608eb67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:01.567144 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31429e26-ebff-45e6-a793-3a67608eb67f admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:01.567700 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31429e26-ebff-45e6-a793-3a67608eb67f admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:01.567966 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df551cf-6699-40db-882d-e00cc6dacd81 service neutron] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:01.568422 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31429e26-ebff-45e6-a793-3a67608eb67f admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:01.569310 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31429e26-ebff-45e6-a793-3a67608eb67f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:01.572974 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31429e26-ebff-45e6-a793-3a67608eb67f admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:01.583371 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f4c51f-1f62-4819-8599-606310bd475a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5047a59bc4547be643ffa78808a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:01.584838 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4c51f-1f62-4819-8599-606310bd475a service nova] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:01.586313 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4c51f-1f62-4819-8599-606310bd475a service nova] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:01.586313 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4c51f-1f62-4819-8599-606310bd475a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:01.599852 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 815/1628] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:58:01.601707 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8a2fb-52bf-40de-9214-1cd968f3d38d None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:01.603213 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8a2fb-52bf-40de-9214-1cd968f3d38d None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:01.605112 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8a2fb-52bf-40de-9214-1cd968f3d38d None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:01.609165 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 816/1629] 10.222.0.60 () {54 vars in 912 bytes} [Sat Sep 24 19:58:01 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:58:01.610128 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df8a2fb-52bf-40de-9214-1cd968f3d38d None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:01.639799 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df8a2fb-52bf-40de-9214-1cd968f3d38d None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:01.650985 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf2f1b-3d5d-40cb-a2b7-4856c3945e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:01.654219 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf2f1b-3d5d-40cb-a2b7-4856c3945e2c admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:01.654631 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf2f1b-3d5d-40cb-a2b7-4856c3945e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:01.655030 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf2f1b-3d5d-40cb-a2b7-4856c3945e2c admin admin] PATH_INFO: `/v3/projects/d192367176274be3a4da001a74932740/users/24b94c44a3c14798bf7fdb95d9b682b2/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:01.663251 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbf2f1b-3d5d-40cb-a2b7-4856c3945e2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d192367176274be3a4da001a74932740, user_id=24b94c44a3c14798bf7fdb95d9b682b2, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:01.671155 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbf2f1b-3d5d-40cb-a2b7-4856c3945e2c admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:01.702350 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 817/1630] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:58:01 2022] PUT /identity/v3/projects/d192367176274be3a4da001a74932740/users/24b94c44a3c14798bf7fdb95d9b682b2/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:01.712002 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf2f1b-3d5d-40cb-a2b7-4856c3945e2c admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:01.727299 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f4c51f-1f62-4819-8599-606310bd475a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:01.729017 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f4c51f-1f62-4819-8599-606310bd475a service nova] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:01.752371 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 814/1631] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:58:01 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:58:01.753533 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce88dc5-297a-45f0-92af-2b4b88cd0e88 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:01.758708 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce88dc5-297a-45f0-92af-2b4b88cd0e88 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:01.758708 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce88dc5-297a-45f0-92af-2b4b88cd0e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:01.762529 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:01.801264 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-1ce88dc5-297a-45f0-92af-2b4b88cd0e88 None None] MFA Rules not processed for user `f3b5047a59bc4547be643ffa78808a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:01.801514 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf2f1b-3d5d-40cb-a2b7-4856c3945e2c admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:01.802537 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-1ce88dc5-297a-45f0-92af-2b4b88cd0e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:01.806530 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c99e4f2-6356-44d6-b2be-ddb774c47893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:01.807142 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99e4f2-6356-44d6-b2be-ddb774c47893 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:02.154030 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99e4f2-6356-44d6-b2be-ddb774c47893 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:02.154030 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99e4f2-6356-44d6-b2be-ddb774c47893 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:02.154030 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c99e4f2-6356-44d6-b2be-ddb774c47893 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:02.154030 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c99e4f2-6356-44d6-b2be-ddb774c47893 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:02.154030 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 818/1632] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:58:02.154030 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751524d8-301d-4982-aa8d-51f37fedaed9 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:02.155557 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751524d8-301d-4982-aa8d-51f37fedaed9 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:02.155557 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751524d8-301d-4982-aa8d-51f37fedaed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:02.155557 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-751524d8-301d-4982-aa8d-51f37fedaed9 None None] MFA Rules not processed for user `24b94c44a3c14798bf7fdb95d9b682b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:02.155557 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-751524d8-301d-4982-aa8d-51f37fedaed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:02.156929 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 815/1633] 10.222.0.60 () {58 vars in 1009 bytes} [Sat Sep 24 19:58:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:02.156929 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce88dc5-297a-45f0-92af-2b4b88cd0e88 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:02.156929 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce88dc5-297a-45f0-92af-2b4b88cd0e88 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:02.156929 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb59024d-85d9-4693-b3d0-7a5974a70dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:02.158873 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59024d-85d9-4693-b3d0-7a5974a70dce admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:02.158873 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59024d-85d9-4693-b3d0-7a5974a70dce admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:02.158873 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59024d-85d9-4693-b3d0-7a5974a70dce admin admin] PATH_INFO: `/v3/projects/d96e69ccc57b4d959502d2892c61dabd/users/00e49640f0f64c3895ad6ed362b30fef/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:02.158873 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb59024d-85d9-4693-b3d0-7a5974a70dce admin admin] RBAC: Authorizing `identity:create_grant(project_id=d96e69ccc57b4d959502d2892c61dabd, user_id=00e49640f0f64c3895ad6ed362b30fef, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:02.158873 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb59024d-85d9-4693-b3d0-7a5974a70dce admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:02.159588 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 819/1634] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:01 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:02.159588 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751524d8-301d-4982-aa8d-51f37fedaed9 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:02.211795 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751524d8-301d-4982-aa8d-51f37fedaed9 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:02.217623 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2abdbf-77e5-4fa9-b500-9f2767a6777f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:02.218260 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2abdbf-77e5-4fa9-b500-9f2767a6777f service cinder] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:02.218541 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2abdbf-77e5-4fa9-b500-9f2767a6777f service cinder] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:02.218814 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2abdbf-77e5-4fa9-b500-9f2767a6777f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:02.232515 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2abdbf-77e5-4fa9-b500-9f2767a6777f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:02.233987 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2abdbf-77e5-4fa9-b500-9f2767a6777f service cinder] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:02.249443 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 820/1635] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:58:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:58:02.250428 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2abdbf-77e5-4fa9-b500-9f2767a6777f service cinder] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:02.261632 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2abdbf-77e5-4fa9-b500-9f2767a6777f service cinder] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:02.265453 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acfd86e-4151-4cc1-8215-d5eece87a5de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:02.266194 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acfd86e-4151-4cc1-8215-d5eece87a5de service cinder] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:02.266547 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acfd86e-4151-4cc1-8215-d5eece87a5de service cinder] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:02.266915 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acfd86e-4151-4cc1-8215-d5eece87a5de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:02.278660 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acfd86e-4151-4cc1-8215-d5eece87a5de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:02.280318 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acfd86e-4151-4cc1-8215-d5eece87a5de service cinder] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:02.293910 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 821/1636] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:58:02 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:58:02.296276 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d4b6e-e632-46a8-ae14-015275b1e7b5 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:02.296276 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d4b6e-e632-46a8-ae14-015275b1e7b5 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:02.296467 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d4b6e-e632-46a8-ae14-015275b1e7b5 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:02.298102 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 822/1637] 10.222.0.60 () {54 vars in 912 bytes} [Sat Sep 24 19:58:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:58:02.304535 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37739de8-9e1d-404f-89c3-0692df66aa71 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:02.305038 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37739de8-9e1d-404f-89c3-0692df66aa71 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:02.306286 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37739de8-9e1d-404f-89c3-0692df66aa71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:02.342504 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 816/1638] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:58:01 2022] PUT /identity/v3/projects/d96e69ccc57b4d959502d2892c61dabd/users/00e49640f0f64c3895ad6ed362b30fef/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:02.352742 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1370c-5260-4ecb-a0c1-3907eed9cb6f None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:02.353293 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1370c-5260-4ecb-a0c1-3907eed9cb6f None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:02.354075 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1370c-5260-4ecb-a0c1-3907eed9cb6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:02.358655 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-37739de8-9e1d-404f-89c3-0692df66aa71 None None] MFA Rules not processed for user `f3b5047a59bc4547be643ffa78808a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:02.362736 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-37739de8-9e1d-404f-89c3-0692df66aa71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:02.371905 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:02.408712 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-38c1370c-5260-4ecb-a0c1-3907eed9cb6f None None] MFA Rules not processed for user `00e49640f0f64c3895ad6ed362b30fef`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:02.408712 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-38c1370c-5260-4ecb-a0c1-3907eed9cb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:02.491365 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 823/1639] 10.222.0.60 () {58 vars in 1009 bytes} [Sat Sep 24 19:58:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:02.516372 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37739de8-9e1d-404f-89c3-0692df66aa71 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:02.535344 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 817/1640] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:02.536358 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1370c-5260-4ecb-a0c1-3907eed9cb6f None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:02.626218 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1370c-5260-4ecb-a0c1-3907eed9cb6f None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:02.630522 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37739de8-9e1d-404f-89c3-0692df66aa71 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:02.631079 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d22601a-f6ee-4cf0-84ab-357eed0fa266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:02.631692 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22601a-f6ee-4cf0-84ab-357eed0fa266 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:02.631974 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22601a-f6ee-4cf0-84ab-357eed0fa266 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:02.632383 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22601a-f6ee-4cf0-84ab-357eed0fa266 admin admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:02.633015 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d22601a-f6ee-4cf0-84ab-357eed0fa266 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:02.634695 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d99b361-db63-4f3a-9833-fcce16b1b91d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:02.635061 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d22601a-f6ee-4cf0-84ab-357eed0fa266 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:02.635292 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99b361-db63-4f3a-9833-fcce16b1b91d service cinder] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:02.635567 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99b361-db63-4f3a-9833-fcce16b1b91d service cinder] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:02.636561 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99b361-db63-4f3a-9833-fcce16b1b91d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:02.651186 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d99b361-db63-4f3a-9833-fcce16b1b91d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:02.652935 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d99b361-db63-4f3a-9833-fcce16b1b91d service cinder] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:02.666458 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 824/1641] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:58:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:58:02.726583 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d99b361-db63-4f3a-9833-fcce16b1b91d service cinder] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:02.736977 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d99b361-db63-4f3a-9833-fcce16b1b91d service cinder] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:02.748981 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8eb575-c5bb-48ba-9567-f52c2820d217 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:02.749707 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8eb575-c5bb-48ba-9567-f52c2820d217 service cinder] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:02.749991 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8eb575-c5bb-48ba-9567-f52c2820d217 service cinder] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:02.750265 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8eb575-c5bb-48ba-9567-f52c2820d217 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:02.789211 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 818/1642] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 19:58:02 2022] POST /identity/v3/projects => generated 385 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 19:58:02.790399 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d22601a-f6ee-4cf0-84ab-357eed0fa266 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:02.923722 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8eb575-c5bb-48ba-9567-f52c2820d217 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:02.926506 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8eb575-c5bb-48ba-9567-f52c2820d217 service cinder] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:02.929249 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d22601a-f6ee-4cf0-84ab-357eed0fa266 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:02.938591 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa8f78-7a3b-4d00-8269-b5f65b7b081c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:02.939826 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa8f78-7a3b-4d00-8269-b5f65b7b081c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:02.941065 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa8f78-7a3b-4d00-8269-b5f65b7b081c admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:02.942962 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa8f78-7a3b-4d00-8269-b5f65b7b081c admin admin] PATH_INFO: `/v3/users/c9eeba1b08304f6685f457d53cc68ae3` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:02.945735 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aa8f78-7a3b-4d00-8269-b5f65b7b081c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9eeba1b08304f6685f457d53cc68ae3)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:02.953232 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 825/1643] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:58:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 19:58:02.954066 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aa8f78-7a3b-4d00-8269-b5f65b7b081c admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:02.966138 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8eb575-c5bb-48ba-9567-f52c2820d217 service cinder] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:02.995002 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8eb575-c5bb-48ba-9567-f52c2820d217 service cinder] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:03.008381 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788eddad-36e5-4909-b214-d01b7ba34180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:03.009466 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788eddad-36e5-4909-b214-d01b7ba34180 admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:03.009785 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788eddad-36e5-4909-b214-d01b7ba34180 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:03.015074 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788eddad-36e5-4909-b214-d01b7ba34180 admin admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:03.015074 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788eddad-36e5-4909-b214-d01b7ba34180 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:03.017373 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788eddad-36e5-4909-b214-d01b7ba34180 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:03.042950 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:03.145755 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 826/1644] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:58:02 2022] POST /identity/v3/users => generated 299 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:58:03.146699 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788eddad-36e5-4909-b214-d01b7ba34180 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:03.175962 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788eddad-36e5-4909-b214-d01b7ba34180 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:03.188274 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef450da-e81e-4c2e-92f5-595a191258d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:03.188915 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef450da-e81e-4c2e-92f5-595a191258d7 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:03.189202 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef450da-e81e-4c2e-92f5-595a191258d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:03.189481 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef450da-e81e-4c2e-92f5-595a191258d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:03.190184 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef450da-e81e-4c2e-92f5-595a191258d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:03.191779 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef450da-e81e-4c2e-92f5-595a191258d7 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:03.237352 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 827/1645] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:58:03 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:58:03.237507 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef450da-e81e-4c2e-92f5-595a191258d7 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:03.246039 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-20aa8f78-7a3b-4d00-8269-b5f65b7b081c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9eeba1b08304f6685f457d53cc68ae3'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:03.252505 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef450da-e81e-4c2e-92f5-595a191258d7 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:03.282215 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5fa37-2303-4d1e-ab7c-a8bd14182b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:03.282917 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5fa37-2303-4d1e-ab7c-a8bd14182b66 admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:03.283202 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5fa37-2303-4d1e-ab7c-a8bd14182b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:03.283481 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5fa37-2303-4d1e-ab7c-a8bd14182b66 admin admin] PATH_INFO: `/v3/projects/b80df21c491349c9a230e63ddaea5859/users/29368883db644cb69e9bcbfbafbe7e2c/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:03.308886 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc5fa37-2303-4d1e-ab7c-a8bd14182b66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b80df21c491349c9a230e63ddaea5859, user_id=29368883db644cb69e9bcbfbafbe7e2c, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:03.311586 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc5fa37-2303-4d1e-ab7c-a8bd14182b66 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:03.344576 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-20aa8f78-7a3b-4d00-8269-b5f65b7b081c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9eeba1b08304f6685f457d53cc68ae3'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:03.345242 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-20aa8f78-7a3b-4d00-8269-b5f65b7b081c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9eeba1b08304f6685f457d53cc68ae3'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:03.346239 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-20aa8f78-7a3b-4d00-8269-b5f65b7b081c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9eeba1b08304f6685f457d53cc68ae3'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:03.384978 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-20aa8f78-7a3b-4d00-8269-b5f65b7b081c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9eeba1b08304f6685f457d53cc68ae3'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:03.418052 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 819/1646] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 19:58:02 2022] DELETE /identity/v3/users/c9eeba1b08304f6685f457d53cc68ae3 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:03.422461 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5fcd49-f3e1-4466-ad32-6bd7ede82105 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:03.423802 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5fcd49-f3e1-4466-ad32-6bd7ede82105 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:03.423802 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5fcd49-f3e1-4466-ad32-6bd7ede82105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:03.441141 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 828/1647] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:58:03 2022] PUT /identity/v3/projects/b80df21c491349c9a230e63ddaea5859/users/29368883db644cb69e9bcbfbafbe7e2c/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:03.445442 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5fa37-2303-4d1e-ab7c-a8bd14182b66 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:03.449978 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-9dc5fa37-2303-4d1e-ab7c-a8bd14182b66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:03.456881 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-cd5fcd49-f3e1-4466-ad32-6bd7ede82105 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:03.459864 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-cd5fcd49-f3e1-4466-ad32-6bd7ede82105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:03.574913 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5fa37-2303-4d1e-ab7c-a8bd14182b66 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:03.576431 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 820/1648] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:03.589759 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae8087-78f0-4870-a1ac-b488b75e1317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:03.590420 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae8087-78f0-4870-a1ac-b488b75e1317 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:03.590734 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae8087-78f0-4870-a1ac-b488b75e1317 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:03.590951 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5fcd49-f3e1-4466-ad32-6bd7ede82105 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:03.591071 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae8087-78f0-4870-a1ac-b488b75e1317 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:03.591664 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cae8087-78f0-4870-a1ac-b488b75e1317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:03.592745 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-cd5fcd49-f3e1-4466-ad32-6bd7ede82105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:03.593379 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cae8087-78f0-4870-a1ac-b488b75e1317 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:03.609068 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 829/1649] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:58:03 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:58:03.610679 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae8087-78f0-4870-a1ac-b488b75e1317 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:03.627444 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae8087-78f0-4870-a1ac-b488b75e1317 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:03.634188 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003d2a53-02c9-4772-b675-e3a70275cf1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:03.634938 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d2a53-02c9-4772-b675-e3a70275cf1d admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:03.635140 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:03.635333 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d2a53-02c9-4772-b675-e3a70275cf1d admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:03.636202 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d2a53-02c9-4772-b675-e3a70275cf1d admin admin] PATH_INFO: `/v3/projects/b80df21c491349c9a230e63ddaea5859/users/29368883db644cb69e9bcbfbafbe7e2c/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:03.640509 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003d2a53-02c9-4772-b675-e3a70275cf1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b80df21c491349c9a230e63ddaea5859, user_id=29368883db644cb69e9bcbfbafbe7e2c, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:03.643662 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003d2a53-02c9-4772-b675-e3a70275cf1d admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:03.660891 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 830/1650] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:58:03 2022] PUT /identity/v3/projects/b80df21c491349c9a230e63ddaea5859/users/29368883db644cb69e9bcbfbafbe7e2c/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:03.687990 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1cacb-d6f2-4625-adf9-d55d26d95835 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:03.688285 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1cacb-d6f2-4625-adf9-d55d26d95835 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:03.689556 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1cacb-d6f2-4625-adf9-d55d26d95835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:03.699002 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:03.732542 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5fcd49-f3e1-4466-ad32-6bd7ede82105 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:03.766520 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-f4c1cacb-d6f2-4625-adf9-d55d26d95835 None None] MFA Rules not processed for user `29368883db644cb69e9bcbfbafbe7e2c`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:03.786762 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-f4c1cacb-d6f2-4625-adf9-d55d26d95835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:03.886438 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1487a88-2b45-496a-97d8-7b18f5ba7f9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:03.890575 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1487a88-2b45-496a-97d8-7b18f5ba7f9b service neutron] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:03.890874 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1487a88-2b45-496a-97d8-7b18f5ba7f9b service neutron] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:03.891154 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1487a88-2b45-496a-97d8-7b18f5ba7f9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:03.937154 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 831/1651] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:03 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:03.948066 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1cacb-d6f2-4625-adf9-d55d26d95835 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:03.963585 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-f4c1cacb-d6f2-4625-adf9-d55d26d95835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:04.079717 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1487a88-2b45-496a-97d8-7b18f5ba7f9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:04.081192 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1487a88-2b45-496a-97d8-7b18f5ba7f9b service neutron] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:04.120955 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 821/1652] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:58:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 19:58:04.127405 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4df9eb-7ab0-4c4e-b98b-0e3410c7898c None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:04.127812 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4df9eb-7ab0-4c4e-b98b-0e3410c7898c None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:04.128186 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4df9eb-7ab0-4c4e-b98b-0e3410c7898c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:04.135976 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1cacb-d6f2-4625-adf9-d55d26d95835 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:04.149673 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab58e6b8-5074-4819-b8d2-e901ec461a2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:04.150698 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58e6b8-5074-4819-b8d2-e901ec461a2d service cinder] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:04.156571 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58e6b8-5074-4819-b8d2-e901ec461a2d service cinder] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:04.156571 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58e6b8-5074-4819-b8d2-e901ec461a2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:04.176443 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab58e6b8-5074-4819-b8d2-e901ec461a2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:04.178744 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab58e6b8-5074-4819-b8d2-e901ec461a2d service cinder] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:04.199924 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 832/1653] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:58:03 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:58:04.232440 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-7b4df9eb-7ab0-4c4e-b98b-0e3410c7898c None None] MFA Rules not processed for user `03991d7560404899a64460c622cb79c7`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:04.234614 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-7b4df9eb-7ab0-4c4e-b98b-0e3410c7898c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:04.423439 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 822/1654] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:04 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:04.425459 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab58e6b8-5074-4819-b8d2-e901ec461a2d service cinder] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:04.427387 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-ab58e6b8-5074-4819-b8d2-e901ec461a2d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:04.451989 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab58e6b8-5074-4819-b8d2-e901ec461a2d service cinder] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:04.480558 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037de7b-925c-4174-b730-a53043182244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:04.481537 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037de7b-925c-4174-b730-a53043182244 admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:04.481537 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037de7b-925c-4174-b730-a53043182244 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:04.481781 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037de7b-925c-4174-b730-a53043182244 admin admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:04.482795 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1037de7b-925c-4174-b730-a53043182244 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:04.484709 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1037de7b-925c-4174-b730-a53043182244 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:04.588558 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 833/1655] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 19:58:04 2022] POST /identity/v3/projects => generated 405 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:58:04.593190 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4df9eb-7ab0-4c4e-b98b-0e3410c7898c None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:04.606668 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4df9eb-7ab0-4c4e-b98b-0e3410c7898c None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:04.714710 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bbe965-9319-488b-b42c-aefd8fbf6621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:04.714912 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbe965-9319-488b-b42c-aefd8fbf6621 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:04.715104 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbe965-9319-488b-b42c-aefd8fbf6621 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:04.715558 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbe965-9319-488b-b42c-aefd8fbf6621 admin admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:04.717542 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bbe965-9319-488b-b42c-aefd8fbf6621 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:04.723020 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bbe965-9319-488b-b42c-aefd8fbf6621 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:04.933051 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 823/1656] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:58:04 2022] POST /identity/v3/users => generated 309 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:58:04.937200 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037de7b-925c-4174-b730-a53043182244 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:06.882759 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037de7b-925c-4174-b730-a53043182244 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:06.882759 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f97a30-d21f-41f0-9df7-4f9bbb86d526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:06.882759 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f97a30-d21f-41f0-9df7-4f9bbb86d526 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:06.882759 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f97a30-d21f-41f0-9df7-4f9bbb86d526 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:06.886480 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f97a30-d21f-41f0-9df7-4f9bbb86d526 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:06.886480 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f97a30-d21f-41f0-9df7-4f9bbb86d526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:06.886480 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f97a30-d21f-41f0-9df7-4f9bbb86d526 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:06.886480 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 834/1657] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:58:04 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:58:06.888670 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bbe965-9319-488b-b42c-aefd8fbf6621 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:06.902930 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bbe965-9319-488b-b42c-aefd8fbf6621 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:06.908599 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc71bb8-4203-4f2f-b651-09e79fbd6ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:06.916622 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc71bb8-4203-4f2f-b651-09e79fbd6ad3 admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:06.916622 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc71bb8-4203-4f2f-b651-09e79fbd6ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:06.916622 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc71bb8-4203-4f2f-b651-09e79fbd6ad3 admin admin] PATH_INFO: `/v3/projects/46abfd7500214f3dbc33ea4e670b6c2f/users/48d3cb593b3e4a159b9c37f8efe130fd/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:06.928784 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc71bb8-4203-4f2f-b651-09e79fbd6ad3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46abfd7500214f3dbc33ea4e670b6c2f, user_id=48d3cb593b3e4a159b9c37f8efe130fd, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:06.938692 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc71bb8-4203-4f2f-b651-09e79fbd6ad3 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:06.948318 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:07.674088 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 824/1658] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:58:06 2022] PUT /identity/v3/projects/46abfd7500214f3dbc33ea4e670b6c2f/users/48d3cb593b3e4a159b9c37f8efe130fd/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 796 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:07.676431 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f97a30-d21f-41f0-9df7-4f9bbb86d526 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:07.687830 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f97a30-d21f-41f0-9df7-4f9bbb86d526 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:07.753828 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281faa7e-7196-4d9a-9fe3-7a8695a0dc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:07.754456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281faa7e-7196-4d9a-9fe3-7a8695a0dc87 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:07.757699 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281faa7e-7196-4d9a-9fe3-7a8695a0dc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:07.757699 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281faa7e-7196-4d9a-9fe3-7a8695a0dc87 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:07.757699 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281faa7e-7196-4d9a-9fe3-7a8695a0dc87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:07.757699 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281faa7e-7196-4d9a-9fe3-7a8695a0dc87 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:07.769609 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc71bb8-4203-4f2f-b651-09e79fbd6ad3 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:07.771909 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-3dc71bb8-4203-4f2f-b651-09e79fbd6ad3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:07.792784 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 835/1659] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:58:07 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:58:07.794171 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc71bb8-4203-4f2f-b651-09e79fbd6ad3 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:07.797173 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281faa7e-7196-4d9a-9fe3-7a8695a0dc87 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:07.807264 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411f0af3-c249-481f-8e48-c3ce67d4f6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:07.808122 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f0af3-c249-481f-8e48-c3ce67d4f6b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:07.809052 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f0af3-c249-481f-8e48-c3ce67d4f6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:07.809636 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f0af3-c249-481f-8e48-c3ce67d4f6b6 admin admin] PATH_INFO: `/v3/projects/7a201af37a554d41bd558d3080a9d43f` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:07.815153 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411f0af3-c249-481f-8e48-c3ce67d4f6b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a201af37a554d41bd558d3080a9d43f)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:07.815153 dv-cinder-859191-1-smb devstack@keystone.service[93399]: WARNING py.warnings [None req-411f0af3-c249-481f-8e48-c3ce67d4f6b6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 19:58:07.815153 dv-cinder-859191-1-smb devstack@keystone.service[93399]: warnings.warn(msg) Sep 24 19:58:07.815153 dv-cinder-859191-1-smb devstack@keystone.service[93399]: Sep 24 19:58:07.815153 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411f0af3-c249-481f-8e48-c3ce67d4f6b6 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:07.819149 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281faa7e-7196-4d9a-9fe3-7a8695a0dc87 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:07.831580 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c5075b-5cc0-4cb2-b0cf-a6170a27bdf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:07.832262 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5075b-5cc0-4cb2-b0cf-a6170a27bdf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:07.832541 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5075b-5cc0-4cb2-b0cf-a6170a27bdf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:07.832814 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5075b-5cc0-4cb2-b0cf-a6170a27bdf7 admin admin] PATH_INFO: `/v3/projects/46abfd7500214f3dbc33ea4e670b6c2f/users/48d3cb593b3e4a159b9c37f8efe130fd/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:07.836137 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c5075b-5cc0-4cb2-b0cf-a6170a27bdf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46abfd7500214f3dbc33ea4e670b6c2f, user_id=48d3cb593b3e4a159b9c37f8efe130fd, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:07.838872 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c5075b-5cc0-4cb2-b0cf-a6170a27bdf7 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:07.872690 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 836/1660] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:58:07 2022] PUT /identity/v3/projects/46abfd7500214f3dbc33ea4e670b6c2f/users/48d3cb593b3e4a159b9c37f8efe130fd/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:08.069754 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-411f0af3-c249-481f-8e48-c3ce67d4f6b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a201af37a554d41bd558d3080a9d43f', 'request_id': 'req-411f0af3-c249-481f-8e48-c3ce67d4f6b6'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:08.135115 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-411f0af3-c249-481f-8e48-c3ce67d4f6b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a201af37a554d41bd558d3080a9d43f', 'request_id': 'req-411f0af3-c249-481f-8e48-c3ce67d4f6b6'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:08.280285 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-411f0af3-c249-481f-8e48-c3ce67d4f6b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a201af37a554d41bd558d3080a9d43f', 'request_id': 'req-411f0af3-c249-481f-8e48-c3ce67d4f6b6'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:08.298407 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-411f0af3-c249-481f-8e48-c3ce67d4f6b6 admin admin] The token cache is being invalidate because project 7a201af37a554d41bd558d3080a9d43f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 19:58:08.299002 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-411f0af3-c249-481f-8e48-c3ce67d4f6b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:08.300541 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-411f0af3-c249-481f-8e48-c3ce67d4f6b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:08.303123 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 825/1661] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 19:58:07 2022] DELETE /identity/v3/projects/7a201af37a554d41bd558d3080a9d43f => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:08.308700 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48f84e-3ca2-4909-83f5-d51c198155d5 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:08.309201 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48f84e-3ca2-4909-83f5-d51c198155d5 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:08.310146 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48f84e-3ca2-4909-83f5-d51c198155d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:08.339008 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-fa48f84e-3ca2-4909-83f5-d51c198155d5 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:08.345296 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-fa48f84e-3ca2-4909-83f5-d51c198155d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:08.495906 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:08.528125 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 837/1662] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:08.537004 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f0a52b-3834-4102-84e2-16285808acfd None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:08.537292 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f0a52b-3834-4102-84e2-16285808acfd None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:08.537594 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f0a52b-3834-4102-84e2-16285808acfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:08.604798 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-75f0a52b-3834-4102-84e2-16285808acfd None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:08.608405 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-75f0a52b-3834-4102-84e2-16285808acfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:08.623428 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48f84e-3ca2-4909-83f5-d51c198155d5 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:08.625023 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-fa48f84e-3ca2-4909-83f5-d51c198155d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:08.647501 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 826/1663] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:08.648980 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f0a52b-3834-4102-84e2-16285808acfd None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:08.685015 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f0a52b-3834-4102-84e2-16285808acfd None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:08.702630 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ed347-b893-460d-b34d-6d40c8c7214d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:08.703264 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ed347-b893-460d-b34d-6d40c8c7214d admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:08.703543 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ed347-b893-460d-b34d-6d40c8c7214d admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:08.703811 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ed347-b893-460d-b34d-6d40c8c7214d admin admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:08.708016 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2ed347-b893-460d-b34d-6d40c8c7214d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:58:08.709087 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2ed347-b893-460d-b34d-6d40c8c7214d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:08.713218 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2ed347-b893-460d-b34d-6d40c8c7214d admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:08.741847 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 827/1664] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 19:58:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:58:08.744938 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ed347-b893-460d-b34d-6d40c8c7214d admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:08.752376 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48f84e-3ca2-4909-83f5-d51c198155d5 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:08.760640 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83653f6f-4f36-4db7-a16e-8e28708d60a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:08.763131 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83653f6f-4f36-4db7-a16e-8e28708d60a6 service cinder] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:08.763849 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83653f6f-4f36-4db7-a16e-8e28708d60a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:08.766430 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ed347-b893-460d-b34d-6d40c8c7214d admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:08.766968 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83653f6f-4f36-4db7-a16e-8e28708d60a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:08.770204 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-83653f6f-4f36-4db7-a16e-8e28708d60a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:08.777033 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f647d64-7924-462d-af95-d88c907e9408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:08.778270 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f647d64-7924-462d-af95-d88c907e9408 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:08.778889 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f647d64-7924-462d-af95-d88c907e9408 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:08.779545 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f647d64-7924-462d-af95-d88c907e9408 admin admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:08.782221 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f647d64-7924-462d-af95-d88c907e9408 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:08.786767 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f647d64-7924-462d-af95-d88c907e9408 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:08.906562 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83653f6f-4f36-4db7-a16e-8e28708d60a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:08.908091 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83653f6f-4f36-4db7-a16e-8e28708d60a6 service cinder] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:08.934877 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 828/1665] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 19:58:08 2022] POST /identity/v3/projects => generated 363 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:58:08.946374 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f647d64-7924-462d-af95-d88c907e9408 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:08.951104 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 838/1666] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:58:08 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:58:09.113867 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f647d64-7924-462d-af95-d88c907e9408 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:09.143040 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef922585-dd73-4654-bf0e-f4908da4217a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:09.147461 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef922585-dd73-4654-bf0e-f4908da4217a admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:09.149130 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef922585-dd73-4654-bf0e-f4908da4217a admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:09.149760 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef922585-dd73-4654-bf0e-f4908da4217a admin admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:09.152367 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef922585-dd73-4654-bf0e-f4908da4217a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:09.156890 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef922585-dd73-4654-bf0e-f4908da4217a admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:09.309901 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 829/1667] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:58:08 2022] POST /identity/v3/users => generated 282 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:58:09.313468 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83653f6f-4f36-4db7-a16e-8e28708d60a6 service cinder] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:09.328350 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83653f6f-4f36-4db7-a16e-8e28708d60a6 service cinder] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:09.345617 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ff139-ea77-4efe-85c9-fd3880500d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:09.347291 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ff139-ea77-4efe-85c9-fd3880500d26 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:09.347576 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ff139-ea77-4efe-85c9-fd3880500d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:09.349987 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ff139-ea77-4efe-85c9-fd3880500d26 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:09.351128 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ff139-ea77-4efe-85c9-fd3880500d26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:09.359735 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ff139-ea77-4efe-85c9-fd3880500d26 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:09.392567 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 839/1668] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:58:09 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:58:09.400577 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef922585-dd73-4654-bf0e-f4908da4217a admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:09.411900 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef922585-dd73-4654-bf0e-f4908da4217a admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:09.450242 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7a8e0-8677-4c32-bf1c-dd738a4b30d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:09.451245 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7a8e0-8677-4c32-bf1c-dd738a4b30d0 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:09.451681 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7a8e0-8677-4c32-bf1c-dd738a4b30d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:09.451961 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7a8e0-8677-4c32-bf1c-dd738a4b30d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:09.452622 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd7a8e0-8677-4c32-bf1c-dd738a4b30d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:09.454344 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd7a8e0-8677-4c32-bf1c-dd738a4b30d0 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:09.479911 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 830/1669] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:58:09 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:58:09.497071 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ff139-ea77-4efe-85c9-fd3880500d26 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:09.513744 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ff139-ea77-4efe-85c9-fd3880500d26 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:09.532875 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677663d-b265-44d3-9c0d-d0a8644718a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:09.534648 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677663d-b265-44d3-9c0d-d0a8644718a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:09.535149 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677663d-b265-44d3-9c0d-d0a8644718a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:09.537084 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677663d-b265-44d3-9c0d-d0a8644718a6 admin admin] PATH_INFO: `/v3/projects/06ebf172ab0f49ba9ec8050dd0c70499/users/435278b22f004e6ba6302140bd944f69/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:09.614453 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5677663d-b265-44d3-9c0d-d0a8644718a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06ebf172ab0f49ba9ec8050dd0c70499, user_id=435278b22f004e6ba6302140bd944f69, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:09.621417 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5677663d-b265-44d3-9c0d-d0a8644718a6 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:09.651028 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:09.728054 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 840/1670] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:58:09 2022] PUT /identity/v3/projects/06ebf172ab0f49ba9ec8050dd0c70499/users/435278b22f004e6ba6302140bd944f69/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:09.732150 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9faed-9bb5-4795-88bb-435939d4eac9 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:09.732150 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9faed-9bb5-4795-88bb-435939d4eac9 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:09.732150 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9faed-9bb5-4795-88bb-435939d4eac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:09.789132 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-25f9faed-9bb5-4795-88bb-435939d4eac9 None None] MFA Rules not processed for user `435278b22f004e6ba6302140bd944f69`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:09.790381 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-25f9faed-9bb5-4795-88bb-435939d4eac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:10.055889 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 831/1671] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:10.056339 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677663d-b265-44d3-9c0d-d0a8644718a6 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:10.159181 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677663d-b265-44d3-9c0d-d0a8644718a6 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:10.171366 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d7e22-d785-4207-8cd4-899743d75fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:10.172151 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d7e22-d785-4207-8cd4-899743d75fb0 admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:10.172500 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d7e22-d785-4207-8cd4-899743d75fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:10.172993 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d7e22-d785-4207-8cd4-899743d75fb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:10.173785 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d7e22-d785-4207-8cd4-899743d75fb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:10.176818 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d7e22-d785-4207-8cd4-899743d75fb0 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:10.323918 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 841/1672] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 19:58:10 2022] POST /identity/v3/projects => generated 363 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:58:10.328249 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9faed-9bb5-4795-88bb-435939d4eac9 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:10.350265 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9faed-9bb5-4795-88bb-435939d4eac9 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:10.483219 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b46bc-d1af-4868-b398-236d0c42732a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:10.484109 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b46bc-d1af-4868-b398-236d0c42732a admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:10.484603 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b46bc-d1af-4868-b398-236d0c42732a admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:10.485106 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b46bc-d1af-4868-b398-236d0c42732a admin admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:10.485944 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3b46bc-d1af-4868-b398-236d0c42732a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:10.488105 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3b46bc-d1af-4868-b398-236d0c42732a admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:10.626101 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 832/1673] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:58:10 2022] POST /identity/v3/users => generated 288 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:58:10.627445 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d7e22-d785-4207-8cd4-899743d75fb0 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:10.644159 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d7e22-d785-4207-8cd4-899743d75fb0 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:10.651180 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6cc78d-0dc1-46f8-b161-c28b12567ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:10.666420 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6cc78d-0dc1-46f8-b161-c28b12567ef0 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:10.667099 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6cc78d-0dc1-46f8-b161-c28b12567ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:10.667622 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6cc78d-0dc1-46f8-b161-c28b12567ef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:10.668579 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6cc78d-0dc1-46f8-b161-c28b12567ef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:10.670472 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6cc78d-0dc1-46f8-b161-c28b12567ef0 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:10.695616 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 842/1674] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:58:10 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:58:10.696513 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b46bc-d1af-4868-b398-236d0c42732a admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:10.714193 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b46bc-d1af-4868-b398-236d0c42732a admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:10.726844 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d5aaa1-27d9-436b-9c26-1fe8834d79e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:10.727578 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5aaa1-27d9-436b-9c26-1fe8834d79e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:10.727856 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5aaa1-27d9-436b-9c26-1fe8834d79e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:10.728125 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5aaa1-27d9-436b-9c26-1fe8834d79e9 admin admin] PATH_INFO: `/v3/projects/85811082ae414b738321e989978e940f/users/fc035dd3aa0649648947a70449d85542/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:10.748604 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d5aaa1-27d9-436b-9c26-1fe8834d79e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85811082ae414b738321e989978e940f, user_id=fc035dd3aa0649648947a70449d85542, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:10.753703 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d5aaa1-27d9-436b-9c26-1fe8834d79e9 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:10.854004 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 833/1675] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:58:10 2022] PUT /identity/v3/projects/85811082ae414b738321e989978e940f/users/fc035dd3aa0649648947a70449d85542/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:10.858320 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6cc78d-0dc1-46f8-b161-c28b12567ef0 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:10.883905 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6cc78d-0dc1-46f8-b161-c28b12567ef0 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:11.005869 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39502297-f0bc-414c-93e2-434973093871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:11.011332 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39502297-f0bc-414c-93e2-434973093871 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:11.011332 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39502297-f0bc-414c-93e2-434973093871 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:11.011332 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39502297-f0bc-414c-93e2-434973093871 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:11.011332 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39502297-f0bc-414c-93e2-434973093871 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:11.015734 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39502297-f0bc-414c-93e2-434973093871 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:11.049552 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 843/1676] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:58:10 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:58:11.051649 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d5aaa1-27d9-436b-9c26-1fe8834d79e9 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:11.070983 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d5aaa1-27d9-436b-9c26-1fe8834d79e9 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:11.102944 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f4969-f9aa-4379-9ebe-97fad38b139b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:11.102944 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f4969-f9aa-4379-9ebe-97fad38b139b admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:11.102944 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f4969-f9aa-4379-9ebe-97fad38b139b admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:11.102944 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f4969-f9aa-4379-9ebe-97fad38b139b admin admin] PATH_INFO: `/v3/projects/85811082ae414b738321e989978e940f/users/fc035dd3aa0649648947a70449d85542/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:11.103384 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124f4969-f9aa-4379-9ebe-97fad38b139b admin admin] RBAC: Authorizing `identity:create_grant(project_id=85811082ae414b738321e989978e940f, user_id=fc035dd3aa0649648947a70449d85542, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:11.103384 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124f4969-f9aa-4379-9ebe-97fad38b139b admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:11.144200 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 834/1677] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:58:11 2022] PUT /identity/v3/projects/85811082ae414b738321e989978e940f/users/fc035dd3aa0649648947a70449d85542/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:11.154912 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd285f7a-f990-446b-b438-fb2244def872 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:11.158581 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd285f7a-f990-446b-b438-fb2244def872 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:11.158581 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd285f7a-f990-446b-b438-fb2244def872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:11.204085 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-fd285f7a-f990-446b-b438-fb2244def872 None None] MFA Rules not processed for user `fc035dd3aa0649648947a70449d85542`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:11.223554 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-fd285f7a-f990-446b-b438-fb2244def872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:11.413847 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f4969-f9aa-4379-9ebe-97fad38b139b admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:11.415656 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-124f4969-f9aa-4379-9ebe-97fad38b139b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:11.431216 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 844/1678] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:11 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:58:11.519727 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:11.533364 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f4969-f9aa-4379-9ebe-97fad38b139b admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:11.539924 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd285f7a-f990-446b-b438-fb2244def872 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:11.554430 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4add98a9-dcbc-4bc0-84ac-a77d2af7ac3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:11.558244 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add98a9-dcbc-4bc0-84ac-a77d2af7ac3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:11.558870 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add98a9-dcbc-4bc0-84ac-a77d2af7ac3b admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:11.559968 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add98a9-dcbc-4bc0-84ac-a77d2af7ac3b admin admin] PATH_INFO: `/v3/users/6a03b162171c44eb9ac697c8e64d0a9a` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:11.563774 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4add98a9-dcbc-4bc0-84ac-a77d2af7ac3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a03b162171c44eb9ac697c8e64d0a9a)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:11.567043 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4add98a9-dcbc-4bc0-84ac-a77d2af7ac3b admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:11.614429 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:11.689538 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd285f7a-f990-446b-b438-fb2244def872 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:11.698726 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb9e843-e4b3-446e-8b43-20064ace2062 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:11.699993 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9e843-e4b3-446e-8b43-20064ace2062 service cinder] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:11.699993 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9e843-e4b3-446e-8b43-20064ace2062 service cinder] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:11.700259 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9e843-e4b3-446e-8b43-20064ace2062 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:11.731259 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb9e843-e4b3-446e-8b43-20064ace2062 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:11.732750 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb9e843-e4b3-446e-8b43-20064ace2062 service cinder] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:11.759371 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 845/1679] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:58:11 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:58:11.761025 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda90ee4-0abb-466e-a900-66a3f689b2ba None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:11.761533 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda90ee4-0abb-466e-a900-66a3f689b2ba None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:11.762243 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda90ee4-0abb-466e-a900-66a3f689b2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:11.801390 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-4add98a9-dcbc-4bc0-84ac-a77d2af7ac3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a03b162171c44eb9ac697c8e64d0a9a'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:11.845470 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-dda90ee4-0abb-466e-a900-66a3f689b2ba None None] MFA Rules not processed for user `48d3cb593b3e4a159b9c37f8efe130fd`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:11.846281 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-dda90ee4-0abb-466e-a900-66a3f689b2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:11.933063 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-4add98a9-dcbc-4bc0-84ac-a77d2af7ac3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a03b162171c44eb9ac697c8e64d0a9a'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:11.934304 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-4add98a9-dcbc-4bc0-84ac-a77d2af7ac3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a03b162171c44eb9ac697c8e64d0a9a'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:11.946668 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-4add98a9-dcbc-4bc0-84ac-a77d2af7ac3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a03b162171c44eb9ac697c8e64d0a9a'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:12.003865 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-4add98a9-dcbc-4bc0-84ac-a77d2af7ac3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a03b162171c44eb9ac697c8e64d0a9a'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:12.065829 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 835/1680] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 19:58:11 2022] DELETE /identity/v3/users/6a03b162171c44eb9ac697c8e64d0a9a => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:12.070438 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860aaa1d-f74e-4247-a574-6ae5bd98a83e None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:12.072956 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860aaa1d-f74e-4247-a574-6ae5bd98a83e None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:12.072956 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860aaa1d-f74e-4247-a574-6ae5bd98a83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:12.111102 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-860aaa1d-f74e-4247-a574-6ae5bd98a83e None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:12.111102 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-860aaa1d-f74e-4247-a574-6ae5bd98a83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:12.112913 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 846/1681] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:11 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:12.180553 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda90ee4-0abb-466e-a900-66a3f689b2ba None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:12.191719 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-dda90ee4-0abb-466e-a900-66a3f689b2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:12.228732 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda90ee4-0abb-466e-a900-66a3f689b2ba None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:12.249016 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 836/1682] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:12.263487 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860aaa1d-f74e-4247-a574-6ae5bd98a83e None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:12.267593 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-860aaa1d-f74e-4247-a574-6ae5bd98a83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:12.397948 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860aaa1d-f74e-4247-a574-6ae5bd98a83e None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:12.404350 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e987e5f9-4ba0-42aa-ad0d-4d511f7cb131 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:12.406392 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987e5f9-4ba0-42aa-ad0d-4d511f7cb131 service neutron] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:12.407599 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987e5f9-4ba0-42aa-ad0d-4d511f7cb131 service neutron] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:12.408757 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987e5f9-4ba0-42aa-ad0d-4d511f7cb131 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:12.435743 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e987e5f9-4ba0-42aa-ad0d-4d511f7cb131 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:12.437147 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aeb993-7146-4524-9cc5-ac8671193726 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:12.439665 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e987e5f9-4ba0-42aa-ad0d-4d511f7cb131 service neutron] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:12.440544 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aeb993-7146-4524-9cc5-ac8671193726 service cinder] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:12.441084 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aeb993-7146-4524-9cc5-ac8671193726 service cinder] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:12.441561 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aeb993-7146-4524-9cc5-ac8671193726 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:12.446795 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-51aeb993-7146-4524-9cc5-ac8671193726 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:12.469081 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 837/1683] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:58:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 19:58:12.600063 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aeb993-7146-4524-9cc5-ac8671193726 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:12.603004 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aeb993-7146-4524-9cc5-ac8671193726 service cinder] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:12.634596 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 847/1684] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:58:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:58:12.967256 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:13.235671 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e987e5f9-4ba0-42aa-ad0d-4d511f7cb131 service neutron] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:13.235671 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-e987e5f9-4ba0-42aa-ad0d-4d511f7cb131 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:13.245613 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e987e5f9-4ba0-42aa-ad0d-4d511f7cb131 service neutron] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:13.271698 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b55f83-a8e6-41c7-8fca-827c73771cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:13.272413 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b55f83-a8e6-41c7-8fca-827c73771cbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:13.272691 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b55f83-a8e6-41c7-8fca-827c73771cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:13.272963 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b55f83-a8e6-41c7-8fca-827c73771cbf admin admin] PATH_INFO: `/v3/users/42301c9929b74988b159de90ad45ecc7` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:13.275295 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:13.281306 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b55f83-a8e6-41c7-8fca-827c73771cbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=42301c9929b74988b159de90ad45ecc7)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:13.287248 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b55f83-a8e6-41c7-8fca-827c73771cbf admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:13.549569 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-e8b55f83-a8e6-41c7-8fca-827c73771cbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42301c9929b74988b159de90ad45ecc7'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:13.612078 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-e8b55f83-a8e6-41c7-8fca-827c73771cbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42301c9929b74988b159de90ad45ecc7'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:13.612850 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-e8b55f83-a8e6-41c7-8fca-827c73771cbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42301c9929b74988b159de90ad45ecc7'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:13.613740 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-e8b55f83-a8e6-41c7-8fca-827c73771cbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42301c9929b74988b159de90ad45ecc7'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:13.632300 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-e8b55f83-a8e6-41c7-8fca-827c73771cbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42301c9929b74988b159de90ad45ecc7'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:13.671733 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 838/1685] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 19:58:13 2022] DELETE /identity/v3/users/42301c9929b74988b159de90ad45ecc7 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:13.673348 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af26ac8-423d-41ee-8fa0-a6e4e5839f34 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:13.673823 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af26ac8-423d-41ee-8fa0-a6e4e5839f34 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:13.673924 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af26ac8-423d-41ee-8fa0-a6e4e5839f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:13.710923 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-0af26ac8-423d-41ee-8fa0-a6e4e5839f34 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:13.712264 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-0af26ac8-423d-41ee-8fa0-a6e4e5839f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:13.819740 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 848/1686] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:13.837360 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b55f83-a8e6-41c7-8fca-827c73771cbf admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:13.839437 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-e8b55f83-a8e6-41c7-8fca-827c73771cbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:13.903886 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b06bf1-0d50-4a6c-84b9-4bb8581f5b8b None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:13.904544 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b06bf1-0d50-4a6c-84b9-4bb8581f5b8b None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:13.905025 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b06bf1-0d50-4a6c-84b9-4bb8581f5b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:13.960191 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b55f83-a8e6-41c7-8fca-827c73771cbf admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:13.964657 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-48b06bf1-0d50-4a6c-84b9-4bb8581f5b8b None None] MFA Rules not processed for user `b418518e8d14456d81965247b5e42003`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:13.968319 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-48b06bf1-0d50-4a6c-84b9-4bb8581f5b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:13.970025 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13644ef4-62a6-4419-aaeb-a2e849cd1fd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:13.971261 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13644ef4-62a6-4419-aaeb-a2e849cd1fd9 service neutron] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:13.973070 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13644ef4-62a6-4419-aaeb-a2e849cd1fd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:13.973852 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13644ef4-62a6-4419-aaeb-a2e849cd1fd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:14.002422 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13644ef4-62a6-4419-aaeb-a2e849cd1fd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:14.005795 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13644ef4-62a6-4419-aaeb-a2e849cd1fd9 service neutron] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:14.030287 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 839/1687] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:58:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:58:14.031473 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13644ef4-62a6-4419-aaeb-a2e849cd1fd9 service neutron] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:14.033170 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-13644ef4-62a6-4419-aaeb-a2e849cd1fd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:14.053099 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13644ef4-62a6-4419-aaeb-a2e849cd1fd9 service neutron] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:14.061244 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053e706-367a-4d2f-9546-08b96204036b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:14.062275 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053e706-367a-4d2f-9546-08b96204036b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:14.062717 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053e706-367a-4d2f-9546-08b96204036b admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:14.063192 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053e706-367a-4d2f-9546-08b96204036b admin admin] PATH_INFO: `/v3/projects/2f682ebc17b441a6800e911f74ab1ce0` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:14.064721 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d053e706-367a-4d2f-9546-08b96204036b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f682ebc17b441a6800e911f74ab1ce0)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:14.068239 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d053e706-367a-4d2f-9546-08b96204036b admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:14.134634 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 849/1688] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:13 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:14.145425 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289952d-701b-4877-968e-80999a93e067 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:14.146465 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289952d-701b-4877-968e-80999a93e067 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:14.146465 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289952d-701b-4877-968e-80999a93e067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:14.180108 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-f289952d-701b-4877-968e-80999a93e067 None None] MFA Rules not processed for user `b418518e8d14456d81965247b5e42003`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:14.181655 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-f289952d-701b-4877-968e-80999a93e067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:14.199455 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 850/1689] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:14 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:14.211637 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f289952d-701b-4877-968e-80999a93e067 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:14.214287 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-f289952d-701b-4877-968e-80999a93e067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:14.223891 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:14.268410 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-d053e706-367a-4d2f-9546-08b96204036b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f682ebc17b441a6800e911f74ab1ce0', 'request_id': 'req-d053e706-367a-4d2f-9546-08b96204036b'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:14.284155 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-d053e706-367a-4d2f-9546-08b96204036b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f682ebc17b441a6800e911f74ab1ce0', 'request_id': 'req-d053e706-367a-4d2f-9546-08b96204036b'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:14.388791 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f289952d-701b-4877-968e-80999a93e067 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:14.424828 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-d053e706-367a-4d2f-9546-08b96204036b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f682ebc17b441a6800e911f74ab1ce0', 'request_id': 'req-d053e706-367a-4d2f-9546-08b96204036b'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:14.474418 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-d053e706-367a-4d2f-9546-08b96204036b admin admin] The token cache is being invalidate because project 2f682ebc17b441a6800e911f74ab1ce0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 19:58:14.474846 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-d053e706-367a-4d2f-9546-08b96204036b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:14.482621 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-d053e706-367a-4d2f-9546-08b96204036b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:14.485277 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 840/1690] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 19:58:14 2022] DELETE /identity/v3/projects/2f682ebc17b441a6800e911f74ab1ce0 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:14.491664 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053e706-367a-4d2f-9546-08b96204036b admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:14.498928 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-d053e706-367a-4d2f-9546-08b96204036b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:14.557770 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c3621-8c6c-434a-8c30-e56efbf5b5b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5047a59bc4547be643ffa78808a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:14.558845 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c3621-8c6c-434a-8c30-e56efbf5b5b4 service nova] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:14.561178 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c3621-8c6c-434a-8c30-e56efbf5b5b4 service nova] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:14.561635 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c3621-8c6c-434a-8c30-e56efbf5b5b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:14.570564 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-040c3621-8c6c-434a-8c30-e56efbf5b5b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:14.699339 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053e706-367a-4d2f-9546-08b96204036b admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:14.724879 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f6eb2-19cb-49c0-896a-cc64b2c3bbe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:14.726401 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f6eb2-19cb-49c0-896a-cc64b2c3bbe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:14.726864 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f6eb2-19cb-49c0-896a-cc64b2c3bbe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:14.727270 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f6eb2-19cb-49c0-896a-cc64b2c3bbe8 admin admin] PATH_INFO: `/v3/users/24b94c44a3c14798bf7fdb95d9b682b2` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:14.729198 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26f6eb2-19cb-49c0-896a-cc64b2c3bbe8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24b94c44a3c14798bf7fdb95d9b682b2)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:14.732776 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26f6eb2-19cb-49c0-896a-cc64b2c3bbe8 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:14.762940 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040c3621-8c6c-434a-8c30-e56efbf5b5b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:14.765963 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040c3621-8c6c-434a-8c30-e56efbf5b5b4 service nova] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:14.785969 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 851/1691] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:58:14 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:58:15.040287 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-a26f6eb2-19cb-49c0-896a-cc64b2c3bbe8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24b94c44a3c14798bf7fdb95d9b682b2'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:15.126611 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-a26f6eb2-19cb-49c0-896a-cc64b2c3bbe8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24b94c44a3c14798bf7fdb95d9b682b2'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:15.127370 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-a26f6eb2-19cb-49c0-896a-cc64b2c3bbe8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24b94c44a3c14798bf7fdb95d9b682b2'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:15.128114 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-a26f6eb2-19cb-49c0-896a-cc64b2c3bbe8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24b94c44a3c14798bf7fdb95d9b682b2'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:15.156183 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-a26f6eb2-19cb-49c0-896a-cc64b2c3bbe8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24b94c44a3c14798bf7fdb95d9b682b2'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:15.174627 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c3621-8c6c-434a-8c30-e56efbf5b5b4 service nova] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:15.174958 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-040c3621-8c6c-434a-8c30-e56efbf5b5b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:15.186575 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 841/1692] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 19:58:14 2022] DELETE /identity/v3/users/24b94c44a3c14798bf7fdb95d9b682b2 => generated 0 bytes in 697 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:15.199360 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c3621-8c6c-434a-8c30-e56efbf5b5b4 service nova] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:15.224674 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ea777-c8bd-4806-bf34-cf9ccb292420 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:15.225027 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ea777-c8bd-4806-bf34-cf9ccb292420 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:15.225242 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ea777-c8bd-4806-bf34-cf9ccb292420 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:15.227790 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 842/1693] 10.222.0.60 () {54 vars in 921 bytes} [Sat Sep 24 19:58:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:58:15.268778 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70adfce2-8245-4108-b38c-0024d958a430 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:15.269320 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70adfce2-8245-4108-b38c-0024d958a430 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:15.269923 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70adfce2-8245-4108-b38c-0024d958a430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:15.276708 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:15.326438 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:15.329301 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-70adfce2-8245-4108-b38c-0024d958a430 None None] MFA Rules not processed for user `55f19f1385114fa5a921999747a6666b`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:15.330854 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-70adfce2-8245-4108-b38c-0024d958a430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:15.342356 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5406d-a9dc-4e80-875d-f9c2e75ffefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:15.348574 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5406d-a9dc-4e80-875d-f9c2e75ffefe admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:15.348574 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5406d-a9dc-4e80-875d-f9c2e75ffefe admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:15.348574 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5406d-a9dc-4e80-875d-f9c2e75ffefe admin admin] PATH_INFO: `/v3/projects/a0e26363672b412ba7fa1da4d02b2bf1` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:15.356371 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b5406d-a9dc-4e80-875d-f9c2e75ffefe admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0e26363672b412ba7fa1da4d02b2bf1)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:15.370114 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b5406d-a9dc-4e80-875d-f9c2e75ffefe admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:15.569830 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-f2b5406d-a9dc-4e80-875d-f9c2e75ffefe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0e26363672b412ba7fa1da4d02b2bf1', 'request_id': 'req-f2b5406d-a9dc-4e80-875d-f9c2e75ffefe'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:15.571218 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 843/1694] 10.222.0.60 () {58 vars in 1018 bytes} [Sat Sep 24 19:58:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:15.617847 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70adfce2-8245-4108-b38c-0024d958a430 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:15.618526 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-70adfce2-8245-4108-b38c-0024d958a430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:15.654148 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70adfce2-8245-4108-b38c-0024d958a430 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:15.715015 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-f2b5406d-a9dc-4e80-875d-f9c2e75ffefe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0e26363672b412ba7fa1da4d02b2bf1', 'request_id': 'req-f2b5406d-a9dc-4e80-875d-f9c2e75ffefe'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:15.722220 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-f2b5406d-a9dc-4e80-875d-f9c2e75ffefe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0e26363672b412ba7fa1da4d02b2bf1', 'request_id': 'req-f2b5406d-a9dc-4e80-875d-f9c2e75ffefe'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:15.744350 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-f2b5406d-a9dc-4e80-875d-f9c2e75ffefe admin admin] The token cache is being invalidate because project a0e26363672b412ba7fa1da4d02b2bf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 19:58:15.745026 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-f2b5406d-a9dc-4e80-875d-f9c2e75ffefe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:15.754079 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-f2b5406d-a9dc-4e80-875d-f9c2e75ffefe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:15.757797 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 852/1695] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 19:58:15 2022] DELETE /identity/v3/projects/a0e26363672b412ba7fa1da4d02b2bf1 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:15.767463 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe14b4-fdf1-4e1d-87ea-d82c84e4f425 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:15.768421 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe14b4-fdf1-4e1d-87ea-d82c84e4f425 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:15.769082 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe14b4-fdf1-4e1d-87ea-d82c84e4f425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:15.817340 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-1bbe14b4-fdf1-4e1d-87ea-d82c84e4f425 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:15.819217 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-1bbe14b4-fdf1-4e1d-87ea-d82c84e4f425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:15.869337 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b732e2-7b44-4b98-aea5-96253133ae32 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f19f1385114fa5a921999747a6666b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:15.871928 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b732e2-7b44-4b98-aea5-96253133ae32 service placement] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:15.872277 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b732e2-7b44-4b98-aea5-96253133ae32 service placement] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:15.872550 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b732e2-7b44-4b98-aea5-96253133ae32 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:15.877749 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-15b732e2-7b44-4b98-aea5-96253133ae32 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:15.902161 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b732e2-7b44-4b98-aea5-96253133ae32 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:15.903902 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b732e2-7b44-4b98-aea5-96253133ae32 service placement] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:15.926993 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 844/1696] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:58:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:58:15.928538 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e54a3-de6e-4e8e-a8b0-ff12d6401554 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:15.939039 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e54a3-de6e-4e8e-a8b0-ff12d6401554 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:15.940607 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e54a3-de6e-4e8e-a8b0-ff12d6401554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:16.012787 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-d71e54a3-de6e-4e8e-a8b0-ff12d6401554 None None] MFA Rules not processed for user `d2c1ded5aad545148d3e30f6ce994004`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:16.014040 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-d71e54a3-de6e-4e8e-a8b0-ff12d6401554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:16.108881 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 853/1697] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:16.118515 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479705f-a0ff-4644-aedb-3e226848e841 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:16.120167 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479705f-a0ff-4644-aedb-3e226848e841 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:16.121195 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479705f-a0ff-4644-aedb-3e226848e841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:16.195316 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-c479705f-a0ff-4644-aedb-3e226848e841 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:16.201482 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-c479705f-a0ff-4644-aedb-3e226848e841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:16.228533 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 854/1698] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:16.229687 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479705f-a0ff-4644-aedb-3e226848e841 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:16.246621 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 845/1699] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:16.246851 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479705f-a0ff-4644-aedb-3e226848e841 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:16.265884 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c9c964-6620-475f-a00e-66a040eeaa4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:16.265992 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e54a3-de6e-4e8e-a8b0-ff12d6401554 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:16.265992 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-d71e54a3-de6e-4e8e-a8b0-ff12d6401554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:16.266143 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9c964-6620-475f-a00e-66a040eeaa4e admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:16.266143 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9c964-6620-475f-a00e-66a040eeaa4e admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:16.266143 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9c964-6620-475f-a00e-66a040eeaa4e admin admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:16.266760 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c9c964-6620-475f-a00e-66a040eeaa4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:58:16.266968 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c9c964-6620-475f-a00e-66a040eeaa4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:16.268597 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c9c964-6620-475f-a00e-66a040eeaa4e admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:16.321684 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 855/1700] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 19:58:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:58:16.327463 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c9c964-6620-475f-a00e-66a040eeaa4e admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:16.352700 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c9c964-6620-475f-a00e-66a040eeaa4e admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:16.393347 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e89ea-21cd-488a-a9ec-42e5f3e469f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:16.394385 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e89ea-21cd-488a-a9ec-42e5f3e469f1 admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:16.394771 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e89ea-21cd-488a-a9ec-42e5f3e469f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:16.395217 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e89ea-21cd-488a-a9ec-42e5f3e469f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:16.398080 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120e89ea-21cd-488a-a9ec-42e5f3e469f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:16.400338 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120e89ea-21cd-488a-a9ec-42e5f3e469f1 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:16.505379 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e54a3-de6e-4e8e-a8b0-ff12d6401554 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:16.524056 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e154bb-bfba-45fc-921a-60fa44f120fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5047a59bc4547be643ffa78808a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:16.524737 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e154bb-bfba-45fc-921a-60fa44f120fc service nova] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:16.525013 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e154bb-bfba-45fc-921a-60fa44f120fc service nova] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:16.525281 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e154bb-bfba-45fc-921a-60fa44f120fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:16.539948 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e154bb-bfba-45fc-921a-60fa44f120fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:16.541826 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e154bb-bfba-45fc-921a-60fa44f120fc service nova] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:16.563478 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 846/1701] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:58:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 19:58:16.565024 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73339ee3-e723-466f-9354-4b4ef7a383d9 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:16.565458 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73339ee3-e723-466f-9354-4b4ef7a383d9 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:16.565924 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73339ee3-e723-466f-9354-4b4ef7a383d9 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:16.577301 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 847/1702] 10.222.0.60 () {54 vars in 912 bytes} [Sat Sep 24 19:58:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:58:16.579029 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ae470-0143-414b-bbdf-8167daf5b3d4 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:16.579548 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ae470-0143-414b-bbdf-8167daf5b3d4 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:16.579983 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ae470-0143-414b-bbdf-8167daf5b3d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:16.589549 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 856/1703] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 19:58:16 2022] POST /identity/v3/projects => generated 373 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:58:16.594385 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e89ea-21cd-488a-a9ec-42e5f3e469f1 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:16.658169 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-161ae470-0143-414b-bbdf-8167daf5b3d4 None None] MFA Rules not processed for user `fed7dee25fd54255ad24cd6ad880fa3f`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:16.659398 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-161ae470-0143-414b-bbdf-8167daf5b3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:16.711379 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:16.836459 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 848/1704] 10.222.0.60 () {58 vars in 1009 bytes} [Sat Sep 24 19:58:16 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:58:16.858567 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:16.876168 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e89ea-21cd-488a-a9ec-42e5f3e469f1 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:16.896762 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707050f1-8211-436c-8cfb-1308ec117da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:16.902184 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707050f1-8211-436c-8cfb-1308ec117da1 admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:16.902598 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707050f1-8211-436c-8cfb-1308ec117da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:16.904907 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707050f1-8211-436c-8cfb-1308ec117da1 admin admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:16.908747 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707050f1-8211-436c-8cfb-1308ec117da1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:16.914869 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707050f1-8211-436c-8cfb-1308ec117da1 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:16.921205 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161ae470-0143-414b-bbdf-8167daf5b3d4 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:16.923094 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-161ae470-0143-414b-bbdf-8167daf5b3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:16.944642 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161ae470-0143-414b-bbdf-8167daf5b3d4 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:16.954081 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40330755-465c-457b-8b36-518f38af4e9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:16.955505 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40330755-465c-457b-8b36-518f38af4e9c service neutron] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:16.956520 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40330755-465c-457b-8b36-518f38af4e9c service neutron] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:16.957028 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40330755-465c-457b-8b36-518f38af4e9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:16.981147 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40330755-465c-457b-8b36-518f38af4e9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:16.983653 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40330755-465c-457b-8b36-518f38af4e9c service neutron] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:16.998576 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 849/1705] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:58:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:58:17.062410 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 857/1706] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:58:16 2022] POST /identity/v3/users => generated 287 bytes in 465 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:58:17.064089 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40330755-465c-457b-8b36-518f38af4e9c service neutron] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:17.086218 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40330755-465c-457b-8b36-518f38af4e9c service neutron] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:17.102811 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e8ffb-0906-4a54-9d04-c5c409f3baf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:17.106520 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e8ffb-0906-4a54-9d04-c5c409f3baf6 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:17.106916 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e8ffb-0906-4a54-9d04-c5c409f3baf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:17.110641 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e8ffb-0906-4a54-9d04-c5c409f3baf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:17.111711 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e8ffb-0906-4a54-9d04-c5c409f3baf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:17.113465 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e8ffb-0906-4a54-9d04-c5c409f3baf6 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:17.145359 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 850/1707] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:58:17 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:58:17.149535 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707050f1-8211-436c-8cfb-1308ec117da1 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:17.166768 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707050f1-8211-436c-8cfb-1308ec117da1 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:17.181701 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32014633-5a95-4ebf-afbb-a030415d4c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:17.182692 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32014633-5a95-4ebf-afbb-a030415d4c0e admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:17.183805 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32014633-5a95-4ebf-afbb-a030415d4c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:17.184239 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32014633-5a95-4ebf-afbb-a030415d4c0e admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:17.185317 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32014633-5a95-4ebf-afbb-a030415d4c0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:17.187429 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32014633-5a95-4ebf-afbb-a030415d4c0e admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:17.219002 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 858/1708] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:58:17 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:58:17.223692 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e8ffb-0906-4a54-9d04-c5c409f3baf6 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:17.241054 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e8ffb-0906-4a54-9d04-c5c409f3baf6 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:17.270294 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32014633-5a95-4ebf-afbb-a030415d4c0e admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:17.272099 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-32014633-5a95-4ebf-afbb-a030415d4c0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:17.273063 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d669f378-b6ea-489b-b832-e22f594c9179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:17.274606 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669f378-b6ea-489b-b832-e22f594c9179 admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:17.275085 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669f378-b6ea-489b-b832-e22f594c9179 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:17.275498 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669f378-b6ea-489b-b832-e22f594c9179 admin admin] PATH_INFO: `/v3/projects/7f94c1cbe3b54179980be6c36f9cef70/users/9a3e03bc7c7640b0a07a47430eb3a408/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:17.305025 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d669f378-b6ea-489b-b832-e22f594c9179 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f94c1cbe3b54179980be6c36f9cef70, user_id=9a3e03bc7c7640b0a07a47430eb3a408, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:17.310552 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d669f378-b6ea-489b-b832-e22f594c9179 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:17.409143 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32014633-5a95-4ebf-afbb-a030415d4c0e admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:17.420435 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 851/1709] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:58:17 2022] PUT /identity/v3/projects/7f94c1cbe3b54179980be6c36f9cef70/users/9a3e03bc7c7640b0a07a47430eb3a408/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:17.426747 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df51f8c-55de-4885-858d-e4840268a179 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:17.427045 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df51f8c-55de-4885-858d-e4840268a179 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:17.427492 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df51f8c-55de-4885-858d-e4840268a179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:17.494323 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-2df51f8c-55de-4885-858d-e4840268a179 None None] MFA Rules not processed for user `9a3e03bc7c7640b0a07a47430eb3a408`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:17.496396 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-2df51f8c-55de-4885-858d-e4840268a179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:17.588039 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4035e4-8005-455e-8e17-c2392dd8aaa5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:17.588667 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4035e4-8005-455e-8e17-c2392dd8aaa5 service cinder] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:17.588948 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4035e4-8005-455e-8e17-c2392dd8aaa5 service cinder] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:17.589619 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4035e4-8005-455e-8e17-c2392dd8aaa5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:17.594283 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-0b4035e4-8005-455e-8e17-c2392dd8aaa5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:17.700966 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 852/1710] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:17.706066 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df51f8c-55de-4885-858d-e4840268a179 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:17.754048 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4035e4-8005-455e-8e17-c2392dd8aaa5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:17.756204 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4035e4-8005-455e-8e17-c2392dd8aaa5 service cinder] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:17.780285 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 859/1711] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:58:17 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:58:17.784000 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4035e4-8005-455e-8e17-c2392dd8aaa5 service cinder] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:17.784000 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-0b4035e4-8005-455e-8e17-c2392dd8aaa5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:17.943147 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4035e4-8005-455e-8e17-c2392dd8aaa5 service cinder] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:17.955219 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25335c-f2ee-43ab-b370-6c1def8f4e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:17.955882 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25335c-f2ee-43ab-b370-6c1def8f4e5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:17.957964 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25335c-f2ee-43ab-b370-6c1def8f4e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:17.958652 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25335c-f2ee-43ab-b370-6c1def8f4e5d admin admin] PATH_INFO: `/v3/projects/d192367176274be3a4da001a74932740` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:17.962061 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e25335c-f2ee-43ab-b370-6c1def8f4e5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d192367176274be3a4da001a74932740)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:17.967734 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e25335c-f2ee-43ab-b370-6c1def8f4e5d admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:17.971166 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df51f8c-55de-4885-858d-e4840268a179 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:17.982579 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf595504-bfe4-4bf1-850b-910cdca0f198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:17.983225 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf595504-bfe4-4bf1-850b-910cdca0f198 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:17.984570 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf595504-bfe4-4bf1-850b-910cdca0f198 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:17.984849 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf595504-bfe4-4bf1-850b-910cdca0f198 admin admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:17.985521 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf595504-bfe4-4bf1-850b-910cdca0f198 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:17.994121 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf595504-bfe4-4bf1-850b-910cdca0f198 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:18.141655 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 853/1712] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 19:58:17 2022] POST /identity/v3/projects => generated 373 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:58:18.144111 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf595504-bfe4-4bf1-850b-910cdca0f198 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:18.250900 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-6e25335c-f2ee-43ab-b370-6c1def8f4e5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd192367176274be3a4da001a74932740', 'request_id': 'req-6e25335c-f2ee-43ab-b370-6c1def8f4e5d'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:18.328562 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-6e25335c-f2ee-43ab-b370-6c1def8f4e5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd192367176274be3a4da001a74932740', 'request_id': 'req-6e25335c-f2ee-43ab-b370-6c1def8f4e5d'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:18.353120 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-6e25335c-f2ee-43ab-b370-6c1def8f4e5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd192367176274be3a4da001a74932740', 'request_id': 'req-6e25335c-f2ee-43ab-b370-6c1def8f4e5d'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:18.400844 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-6e25335c-f2ee-43ab-b370-6c1def8f4e5d admin admin] The token cache is being invalidate because project d192367176274be3a4da001a74932740 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 19:58:18.401147 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-6e25335c-f2ee-43ab-b370-6c1def8f4e5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:18.404212 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-6e25335c-f2ee-43ab-b370-6c1def8f4e5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:18.408850 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf595504-bfe4-4bf1-850b-910cdca0f198 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:18.424771 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 860/1713] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 19:58:17 2022] DELETE /identity/v3/projects/d192367176274be3a4da001a74932740 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:18.429162 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25335c-f2ee-43ab-b370-6c1def8f4e5d admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:18.431508 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-6e25335c-f2ee-43ab-b370-6c1def8f4e5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:18.529681 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f874956-916c-427f-a9bd-a64c000b4570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:18.530495 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f874956-916c-427f-a9bd-a64c000b4570 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:18.531056 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f874956-916c-427f-a9bd-a64c000b4570 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:18.531857 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f874956-916c-427f-a9bd-a64c000b4570 admin admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:18.533168 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f874956-916c-427f-a9bd-a64c000b4570 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:18.540442 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f874956-916c-427f-a9bd-a64c000b4570 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:18.580166 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25335c-f2ee-43ab-b370-6c1def8f4e5d admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:18.586915 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6bd640-f63b-40a9-b4a1-ff0a3ccd46c5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f19f1385114fa5a921999747a6666b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:18.588306 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6bd640-f63b-40a9-b4a1-ff0a3ccd46c5 service placement] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:18.588691 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6bd640-f63b-40a9-b4a1-ff0a3ccd46c5 service placement] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:18.589049 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6bd640-f63b-40a9-b4a1-ff0a3ccd46c5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:18.591936 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-4c6bd640-f63b-40a9-b4a1-ff0a3ccd46c5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:18.607071 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6bd640-f63b-40a9-b4a1-ff0a3ccd46c5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:18.609061 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6bd640-f63b-40a9-b4a1-ff0a3ccd46c5 service placement] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:18.623478 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 861/1714] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:58:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:58:18.624245 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6bd640-f63b-40a9-b4a1-ff0a3ccd46c5 service placement] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:18.625657 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-4c6bd640-f63b-40a9-b4a1-ff0a3ccd46c5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:18.651182 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6bd640-f63b-40a9-b4a1-ff0a3ccd46c5 service placement] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:18.661932 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f56e3-4c35-4382-af8e-ea587a31f2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:18.663021 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f56e3-4c35-4382-af8e-ea587a31f2ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:18.663437 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f56e3-4c35-4382-af8e-ea587a31f2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:18.663790 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f56e3-4c35-4382-af8e-ea587a31f2ed admin admin] PATH_INFO: `/v3/users/03991d7560404899a64460c622cb79c7` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:18.665337 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2f56e3-4c35-4382-af8e-ea587a31f2ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=03991d7560404899a64460c622cb79c7)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:18.666479 dv-cinder-859191-1-smb devstack@keystone.service[93400]: WARNING py.warnings [None req-7e2f56e3-4c35-4382-af8e-ea587a31f2ed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 19:58:18.666479 dv-cinder-859191-1-smb devstack@keystone.service[93400]: warnings.warn(msg) Sep 24 19:58:18.666479 dv-cinder-859191-1-smb devstack@keystone.service[93400]: Sep 24 19:58:18.668729 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2f56e3-4c35-4382-af8e-ea587a31f2ed admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:18.716064 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 854/1715] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:58:18 2022] POST /identity/v3/users => generated 293 bytes in 570 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:58:18.716064 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c58be9-c974-4105-bad9-579008f5152e None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:18.717456 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c58be9-c974-4105-bad9-579008f5152e None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:18.717913 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c58be9-c974-4105-bad9-579008f5152e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:18.789625 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-64c58be9-c974-4105-bad9-579008f5152e None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:18.790978 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-64c58be9-c974-4105-bad9-579008f5152e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:18.814244 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 855/1716] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:18.815995 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5cad5-1ed1-4094-bacc-9efc9376f540 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:18.816452 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5cad5-1ed1-4094-bacc-9efc9376f540 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:18.816859 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5cad5-1ed1-4094-bacc-9efc9376f540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:18.844939 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-54a5cad5-1ed1-4094-bacc-9efc9376f540 None None] MFA Rules not processed for user `b418518e8d14456d81965247b5e42003`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:18.846852 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-54a5cad5-1ed1-4094-bacc-9efc9376f540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:18.975240 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 856/1717] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:18 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:18.981240 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a5cad5-1ed1-4094-bacc-9efc9376f540 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:18.987229 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-54a5cad5-1ed1-4094-bacc-9efc9376f540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:19.017140 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a5cad5-1ed1-4094-bacc-9efc9376f540 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:19.030698 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9b698c-232b-4724-a626-3425dfec24a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:19.031367 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b698c-232b-4724-a626-3425dfec24a5 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:19.031638 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b698c-232b-4724-a626-3425dfec24a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:19.031910 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b698c-232b-4724-a626-3425dfec24a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:19.035178 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9b698c-232b-4724-a626-3425dfec24a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:19.041996 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9b698c-232b-4724-a626-3425dfec24a5 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:19.072229 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 857/1718] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:58:18 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:58:19.078574 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95454f22-11cf-439e-a9fd-5f52d7c301af None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:19.078574 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95454f22-11cf-439e-a9fd-5f52d7c301af None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:19.078574 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95454f22-11cf-439e-a9fd-5f52d7c301af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:19.079741 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-7e2f56e3-4c35-4382-af8e-ea587a31f2ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03991d7560404899a64460c622cb79c7'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:19.131358 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-95454f22-11cf-439e-a9fd-5f52d7c301af None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:19.134636 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-95454f22-11cf-439e-a9fd-5f52d7c301af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:19.176077 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 858/1719] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:19.177165 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95454f22-11cf-439e-a9fd-5f52d7c301af None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:19.194738 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-7e2f56e3-4c35-4382-af8e-ea587a31f2ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03991d7560404899a64460c622cb79c7'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:19.198334 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-7e2f56e3-4c35-4382-af8e-ea587a31f2ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03991d7560404899a64460c622cb79c7'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:19.212257 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95454f22-11cf-439e-a9fd-5f52d7c301af None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:19.226984 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f041a7-8ff8-4f8f-b182-d2fb7c0f792f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:19.226984 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f041a7-8ff8-4f8f-b182-d2fb7c0f792f admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:19.226984 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f041a7-8ff8-4f8f-b182-d2fb7c0f792f admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:19.226984 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f041a7-8ff8-4f8f-b182-d2fb7c0f792f admin admin] PATH_INFO: `/v3/projects/a4c2f67efef144f6a5028946bb3fd1d2/users/4f4eedbddefc46d79b9553ba1b5765ab/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:19.237885 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:19.257369 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-7e2f56e3-4c35-4382-af8e-ea587a31f2ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03991d7560404899a64460c622cb79c7'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:19.258299 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-7e2f56e3-4c35-4382-af8e-ea587a31f2ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03991d7560404899a64460c622cb79c7'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:19.267006 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f041a7-8ff8-4f8f-b182-d2fb7c0f792f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4c2f67efef144f6a5028946bb3fd1d2, user_id=4f4eedbddefc46d79b9553ba1b5765ab, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:19.270032 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f041a7-8ff8-4f8f-b182-d2fb7c0f792f admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:19.316160 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 862/1720] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 19:58:18 2022] DELETE /identity/v3/users/03991d7560404899a64460c622cb79c7 => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:19.317152 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f56e3-4c35-4382-af8e-ea587a31f2ed admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:19.325865 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-7e2f56e3-4c35-4382-af8e-ea587a31f2ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:19.409261 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 859/1721] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:58:19 2022] PUT /identity/v3/projects/a4c2f67efef144f6a5028946bb3fd1d2/users/4f4eedbddefc46d79b9553ba1b5765ab/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:19.413263 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f041a7-8ff8-4f8f-b182-d2fb7c0f792f admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:19.416303 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-d7f041a7-8ff8-4f8f-b182-d2fb7c0f792f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:19.569319 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f56e3-4c35-4382-af8e-ea587a31f2ed admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:19.639772 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f041a7-8ff8-4f8f-b182-d2fb7c0f792f admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:19.653619 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a850c447-80e3-45b9-b9f5-d1a66f336eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:19.659562 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a850c447-80e3-45b9-b9f5-d1a66f336eac admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:19.659766 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a850c447-80e3-45b9-b9f5-d1a66f336eac admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:19.660053 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a850c447-80e3-45b9-b9f5-d1a66f336eac admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:19.663379 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a850c447-80e3-45b9-b9f5-d1a66f336eac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:19.663379 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a850c447-80e3-45b9-b9f5-d1a66f336eac admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:19.700617 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 860/1722] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:58:19.703474 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a850c447-80e3-45b9-b9f5-d1a66f336eac admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:19.735981 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f1e2b-4d36-42dd-8889-c20ed1d4b6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:19.736714 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a850c447-80e3-45b9-b9f5-d1a66f336eac admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:19.738743 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f1e2b-4d36-42dd-8889-c20ed1d4b6f0 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:19.739084 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f1e2b-4d36-42dd-8889-c20ed1d4b6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:19.739438 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f1e2b-4d36-42dd-8889-c20ed1d4b6f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:19.740081 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77f1e2b-4d36-42dd-8889-c20ed1d4b6f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:58:19.744653 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77f1e2b-4d36-42dd-8889-c20ed1d4b6f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:19.744653 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77f1e2b-4d36-42dd-8889-c20ed1d4b6f0 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:19.751019 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:19.769520 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 863/1723] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 19:58:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 442 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:58:19.769868 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe3b6e7-f94b-4fde-b002-ac1b617eb3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:19.769960 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f1e2b-4d36-42dd-8889-c20ed1d4b6f0 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:19.770035 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3b6e7-f94b-4fde-b002-ac1b617eb3f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:19.770035 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3b6e7-f94b-4fde-b002-ac1b617eb3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:19.770035 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3b6e7-f94b-4fde-b002-ac1b617eb3f5 admin admin] PATH_INFO: `/v3/projects/a4c2f67efef144f6a5028946bb3fd1d2/users/4f4eedbddefc46d79b9553ba1b5765ab/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:19.783799 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe3b6e7-f94b-4fde-b002-ac1b617eb3f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4c2f67efef144f6a5028946bb3fd1d2, user_id=4f4eedbddefc46d79b9553ba1b5765ab, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:19.783799 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe3b6e7-f94b-4fde-b002-ac1b617eb3f5 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:19.786851 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f1e2b-4d36-42dd-8889-c20ed1d4b6f0 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:19.803053 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f1fcbb-8b26-4289-a938-c824c2493824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:19.805828 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1fcbb-8b26-4289-a938-c824c2493824 admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:19.805963 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1fcbb-8b26-4289-a938-c824c2493824 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:19.807779 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1fcbb-8b26-4289-a938-c824c2493824 admin admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:19.812643 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 861/1724] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:58:19 2022] PUT /identity/v3/projects/a4c2f67efef144f6a5028946bb3fd1d2/users/4f4eedbddefc46d79b9553ba1b5765ab/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:19.827686 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e440154-950c-4722-bc78-6dea0c9441a4 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:19.827969 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e440154-950c-4722-bc78-6dea0c9441a4 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:19.828759 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e440154-950c-4722-bc78-6dea0c9441a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:19.831309 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f1fcbb-8b26-4289-a938-c824c2493824 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:19.840332 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f1fcbb-8b26-4289-a938-c824c2493824 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:19.891828 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-7e440154-950c-4722-bc78-6dea0c9441a4 None None] MFA Rules not processed for user `4f4eedbddefc46d79b9553ba1b5765ab`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:19.893063 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-7e440154-950c-4722-bc78-6dea0c9441a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:20.005785 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 864/1725] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 19:58:19 2022] POST /identity/v3/projects => generated 387 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:58:20.012103 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf4bc0-9d88-4cfe-9dcb-faefa8380d49 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:20.012508 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf4bc0-9d88-4cfe-9dcb-faefa8380d49 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:20.013816 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf4bc0-9d88-4cfe-9dcb-faefa8380d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:20.053693 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 862/1726] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:19 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:20.054907 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e440154-950c-4722-bc78-6dea0c9441a4 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:20.108181 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-accf4bc0-9d88-4cfe-9dcb-faefa8380d49 None None] MFA Rules not processed for user `014e32daafa540af92a906b9c2028db4`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:20.109576 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-accf4bc0-9d88-4cfe-9dcb-faefa8380d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:20.267751 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 865/1727] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:20.271583 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf4bc0-9d88-4cfe-9dcb-faefa8380d49 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:20.282007 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-accf4bc0-9d88-4cfe-9dcb-faefa8380d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:20.289867 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e440154-950c-4722-bc78-6dea0c9441a4 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:20.432564 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf4bc0-9d88-4cfe-9dcb-faefa8380d49 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:20.441957 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a25586-7d4d-4bc2-a180-bfcb68473413 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:20.442586 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a25586-7d4d-4bc2-a180-bfcb68473413 service cinder] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:20.442867 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a25586-7d4d-4bc2-a180-bfcb68473413 service cinder] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:20.443144 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a25586-7d4d-4bc2-a180-bfcb68473413 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:20.459684 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a6fdfe-3fdf-4d7d-85e4-a233bfb0f611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:20.459787 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6fdfe-3fdf-4d7d-85e4-a233bfb0f611 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:20.463850 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6fdfe-3fdf-4d7d-85e4-a233bfb0f611 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:20.465016 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6fdfe-3fdf-4d7d-85e4-a233bfb0f611 admin admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:20.469357 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a6fdfe-3fdf-4d7d-85e4-a233bfb0f611 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:20.473549 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a6fdfe-3fdf-4d7d-85e4-a233bfb0f611 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:20.596408 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a25586-7d4d-4bc2-a180-bfcb68473413 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:20.601637 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a25586-7d4d-4bc2-a180-bfcb68473413 service cinder] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:20.620534 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 866/1728] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:58:20 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:58:20.621760 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a25586-7d4d-4bc2-a180-bfcb68473413 service cinder] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:20.636179 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 863/1729] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:58:20 2022] POST /identity/v3/users => generated 294 bytes in 578 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:58:20.636179 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9321fb1-b1d2-4523-825c-4230087aa0f6 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:20.636179 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9321fb1-b1d2-4523-825c-4230087aa0f6 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:20.636179 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9321fb1-b1d2-4523-825c-4230087aa0f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:20.649127 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-02a25586-7d4d-4bc2-a180-bfcb68473413 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:20.727704 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a25586-7d4d-4bc2-a180-bfcb68473413 service cinder] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:20.750239 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-d9321fb1-b1d2-4523-825c-4230087aa0f6 None None] MFA Rules not processed for user `014e32daafa540af92a906b9c2028db4`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:20.752087 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-d9321fb1-b1d2-4523-825c-4230087aa0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:20.753262 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf5b2c0-2e74-464d-93f3-87605eb8b3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:20.754535 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5b2c0-2e74-464d-93f3-87605eb8b3f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:20.755035 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5b2c0-2e74-464d-93f3-87605eb8b3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:20.759083 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5b2c0-2e74-464d-93f3-87605eb8b3f2 admin admin] PATH_INFO: `/v3/projects/ecc2c27b688343738ce01c149d070388` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:20.766720 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf5b2c0-2e74-464d-93f3-87605eb8b3f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecc2c27b688343738ce01c149d070388)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:20.770355 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf5b2c0-2e74-464d-93f3-87605eb8b3f2 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:20.797958 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 864/1730] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:20.799054 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9321fb1-b1d2-4523-825c-4230087aa0f6 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:20.827255 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9321fb1-b1d2-4523-825c-4230087aa0f6 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:20.837688 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e143f9-38a9-4882-b538-93e862c399e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:20.838320 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e143f9-38a9-4882-b538-93e862c399e4 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:20.841145 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:20.849752 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e143f9-38a9-4882-b538-93e862c399e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:20.851546 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e143f9-38a9-4882-b538-93e862c399e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:20.857923 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e143f9-38a9-4882-b538-93e862c399e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:20.872126 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e143f9-38a9-4882-b538-93e862c399e4 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:20.892984 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 865/1731] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:58:20.894272 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e143f9-38a9-4882-b538-93e862c399e4 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:20.903837 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-e5e143f9-38a9-4882-b538-93e862c399e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:20.984059 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-bcf5b2c0-2e74-464d-93f3-87605eb8b3f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecc2c27b688343738ce01c149d070388', 'request_id': 'req-bcf5b2c0-2e74-464d-93f3-87605eb8b3f2'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:21.127583 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e143f9-38a9-4882-b538-93e862c399e4 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:21.142912 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-bcf5b2c0-2e74-464d-93f3-87605eb8b3f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecc2c27b688343738ce01c149d070388', 'request_id': 'req-bcf5b2c0-2e74-464d-93f3-87605eb8b3f2'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:21.149387 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-bcf5b2c0-2e74-464d-93f3-87605eb8b3f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecc2c27b688343738ce01c149d070388', 'request_id': 'req-bcf5b2c0-2e74-464d-93f3-87605eb8b3f2'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:21.191753 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-bcf5b2c0-2e74-464d-93f3-87605eb8b3f2 admin admin] The token cache is being invalidate because project ecc2c27b688343738ce01c149d070388 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 19:58:21.192051 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-bcf5b2c0-2e74-464d-93f3-87605eb8b3f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:21.193385 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-bcf5b2c0-2e74-464d-93f3-87605eb8b3f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:21.197828 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 867/1732] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 19:58:20 2022] DELETE /identity/v3/projects/ecc2c27b688343738ce01c149d070388 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:21.197828 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf5b2c0-2e74-464d-93f3-87605eb8b3f2 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:21.209909 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-bcf5b2c0-2e74-464d-93f3-87605eb8b3f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:21.330677 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a2f115-b3b4-4401-af57-dd78754f32af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5047a59bc4547be643ffa78808a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:21.331309 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2f115-b3b4-4401-af57-dd78754f32af service nova] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:21.331587 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2f115-b3b4-4401-af57-dd78754f32af service nova] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:21.332022 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2f115-b3b4-4401-af57-dd78754f32af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:21.334113 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-35a2f115-b3b4-4401-af57-dd78754f32af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:21.455602 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf5b2c0-2e74-464d-93f3-87605eb8b3f2 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:21.470840 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45757715-7be4-4e20-ad49-5e2eac00e631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:21.471884 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45757715-7be4-4e20-ad49-5e2eac00e631 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:21.472364 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45757715-7be4-4e20-ad49-5e2eac00e631 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:21.472777 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45757715-7be4-4e20-ad49-5e2eac00e631 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:21.473817 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45757715-7be4-4e20-ad49-5e2eac00e631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:21.477407 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45757715-7be4-4e20-ad49-5e2eac00e631 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:21.499590 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a2f115-b3b4-4401-af57-dd78754f32af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:21.499590 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a2f115-b3b4-4401-af57-dd78754f32af service nova] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:21.520028 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 868/1733] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:58:21.522370 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45757715-7be4-4e20-ad49-5e2eac00e631 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:21.530606 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-45757715-7be4-4e20-ad49-5e2eac00e631 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:21.541078 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 866/1734] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:58:20 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 647 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:58:21.543889 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a2f115-b3b4-4401-af57-dd78754f32af service nova] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:21.553243 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-35a2f115-b3b4-4401-af57-dd78754f32af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:21.614892 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a2f115-b3b4-4401-af57-dd78754f32af service nova] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:21.642352 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75093fc-18bb-47d7-a774-1e30b1487006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:21.643019 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75093fc-18bb-47d7-a774-1e30b1487006 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:21.643337 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75093fc-18bb-47d7-a774-1e30b1487006 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:21.643611 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75093fc-18bb-47d7-a774-1e30b1487006 admin admin] PATH_INFO: `/v3/users/48d3cb593b3e4a159b9c37f8efe130fd` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:21.654457 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75093fc-18bb-47d7-a774-1e30b1487006 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48d3cb593b3e4a159b9c37f8efe130fd)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:21.659854 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75093fc-18bb-47d7-a774-1e30b1487006 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:21.763369 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45757715-7be4-4e20-ad49-5e2eac00e631 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:21.773634 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2026b408-7c08-4036-a2b4-88d78ac4b41d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:21.774608 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026b408-7c08-4036-a2b4-88d78ac4b41d service cinder] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:21.775034 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026b408-7c08-4036-a2b4-88d78ac4b41d service cinder] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:21.777366 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026b408-7c08-4036-a2b4-88d78ac4b41d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:21.783372 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-2026b408-7c08-4036-a2b4-88d78ac4b41d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:21.941658 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2026b408-7c08-4036-a2b4-88d78ac4b41d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:21.943120 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2026b408-7c08-4036-a2b4-88d78ac4b41d service cinder] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:21.966262 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 869/1735] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:58:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:58:21.980671 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2026b408-7c08-4036-a2b4-88d78ac4b41d service cinder] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:21.997849 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-f75093fc-18bb-47d7-a774-1e30b1487006 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48d3cb593b3e4a159b9c37f8efe130fd'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:22.033252 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2026b408-7c08-4036-a2b4-88d78ac4b41d service cinder] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:22.048303 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf269c5-526c-425d-8276-f8022a2b1c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:22.049101 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf269c5-526c-425d-8276-f8022a2b1c14 admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:22.049521 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf269c5-526c-425d-8276-f8022a2b1c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:22.061921 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf269c5-526c-425d-8276-f8022a2b1c14 admin admin] PATH_INFO: `/v3/projects/4b7f236525004499ab97f9f58876bda1/users/69db61e1dfd04dc6b63c619cbeae6d2f/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:22.085970 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf269c5-526c-425d-8276-f8022a2b1c14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b7f236525004499ab97f9f58876bda1, user_id=69db61e1dfd04dc6b63c619cbeae6d2f, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:22.089023 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf269c5-526c-425d-8276-f8022a2b1c14 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:22.195827 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-f75093fc-18bb-47d7-a774-1e30b1487006 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48d3cb593b3e4a159b9c37f8efe130fd'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:22.196574 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-f75093fc-18bb-47d7-a774-1e30b1487006 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48d3cb593b3e4a159b9c37f8efe130fd'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:22.197283 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-f75093fc-18bb-47d7-a774-1e30b1487006 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48d3cb593b3e4a159b9c37f8efe130fd'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:22.220211 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-f75093fc-18bb-47d7-a774-1e30b1487006 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48d3cb593b3e4a159b9c37f8efe130fd'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:22.244736 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 867/1736] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 19:58:21 2022] DELETE /identity/v3/users/48d3cb593b3e4a159b9c37f8efe130fd => generated 0 bytes in 703 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:22.287061 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 870/1737] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:58:21 2022] PUT /identity/v3/projects/4b7f236525004499ab97f9f58876bda1/users/69db61e1dfd04dc6b63c619cbeae6d2f/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:22.298316 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16522d53-993f-4b02-9893-c6a0b7b30580 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:22.299021 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16522d53-993f-4b02-9893-c6a0b7b30580 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:22.299449 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16522d53-993f-4b02-9893-c6a0b7b30580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:22.320755 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:22.406935 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-16522d53-993f-4b02-9893-c6a0b7b30580 None None] MFA Rules not processed for user `69db61e1dfd04dc6b63c619cbeae6d2f`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:22.408201 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-16522d53-993f-4b02-9893-c6a0b7b30580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:22.434161 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26926842-3b19-46b4-a516-7fe788b710a0 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:22.434697 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26926842-3b19-46b4-a516-7fe788b710a0 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:22.435187 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26926842-3b19-46b4-a516-7fe788b710a0 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:22.436915 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 871/1738] 10.222.0.60 () {54 vars in 912 bytes} [Sat Sep 24 19:58:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:58:22.453283 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101461e-45a3-4bba-b814-5d1ed791b7c2 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:22.453283 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101461e-45a3-4bba-b814-5d1ed791b7c2 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:22.453283 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101461e-45a3-4bba-b814-5d1ed791b7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:22.487614 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-8101461e-45a3-4bba-b814-5d1ed791b7c2 None None] MFA Rules not processed for user `fed7dee25fd54255ad24cd6ad880fa3f`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:22.490082 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-8101461e-45a3-4bba-b814-5d1ed791b7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:22.702214 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 872/1739] 10.222.0.60 () {58 vars in 1009 bytes} [Sat Sep 24 19:58:22 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:58:22.723812 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8101461e-45a3-4bba-b814-5d1ed791b7c2 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:22.726371 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-8101461e-45a3-4bba-b814-5d1ed791b7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:22.745098 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 868/1740] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:22 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 448 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:22.747079 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16522d53-993f-4b02-9893-c6a0b7b30580 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:22.758932 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-16522d53-993f-4b02-9893-c6a0b7b30580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:22.771059 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8101461e-45a3-4bba-b814-5d1ed791b7c2 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:22.797077 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d5a5db-d2cb-4ff8-9496-ecdefa8fc839 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:22.797077 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5a5db-d2cb-4ff8-9496-ecdefa8fc839 service neutron] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:22.797077 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5a5db-d2cb-4ff8-9496-ecdefa8fc839 service neutron] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:22.797420 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5a5db-d2cb-4ff8-9496-ecdefa8fc839 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:22.830944 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d5a5db-d2cb-4ff8-9496-ecdefa8fc839 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:22.842935 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d5a5db-d2cb-4ff8-9496-ecdefa8fc839 service neutron] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:22.890976 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 873/1741] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:58:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:58:22.963682 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16522d53-993f-4b02-9893-c6a0b7b30580 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:22.966098 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2a2b2c-deb2-4a40-ad96-ca088a98b34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:22.967003 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a2b2c-deb2-4a40-ad96-ca088a98b34c admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:22.967556 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a2b2c-deb2-4a40-ad96-ca088a98b34c admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:22.968040 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a2b2c-deb2-4a40-ad96-ca088a98b34c admin admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:22.968904 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2a2b2c-deb2-4a40-ad96-ca088a98b34c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:22.971269 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2a2b2c-deb2-4a40-ad96-ca088a98b34c admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:23.000894 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d5a5db-d2cb-4ff8-9496-ecdefa8fc839 service neutron] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:23.003870 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-98d5a5db-d2cb-4ff8-9496-ecdefa8fc839 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:23.041078 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d5a5db-d2cb-4ff8-9496-ecdefa8fc839 service neutron] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:23.049879 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc4132d-110f-4789-a14b-14675dac2b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:23.051484 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4132d-110f-4789-a14b-14675dac2b49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:23.051901 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4132d-110f-4789-a14b-14675dac2b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:23.052317 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4132d-110f-4789-a14b-14675dac2b49 admin admin] PATH_INFO: `/v3/projects/46abfd7500214f3dbc33ea4e670b6c2f` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:23.054463 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc4132d-110f-4789-a14b-14675dac2b49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46abfd7500214f3dbc33ea4e670b6c2f)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:23.056791 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc4132d-110f-4789-a14b-14675dac2b49 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:23.144351 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 869/1742] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 19:58:22 2022] POST /identity/v3/projects => generated 385 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:58:23.150746 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2a2b2c-deb2-4a40-ad96-ca088a98b34c admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:23.266423 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-7fc4132d-110f-4789-a14b-14675dac2b49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46abfd7500214f3dbc33ea4e670b6c2f', 'request_id': 'req-7fc4132d-110f-4789-a14b-14675dac2b49'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:23.267782 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2a2b2c-deb2-4a40-ad96-ca088a98b34c admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:23.369132 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eafc738-5911-4daf-b0bc-58bd2015fc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:23.370474 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eafc738-5911-4daf-b0bc-58bd2015fc62 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:23.370939 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eafc738-5911-4daf-b0bc-58bd2015fc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:23.371361 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eafc738-5911-4daf-b0bc-58bd2015fc62 admin admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:23.372390 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eafc738-5911-4daf-b0bc-58bd2015fc62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:23.374607 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eafc738-5911-4daf-b0bc-58bd2015fc62 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:23.388737 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-7fc4132d-110f-4789-a14b-14675dac2b49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46abfd7500214f3dbc33ea4e670b6c2f', 'request_id': 'req-7fc4132d-110f-4789-a14b-14675dac2b49'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:23.413237 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-7fc4132d-110f-4789-a14b-14675dac2b49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46abfd7500214f3dbc33ea4e670b6c2f', 'request_id': 'req-7fc4132d-110f-4789-a14b-14675dac2b49'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:23.455758 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-7fc4132d-110f-4789-a14b-14675dac2b49 admin admin] The token cache is being invalidate because project 46abfd7500214f3dbc33ea4e670b6c2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 19:58:23.455965 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-7fc4132d-110f-4789-a14b-14675dac2b49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:23.456602 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-7fc4132d-110f-4789-a14b-14675dac2b49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:23.458484 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 874/1743] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 19:58:22 2022] DELETE /identity/v3/projects/46abfd7500214f3dbc33ea4e670b6c2f => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:23.477977 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147127f5-efd8-4fa9-bae4-6a663fd4470d None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:23.477977 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147127f5-efd8-4fa9-bae4-6a663fd4470d None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:23.477977 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147127f5-efd8-4fa9-bae4-6a663fd4470d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:23.506093 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-147127f5-efd8-4fa9-bae4-6a663fd4470d None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:23.511805 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-147127f5-efd8-4fa9-bae4-6a663fd4470d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:23.542836 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 875/1744] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:23.542836 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b74fe1-f028-460f-9b6e-1502624ed5e8 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:23.542836 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b74fe1-f028-460f-9b6e-1502624ed5e8 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:23.542836 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b74fe1-f028-460f-9b6e-1502624ed5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:23.564101 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 870/1745] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:58:23 2022] POST /identity/v3/users => generated 299 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:58:23.567737 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e76d6-c840-4113-a13f-1bfac2e9daf8 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:23.570001 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e76d6-c840-4113-a13f-1bfac2e9daf8 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:23.570456 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e76d6-c840-4113-a13f-1bfac2e9daf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:23.581083 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-61b74fe1-f028-460f-9b6e-1502624ed5e8 None None] MFA Rules not processed for user `d2c1ded5aad545148d3e30f6ce994004`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:23.588099 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-61b74fe1-f028-460f-9b6e-1502624ed5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:23.643862 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-645e76d6-c840-4113-a13f-1bfac2e9daf8 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:23.650885 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-645e76d6-c840-4113-a13f-1bfac2e9daf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:23.677784 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 871/1746] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:23.678873 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e76d6-c840-4113-a13f-1bfac2e9daf8 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:23.685920 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-645e76d6-c840-4113-a13f-1bfac2e9daf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:23.714913 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e76d6-c840-4113-a13f-1bfac2e9daf8 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:23.727161 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7da224e-f9da-4ad9-8d7d-960db6be9b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:23.737468 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da224e-f9da-4ad9-8d7d-960db6be9b08 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:23.737468 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da224e-f9da-4ad9-8d7d-960db6be9b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:23.737468 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da224e-f9da-4ad9-8d7d-960db6be9b08 admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:23.737468 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7da224e-f9da-4ad9-8d7d-960db6be9b08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:23.737468 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7da224e-f9da-4ad9-8d7d-960db6be9b08 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:23.757391 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 872/1747] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:58:23 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:58:23.758547 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7da224e-f9da-4ad9-8d7d-960db6be9b08 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:23.774757 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7da224e-f9da-4ad9-8d7d-960db6be9b08 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:23.783626 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70379ee0-93fc-4da1-a865-ef2a0b52ba9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:23.784607 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70379ee0-93fc-4da1-a865-ef2a0b52ba9c admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:23.785084 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70379ee0-93fc-4da1-a865-ef2a0b52ba9c admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:23.785681 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70379ee0-93fc-4da1-a865-ef2a0b52ba9c admin admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:23.791399 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 876/1748] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:23.791399 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b74fe1-f028-460f-9b6e-1502624ed5e8 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:23.794519 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70379ee0-93fc-4da1-a865-ef2a0b52ba9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:58:23.795036 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70379ee0-93fc-4da1-a865-ef2a0b52ba9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:23.802332 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b74fe1-f028-460f-9b6e-1502624ed5e8 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:23.814715 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b35108-3dfd-42d5-b167-e5a7950b04c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:23.815649 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b35108-3dfd-42d5-b167-e5a7950b04c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:23.816231 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b35108-3dfd-42d5-b167-e5a7950b04c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:23.816690 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b35108-3dfd-42d5-b167-e5a7950b04c4 admin admin] PATH_INFO: `/v3/projects/1e84c48803614164aef3d52b00e179d9/users/2914caf88f94408c819220f0ea9adf10/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:23.840045 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:23.840201 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70379ee0-93fc-4da1-a865-ef2a0b52ba9c admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:23.848848 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b35108-3dfd-42d5-b167-e5a7950b04c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e84c48803614164aef3d52b00e179d9, user_id=2914caf88f94408c819220f0ea9adf10, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:23.854411 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b35108-3dfd-42d5-b167-e5a7950b04c4 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:23.890533 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 873/1749] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 19:58:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:58:23.892220 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70379ee0-93fc-4da1-a865-ef2a0b52ba9c admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:23.928964 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70379ee0-93fc-4da1-a865-ef2a0b52ba9c admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:23.951274 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a243d-a2ba-4cf4-9ef7-b84b58969bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:23.951740 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a243d-a2ba-4cf4-9ef7-b84b58969bdc admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:23.952019 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a243d-a2ba-4cf4-9ef7-b84b58969bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:23.952292 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a243d-a2ba-4cf4-9ef7-b84b58969bdc admin admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:23.954079 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154a243d-a2ba-4cf4-9ef7-b84b58969bdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:23.958221 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154a243d-a2ba-4cf4-9ef7-b84b58969bdc admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:23.978496 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 877/1750] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:58:23 2022] PUT /identity/v3/projects/1e84c48803614164aef3d52b00e179d9/users/2914caf88f94408c819220f0ea9adf10/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:23.983289 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b35108-3dfd-42d5-b167-e5a7950b04c4 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:24.124905 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 874/1751] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 19:58:23 2022] POST /identity/v3/projects => generated 365 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:58:24.133551 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a243d-a2ba-4cf4-9ef7-b84b58969bdc admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:24.283124 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b35108-3dfd-42d5-b167-e5a7950b04c4 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:24.426517 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a243d-a2ba-4cf4-9ef7-b84b58969bdc admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:24.441313 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd41358c-1d0b-44b8-ac7c-5a7341a59ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:24.441980 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41358c-1d0b-44b8-ac7c-5a7341a59ce6 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:24.442290 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41358c-1d0b-44b8-ac7c-5a7341a59ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:24.442668 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41358c-1d0b-44b8-ac7c-5a7341a59ce6 admin admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:24.443318 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd41358c-1d0b-44b8-ac7c-5a7341a59ce6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:24.445424 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd41358c-1d0b-44b8-ac7c-5a7341a59ce6 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:24.451558 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071451bc-4085-4ba2-80cb-38357a903d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:24.457560 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071451bc-4085-4ba2-80cb-38357a903d91 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:24.457560 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071451bc-4085-4ba2-80cb-38357a903d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:24.457560 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071451bc-4085-4ba2-80cb-38357a903d91 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:24.457560 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071451bc-4085-4ba2-80cb-38357a903d91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:24.460879 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071451bc-4085-4ba2-80cb-38357a903d91 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:24.493174 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 878/1752] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:58:23 2022] GET /identity/v3/roles => generated 1420 bytes in 508 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:58:24.495017 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071451bc-4085-4ba2-80cb-38357a903d91 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:24.540541 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071451bc-4085-4ba2-80cb-38357a903d91 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:24.563686 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a7b11-609f-4c98-bfde-9c7588ab6bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:24.563686 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a7b11-609f-4c98-bfde-9c7588ab6bf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:24.563686 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a7b11-609f-4c98-bfde-9c7588ab6bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:24.563686 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a7b11-609f-4c98-bfde-9c7588ab6bf8 admin admin] PATH_INFO: `/v3/projects/1e84c48803614164aef3d52b00e179d9/users/2914caf88f94408c819220f0ea9adf10/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:24.566222 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a7b11-609f-4c98-bfde-9c7588ab6bf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e84c48803614164aef3d52b00e179d9, user_id=2914caf88f94408c819220f0ea9adf10, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:24.568646 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a7b11-609f-4c98-bfde-9c7588ab6bf8 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:24.597530 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 879/1753] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:58:24 2022] PUT /identity/v3/projects/1e84c48803614164aef3d52b00e179d9/users/2914caf88f94408c819220f0ea9adf10/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:24.604426 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38ce57-7c0d-4799-bf9a-6cce1226b52f None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:24.605661 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38ce57-7c0d-4799-bf9a-6cce1226b52f None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:24.606180 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38ce57-7c0d-4799-bf9a-6cce1226b52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:24.622976 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 875/1754] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:58:24 2022] POST /identity/v3/users => generated 283 bytes in 490 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:58:24.627042 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd41358c-1d0b-44b8-ac7c-5a7341a59ce6 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:24.672424 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd41358c-1d0b-44b8-ac7c-5a7341a59ce6 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:24.681626 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-bc38ce57-7c0d-4799-bf9a-6cce1226b52f None None] MFA Rules not processed for user `2914caf88f94408c819220f0ea9adf10`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:24.685135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-bc38ce57-7c0d-4799-bf9a-6cce1226b52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:24.819698 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b37e7-8430-49ac-9ee9-2787fec65d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:24.820774 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b37e7-8430-49ac-9ee9-2787fec65d8d admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:24.821219 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b37e7-8430-49ac-9ee9-2787fec65d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:24.821777 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b37e7-8430-49ac-9ee9-2787fec65d8d admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:24.822657 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616b37e7-8430-49ac-9ee9-2787fec65d8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:24.825486 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616b37e7-8430-49ac-9ee9-2787fec65d8d admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:24.830296 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 880/1755] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:24 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:58:24.832001 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023f481-5004-40fe-81d1-11d2b790da3c None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:24.832281 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023f481-5004-40fe-81d1-11d2b790da3c None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:24.832691 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023f481-5004-40fe-81d1-11d2b790da3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:24.846475 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 876/1756] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:58:24.851297 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b37e7-8430-49ac-9ee9-2787fec65d8d admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:24.862971 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b37e7-8430-49ac-9ee9-2787fec65d8d admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:24.869152 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6534a3e8-87ec-4900-a481-bacbb26e3f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:24.869819 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534a3e8-87ec-4900-a481-bacbb26e3f41 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:24.870321 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534a3e8-87ec-4900-a481-bacbb26e3f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:24.870593 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534a3e8-87ec-4900-a481-bacbb26e3f41 admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:24.871521 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6534a3e8-87ec-4900-a481-bacbb26e3f41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:24.879955 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6534a3e8-87ec-4900-a481-bacbb26e3f41 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:24.894803 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-7023f481-5004-40fe-81d1-11d2b790da3c None None] MFA Rules not processed for user `fd597f74abdf49288ea0d92642c6a5a2`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:24.895220 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 877/1757] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 19:58:24.896651 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-7023f481-5004-40fe-81d1-11d2b790da3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:24.914938 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6534a3e8-87ec-4900-a481-bacbb26e3f41 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:24.924835 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6534a3e8-87ec-4900-a481-bacbb26e3f41 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:24.937276 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8665118c-9018-4636-8ee5-71ee411c4cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:24.937990 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665118c-9018-4636-8ee5-71ee411c4cbc admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:24.938457 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665118c-9018-4636-8ee5-71ee411c4cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:24.938907 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665118c-9018-4636-8ee5-71ee411c4cbc admin admin] PATH_INFO: `/v3/projects/47a7a28a65cb418a850b5192a1a3a43e/users/23d76c46a8d543c49518a995396f08c6/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:24.964555 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8665118c-9018-4636-8ee5-71ee411c4cbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=47a7a28a65cb418a850b5192a1a3a43e, user_id=23d76c46a8d543c49518a995396f08c6, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:24.969839 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8665118c-9018-4636-8ee5-71ee411c4cbc admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:25.062057 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 881/1758] 10.222.0.60 () {58 vars in 1009 bytes} [Sat Sep 24 19:58:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:25.062057 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023f481-5004-40fe-81d1-11d2b790da3c None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:25.062998 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-7023f481-5004-40fe-81d1-11d2b790da3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:25.103663 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 878/1759] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:58:24 2022] PUT /identity/v3/projects/47a7a28a65cb418a850b5192a1a3a43e/users/23d76c46a8d543c49518a995396f08c6/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:25.105666 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8665118c-9018-4636-8ee5-71ee411c4cbc admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:25.109410 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-8665118c-9018-4636-8ee5-71ee411c4cbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:25.195727 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8665118c-9018-4636-8ee5-71ee411c4cbc admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:25.202116 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8107232-cdae-45b3-81ac-40b935df0e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:25.204770 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8107232-cdae-45b3-81ac-40b935df0e6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:25.205239 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8107232-cdae-45b3-81ac-40b935df0e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:25.205520 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8107232-cdae-45b3-81ac-40b935df0e6a admin admin] PATH_INFO: `/v3/users/435278b22f004e6ba6302140bd944f69` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:25.206911 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8107232-cdae-45b3-81ac-40b935df0e6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=435278b22f004e6ba6302140bd944f69)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:25.210392 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8107232-cdae-45b3-81ac-40b935df0e6a admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:25.267975 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023f481-5004-40fe-81d1-11d2b790da3c None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:25.379344 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ca06d-5094-4425-ac56-41153824ded3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:25.380143 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ca06d-5094-4425-ac56-41153824ded3 service cinder] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:25.380823 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ca06d-5094-4425-ac56-41153824ded3 service cinder] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:25.381371 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ca06d-5094-4425-ac56-41153824ded3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:25.453033 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:25.499549 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-f8107232-cdae-45b3-81ac-40b935df0e6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '435278b22f004e6ba6302140bd944f69'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:25.530210 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370ca06d-5094-4425-ac56-41153824ded3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:25.530210 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370ca06d-5094-4425-ac56-41153824ded3 service cinder] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:25.546157 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 882/1760] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:58:25 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:58:25.547833 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ca06d-5094-4425-ac56-41153824ded3 service cinder] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:25.549883 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-370ca06d-5094-4425-ac56-41153824ded3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:25.574466 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ca06d-5094-4425-ac56-41153824ded3 service cinder] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:25.592249 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3cd9c8-67c1-4995-8711-ab57cd25835b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:25.594304 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3cd9c8-67c1-4995-8711-ab57cd25835b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:25.594304 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3cd9c8-67c1-4995-8711-ab57cd25835b admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:25.594304 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3cd9c8-67c1-4995-8711-ab57cd25835b admin admin] PATH_INFO: `/v3/users/5452a74785eb4748b508331ec3103890` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:25.601796 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3cd9c8-67c1-4995-8711-ab57cd25835b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5452a74785eb4748b508331ec3103890)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:25.603920 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3cd9c8-67c1-4995-8711-ab57cd25835b admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:25.610407 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-f8107232-cdae-45b3-81ac-40b935df0e6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '435278b22f004e6ba6302140bd944f69'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:25.612418 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-f8107232-cdae-45b3-81ac-40b935df0e6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '435278b22f004e6ba6302140bd944f69'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:25.613454 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-f8107232-cdae-45b3-81ac-40b935df0e6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '435278b22f004e6ba6302140bd944f69'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:25.636347 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-f8107232-cdae-45b3-81ac-40b935df0e6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '435278b22f004e6ba6302140bd944f69'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:25.649945 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 879/1761] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 19:58:25 2022] DELETE /identity/v3/users/435278b22f004e6ba6302140bd944f69 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:25.651364 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce9216-d645-41d7-815a-88562d6ba78a None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:25.651879 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce9216-d645-41d7-815a-88562d6ba78a None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:25.652554 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce9216-d645-41d7-815a-88562d6ba78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:25.692650 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-28ce9216-d645-41d7-815a-88562d6ba78a None None] MFA Rules not processed for user `23d76c46a8d543c49518a995396f08c6`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:25.695129 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-28ce9216-d645-41d7-815a-88562d6ba78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:25.786927 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 880/1762] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:25.788975 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce9216-d645-41d7-815a-88562d6ba78a None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:25.791342 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-28ce9216-d645-41d7-815a-88562d6ba78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:25.923160 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-8a3cd9c8-67c1-4995-8711-ab57cd25835b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5452a74785eb4748b508331ec3103890'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:25.961539 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce9216-d645-41d7-815a-88562d6ba78a None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:25.967973 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a70bb-0fb5-470f-8db2-80a78511d5c2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd94cd16acc45e6ac2997204297fb75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:25.968617 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a70bb-0fb5-470f-8db2-80a78511d5c2 service swift] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:25.968905 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a70bb-0fb5-470f-8db2-80a78511d5c2 service swift] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:25.969181 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a70bb-0fb5-470f-8db2-80a78511d5c2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:25.971336 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-5a4a70bb-0fb5-470f-8db2-80a78511d5c2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:26.044301 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a70bb-0fb5-470f-8db2-80a78511d5c2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:26.047996 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a70bb-0fb5-470f-8db2-80a78511d5c2 service swift] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:26.051893 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-8a3cd9c8-67c1-4995-8711-ab57cd25835b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5452a74785eb4748b508331ec3103890'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:26.052619 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-8a3cd9c8-67c1-4995-8711-ab57cd25835b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5452a74785eb4748b508331ec3103890'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:26.064306 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 881/1763] 10.222.0.60 () {60 vars in 1384 bytes} [Sat Sep 24 19:58:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 24 19:58:26.065632 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a70bb-0fb5-470f-8db2-80a78511d5c2 service swift] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:26.067279 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-5a4a70bb-0fb5-470f-8db2-80a78511d5c2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:26.098941 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-8a3cd9c8-67c1-4995-8711-ab57cd25835b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5452a74785eb4748b508331ec3103890'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:26.098941 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-8a3cd9c8-67c1-4995-8711-ab57cd25835b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5452a74785eb4748b508331ec3103890'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:26.193760 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 883/1764] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 19:58:25 2022] DELETE /identity/v3/users/5452a74785eb4748b508331ec3103890 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:26.202597 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b2683-b7e5-4cef-85dc-1562b48f9ab7 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:26.202981 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b2683-b7e5-4cef-85dc-1562b48f9ab7 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:26.205779 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b2683-b7e5-4cef-85dc-1562b48f9ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:26.289200 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-3e7b2683-b7e5-4cef-85dc-1562b48f9ab7 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:26.289200 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-3e7b2683-b7e5-4cef-85dc-1562b48f9ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:26.422059 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a70bb-0fb5-470f-8db2-80a78511d5c2 service swift] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:26.525178 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d1c9d2-c224-4f85-be2c-24a53e5459c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:26.527720 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1c9d2-c224-4f85-be2c-24a53e5459c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:26.528003 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1c9d2-c224-4f85-be2c-24a53e5459c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:26.528275 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1c9d2-c224-4f85-be2c-24a53e5459c1 admin admin] PATH_INFO: `/v3/users/69db61e1dfd04dc6b63c619cbeae6d2f` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:26.529110 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 884/1765] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:26.530276 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b2683-b7e5-4cef-85dc-1562b48f9ab7 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:26.543281 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-3e7b2683-b7e5-4cef-85dc-1562b48f9ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:26.547788 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d1c9d2-c224-4f85-be2c-24a53e5459c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69db61e1dfd04dc6b63c619cbeae6d2f)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:26.566898 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d1c9d2-c224-4f85-be2c-24a53e5459c1 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:26.579349 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b2683-b7e5-4cef-85dc-1562b48f9ab7 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:26.588026 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:26.599716 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da9c3f9-9704-4026-bacb-b422b48263bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:26.600881 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9c3f9-9704-4026-bacb-b422b48263bb admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:26.601175 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9c3f9-9704-4026-bacb-b422b48263bb admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:26.601758 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9c3f9-9704-4026-bacb-b422b48263bb admin admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:26.602435 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da9c3f9-9704-4026-bacb-b422b48263bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:26.606969 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da9c3f9-9704-4026-bacb-b422b48263bb admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:26.855824 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 885/1766] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 19:58:26 2022] POST /identity/v3/projects => generated 365 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:58:26.860576 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a404ada-375c-47b4-ade1-93d998219070 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:26.865812 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a404ada-375c-47b4-ade1-93d998219070 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:26.899457 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a404ada-375c-47b4-ade1-93d998219070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:26.900279 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-53d1c9d2-c224-4f85-be2c-24a53e5459c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69db61e1dfd04dc6b63c619cbeae6d2f'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:26.982211 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-9a404ada-375c-47b4-ade1-93d998219070 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:26.984043 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-9a404ada-375c-47b4-ade1-93d998219070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:27.049563 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-53d1c9d2-c224-4f85-be2c-24a53e5459c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69db61e1dfd04dc6b63c619cbeae6d2f'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:27.050485 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-53d1c9d2-c224-4f85-be2c-24a53e5459c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69db61e1dfd04dc6b63c619cbeae6d2f'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:27.051357 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-53d1c9d2-c224-4f85-be2c-24a53e5459c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69db61e1dfd04dc6b63c619cbeae6d2f'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:27.074496 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-53d1c9d2-c224-4f85-be2c-24a53e5459c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69db61e1dfd04dc6b63c619cbeae6d2f'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:27.097644 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:27.133876 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 882/1767] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 19:58:26 2022] DELETE /identity/v3/users/69db61e1dfd04dc6b63c619cbeae6d2f => generated 0 bytes in 1069 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:27.134374 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 886/1768] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:27.138287 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d82c4-c32d-4365-ab11-f4c6aa206c28 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:27.138822 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d82c4-c32d-4365-ab11-f4c6aa206c28 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:27.139519 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a404ada-375c-47b4-ade1-93d998219070 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:27.140537 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d82c4-c32d-4365-ab11-f4c6aa206c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:27.144549 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-9a404ada-375c-47b4-ade1-93d998219070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:27.227082 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-a67d82c4-c32d-4365-ab11-f4c6aa206c28 None None] MFA Rules not processed for user `fed7dee25fd54255ad24cd6ad880fa3f`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:27.228449 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-a67d82c4-c32d-4365-ab11-f4c6aa206c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:27.345116 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 883/1769] 10.222.0.33 () {58 vars in 1015 bytes} [Sat Sep 24 19:58:27 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:27.346177 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d82c4-c32d-4365-ab11-f4c6aa206c28 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:27.347859 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-a67d82c4-c32d-4365-ab11-f4c6aa206c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:27.373549 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a404ada-375c-47b4-ade1-93d998219070 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:27.380534 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed68d09-6d0b-415b-ad67-9ce30b47180b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:27.381420 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed68d09-6d0b-415b-ad67-9ce30b47180b service neutron] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:27.381811 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed68d09-6d0b-415b-ad67-9ce30b47180b service neutron] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:27.381985 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed68d09-6d0b-415b-ad67-9ce30b47180b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:27.388906 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-bed68d09-6d0b-415b-ad67-9ce30b47180b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:27.519024 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d82c4-c32d-4365-ab11-f4c6aa206c28 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:27.538222 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc5b63-e2b5-44a1-b21c-00e1399805fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:27.538901 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc5b63-e2b5-44a1-b21c-00e1399805fc admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:27.544367 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc5b63-e2b5-44a1-b21c-00e1399805fc admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:27.544367 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc5b63-e2b5-44a1-b21c-00e1399805fc admin admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:27.544367 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcc5b63-e2b5-44a1-b21c-00e1399805fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:27.544367 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcc5b63-e2b5-44a1-b21c-00e1399805fc admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:27.638897 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed68d09-6d0b-415b-ad67-9ce30b47180b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:27.643995 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed68d09-6d0b-415b-ad67-9ce30b47180b service neutron] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:27.676265 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 887/1770] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:58:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:58:27.677656 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d9e1b-2536-4375-89a6-76f820f439e5 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:27.677924 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d9e1b-2536-4375-89a6-76f820f439e5 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:27.678214 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d9e1b-2536-4375-89a6-76f820f439e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:27.720058 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 884/1771] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:58:27 2022] POST /identity/v3/users => generated 289 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:58:27.720058 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc5b63-e2b5-44a1-b21c-00e1399805fc admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:27.725044 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-2e5d9e1b-2536-4375-89a6-76f820f439e5 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:27.730966 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-2e5d9e1b-2536-4375-89a6-76f820f439e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:27.751209 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 888/1772] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:27.751905 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d9e1b-2536-4375-89a6-76f820f439e5 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:27.787511 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc5b63-e2b5-44a1-b21c-00e1399805fc admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:27.788446 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d9e1b-2536-4375-89a6-76f820f439e5 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:27.800165 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072875b5-c48d-4dd4-a15d-0d066f71efcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:27.810825 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5754529-5e9d-4070-853b-2ec2edf7f057 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:27.810825 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5754529-5e9d-4070-853b-2ec2edf7f057 service neutron] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:27.810825 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5754529-5e9d-4070-853b-2ec2edf7f057 service neutron] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:27.811155 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072875b5-c48d-4dd4-a15d-0d066f71efcf service neutron] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:27.811155 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072875b5-c48d-4dd4-a15d-0d066f71efcf service neutron] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:27.811155 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072875b5-c48d-4dd4-a15d-0d066f71efcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:27.811394 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5754529-5e9d-4070-853b-2ec2edf7f057 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:27.829640 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5754529-5e9d-4070-853b-2ec2edf7f057 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:27.834287 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5754529-5e9d-4070-853b-2ec2edf7f057 service neutron] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:27.841944 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072875b5-c48d-4dd4-a15d-0d066f71efcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:27.894348 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072875b5-c48d-4dd4-a15d-0d066f71efcf service neutron] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:27.894348 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 889/1773] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:58:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:58:27.894348 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072875b5-c48d-4dd4-a15d-0d066f71efcf service neutron] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:27.895195 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 885/1774] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:58:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:58:27.895195 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5754529-5e9d-4070-853b-2ec2edf7f057 service neutron] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:27.895940 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072875b5-c48d-4dd4-a15d-0d066f71efcf service neutron] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:27.897426 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28e56a0-5a76-4564-a9ad-8875c290cb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:27.898189 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e56a0-5a76-4564-a9ad-8875c290cb1b admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:27.898566 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e56a0-5a76-4564-a9ad-8875c290cb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:27.898930 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e56a0-5a76-4564-a9ad-8875c290cb1b admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:27.899683 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28e56a0-5a76-4564-a9ad-8875c290cb1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:27.902053 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28e56a0-5a76-4564-a9ad-8875c290cb1b admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:27.902233 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5754529-5e9d-4070-853b-2ec2edf7f057 service neutron] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:27.908988 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00001b00-01b6-4a59-ac7e-899ec327b204 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:27.911452 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00001b00-01b6-4a59-ac7e-899ec327b204 service neutron] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:27.911816 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00001b00-01b6-4a59-ac7e-899ec327b204 service neutron] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:27.912095 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00001b00-01b6-4a59-ac7e-899ec327b204 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:27.917784 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 890/1775] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:58:27.938192 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28e56a0-5a76-4564-a9ad-8875c290cb1b admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:27.941173 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00001b00-01b6-4a59-ac7e-899ec327b204 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:27.943865 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00001b00-01b6-4a59-ac7e-899ec327b204 service neutron] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:27.972184 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28e56a0-5a76-4564-a9ad-8875c290cb1b admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:27.972694 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 886/1776] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:58:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:58:27.988248 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e5778e-52ed-4ed2-8d52-8cc7b4b154b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:27.991739 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5778e-52ed-4ed2-8d52-8cc7b4b154b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:27.992145 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5778e-52ed-4ed2-8d52-8cc7b4b154b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:27.992521 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5778e-52ed-4ed2-8d52-8cc7b4b154b4 admin admin] PATH_INFO: `/v3/projects/82e7519500804547ad785d618f3130ad/users/419e91ac1b854e49b997a86a2556896c/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:28.043714 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e5778e-52ed-4ed2-8d52-8cc7b4b154b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82e7519500804547ad785d618f3130ad, user_id=419e91ac1b854e49b997a86a2556896c, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:28.047099 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e5778e-52ed-4ed2-8d52-8cc7b4b154b4 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:28.281202 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 891/1777] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:58:27 2022] PUT /identity/v3/projects/82e7519500804547ad785d618f3130ad/users/419e91ac1b854e49b997a86a2556896c/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:28.285074 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00001b00-01b6-4a59-ac7e-899ec327b204 service neutron] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:28.304513 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00001b00-01b6-4a59-ac7e-899ec327b204 service neutron] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:28.484948 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8975c5e9-aa6a-4927-88cc-c9198193d59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:28.488149 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975c5e9-aa6a-4927-88cc-c9198193d59b admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:28.488435 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975c5e9-aa6a-4927-88cc-c9198193d59b admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:28.493217 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975c5e9-aa6a-4927-88cc-c9198193d59b admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:28.493217 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8975c5e9-aa6a-4927-88cc-c9198193d59b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:28.500192 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8975c5e9-aa6a-4927-88cc-c9198193d59b admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:28.532142 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 887/1778] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:58:28.534873 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e5778e-52ed-4ed2-8d52-8cc7b4b154b4 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:28.552224 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e5778e-52ed-4ed2-8d52-8cc7b4b154b4 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:28.564125 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea82ff77-955f-4b35-8286-0fef821e1a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:28.565120 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82ff77-955f-4b35-8286-0fef821e1a64 admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:28.565737 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82ff77-955f-4b35-8286-0fef821e1a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:28.565861 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82ff77-955f-4b35-8286-0fef821e1a64 admin admin] PATH_INFO: `/v3/projects/82e7519500804547ad785d618f3130ad/users/419e91ac1b854e49b997a86a2556896c/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:28.569547 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea82ff77-955f-4b35-8286-0fef821e1a64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82e7519500804547ad785d618f3130ad, user_id=419e91ac1b854e49b997a86a2556896c, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:28.579531 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea82ff77-955f-4b35-8286-0fef821e1a64 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:28.602841 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 892/1779] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:58:28 2022] PUT /identity/v3/projects/82e7519500804547ad785d618f3130ad/users/419e91ac1b854e49b997a86a2556896c/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:28.614240 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93989d71-44cc-4381-8dc5-31432e0dc66c None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:28.615421 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93989d71-44cc-4381-8dc5-31432e0dc66c None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:28.615884 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93989d71-44cc-4381-8dc5-31432e0dc66c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:28.749231 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-93989d71-44cc-4381-8dc5-31432e0dc66c None None] MFA Rules not processed for user `419e91ac1b854e49b997a86a2556896c`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:28.750956 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-93989d71-44cc-4381-8dc5-31432e0dc66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:28.992805 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:29.051116 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 888/1780] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:28 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 435 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:29.072707 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea82ff77-955f-4b35-8286-0fef821e1a64 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:29.075171 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-ea82ff77-955f-4b35-8286-0fef821e1a64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:29.285150 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea82ff77-955f-4b35-8286-0fef821e1a64 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:29.299123 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f9af8-a76a-4f56-b727-476ecacd816e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:29.302829 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f9af8-a76a-4f56-b727-476ecacd816e service cinder] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:29.302829 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f9af8-a76a-4f56-b727-476ecacd816e service cinder] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:29.302829 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f9af8-a76a-4f56-b727-476ecacd816e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:29.329532 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736f9af8-a76a-4f56-b727-476ecacd816e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:29.333314 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736f9af8-a76a-4f56-b727-476ecacd816e service cinder] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:29.364388 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 893/1781] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:58:29 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:58:29.550674 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93989d71-44cc-4381-8dc5-31432e0dc66c None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:29.552883 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-93989d71-44cc-4381-8dc5-31432e0dc66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:29.793264 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93989d71-44cc-4381-8dc5-31432e0dc66c None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:29.803700 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267eac06-f8da-486a-b835-8ed7d3379e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:29.804789 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267eac06-f8da-486a-b835-8ed7d3379e60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:29.805434 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267eac06-f8da-486a-b835-8ed7d3379e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:29.805934 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267eac06-f8da-486a-b835-8ed7d3379e60 admin admin] PATH_INFO: `/v3/projects/06ebf172ab0f49ba9ec8050dd0c70499` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:29.807334 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267eac06-f8da-486a-b835-8ed7d3379e60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06ebf172ab0f49ba9ec8050dd0c70499)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:29.812107 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267eac06-f8da-486a-b835-8ed7d3379e60 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:29.883706 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f9af8-a76a-4f56-b727-476ecacd816e service cinder] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:29.886141 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-736f9af8-a76a-4f56-b727-476ecacd816e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:29.918792 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f9af8-a76a-4f56-b727-476ecacd816e service cinder] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:29.929898 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e83122-a522-4080-bd0b-08fc950f8d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:29.930799 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e83122-a522-4080-bd0b-08fc950f8d4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:29.931247 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e83122-a522-4080-bd0b-08fc950f8d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:29.931956 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e83122-a522-4080-bd0b-08fc950f8d4b admin admin] PATH_INFO: `/v3/projects/4b7f236525004499ab97f9f58876bda1` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:29.946052 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e83122-a522-4080-bd0b-08fc950f8d4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b7f236525004499ab97f9f58876bda1)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:29.946187 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e83122-a522-4080-bd0b-08fc950f8d4b admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:30.040047 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-267eac06-f8da-486a-b835-8ed7d3379e60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06ebf172ab0f49ba9ec8050dd0c70499', 'request_id': 'req-267eac06-f8da-486a-b835-8ed7d3379e60'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:30.067006 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-267eac06-f8da-486a-b835-8ed7d3379e60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06ebf172ab0f49ba9ec8050dd0c70499', 'request_id': 'req-267eac06-f8da-486a-b835-8ed7d3379e60'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:30.190067 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-267eac06-f8da-486a-b835-8ed7d3379e60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06ebf172ab0f49ba9ec8050dd0c70499', 'request_id': 'req-267eac06-f8da-486a-b835-8ed7d3379e60'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:30.190398 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:30.190850 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-267eac06-f8da-486a-b835-8ed7d3379e60 admin admin] The token cache is being invalidate because project 06ebf172ab0f49ba9ec8050dd0c70499 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 19:58:30.190850 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-267eac06-f8da-486a-b835-8ed7d3379e60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:30.190850 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-267eac06-f8da-486a-b835-8ed7d3379e60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:30.207114 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 889/1782] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 19:58:29 2022] DELETE /identity/v3/projects/06ebf172ab0f49ba9ec8050dd0c70499 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:30.208461 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267eac06-f8da-486a-b835-8ed7d3379e60 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:30.219597 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-267eac06-f8da-486a-b835-8ed7d3379e60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:30.223982 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-12e83122-a522-4080-bd0b-08fc950f8d4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b7f236525004499ab97f9f58876bda1', 'request_id': 'req-12e83122-a522-4080-bd0b-08fc950f8d4b'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:30.320818 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-12e83122-a522-4080-bd0b-08fc950f8d4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b7f236525004499ab97f9f58876bda1', 'request_id': 'req-12e83122-a522-4080-bd0b-08fc950f8d4b'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:30.323308 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-12e83122-a522-4080-bd0b-08fc950f8d4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b7f236525004499ab97f9f58876bda1', 'request_id': 'req-12e83122-a522-4080-bd0b-08fc950f8d4b'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:30.349001 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-12e83122-a522-4080-bd0b-08fc950f8d4b admin admin] The token cache is being invalidate because project 4b7f236525004499ab97f9f58876bda1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 19:58:30.349302 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-12e83122-a522-4080-bd0b-08fc950f8d4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:30.356131 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-12e83122-a522-4080-bd0b-08fc950f8d4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:30.361465 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 894/1783] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 19:58:29 2022] DELETE /identity/v3/projects/4b7f236525004499ab97f9f58876bda1 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:30.366073 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e83122-a522-4080-bd0b-08fc950f8d4b admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:30.368153 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-12e83122-a522-4080-bd0b-08fc950f8d4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:30.422280 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267eac06-f8da-486a-b835-8ed7d3379e60 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:30.481245 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e83122-a522-4080-bd0b-08fc950f8d4b admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:30.495989 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a8eb51-c4f4-4a06-9106-019f498094fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:30.495989 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8eb51-c4f4-4a06-9106-019f498094fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:30.495989 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8eb51-c4f4-4a06-9106-019f498094fc admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:30.495989 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8eb51-c4f4-4a06-9106-019f498094fc admin admin] PATH_INFO: `/v3/users/2914caf88f94408c819220f0ea9adf10` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:30.496288 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a8eb51-c4f4-4a06-9106-019f498094fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2914caf88f94408c819220f0ea9adf10)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:30.500229 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a8eb51-c4f4-4a06-9106-019f498094fc admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:30.605554 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db2ff0-2875-4017-8d20-d5dc1982fba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:30.605554 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db2ff0-2875-4017-8d20-d5dc1982fba4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:30.605554 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db2ff0-2875-4017-8d20-d5dc1982fba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:30.605554 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db2ff0-2875-4017-8d20-d5dc1982fba4 admin admin] PATH_INFO: `/v3/users/fc035dd3aa0649648947a70449d85542` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:30.619335 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9db2ff0-2875-4017-8d20-d5dc1982fba4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc035dd3aa0649648947a70449d85542)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:30.627729 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9db2ff0-2875-4017-8d20-d5dc1982fba4 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:30.795551 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-a9a8eb51-c4f4-4a06-9106-019f498094fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2914caf88f94408c819220f0ea9adf10'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:30.822638 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:30.909168 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-a9a8eb51-c4f4-4a06-9106-019f498094fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2914caf88f94408c819220f0ea9adf10'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:30.909886 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-a9a8eb51-c4f4-4a06-9106-019f498094fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2914caf88f94408c819220f0ea9adf10'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:30.936375 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-f9db2ff0-2875-4017-8d20-d5dc1982fba4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc035dd3aa0649648947a70449d85542'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:30.937371 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-a9a8eb51-c4f4-4a06-9106-019f498094fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2914caf88f94408c819220f0ea9adf10'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:30.939166 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-a9a8eb51-c4f4-4a06-9106-019f498094fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2914caf88f94408c819220f0ea9adf10'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:30.976481 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 895/1784] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 19:58:30 2022] DELETE /identity/v3/users/2914caf88f94408c819220f0ea9adf10 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 19:58:30.977436 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a8eb51-c4f4-4a06-9106-019f498094fc admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:30.978934 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-a9a8eb51-c4f4-4a06-9106-019f498094fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:31.070681 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-f9db2ff0-2875-4017-8d20-d5dc1982fba4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc035dd3aa0649648947a70449d85542'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:31.082895 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-f9db2ff0-2875-4017-8d20-d5dc1982fba4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc035dd3aa0649648947a70449d85542'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:31.082895 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-f9db2ff0-2875-4017-8d20-d5dc1982fba4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc035dd3aa0649648947a70449d85542'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:31.107474 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-f9db2ff0-2875-4017-8d20-d5dc1982fba4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc035dd3aa0649648947a70449d85542'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:31.130502 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a8eb51-c4f4-4a06-9106-019f498094fc admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:31.138076 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 890/1785] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 19:58:30 2022] DELETE /identity/v3/users/fc035dd3aa0649648947a70449d85542 => generated 0 bytes in 928 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:31.139117 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db2ff0-2875-4017-8d20-d5dc1982fba4 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:31.139234 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74195ad-d8b9-4041-9950-745f734f62c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:31.140037 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74195ad-d8b9-4041-9950-745f734f62c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:31.140278 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74195ad-d8b9-4041-9950-745f734f62c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:31.140550 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74195ad-d8b9-4041-9950-745f734f62c8 admin admin] PATH_INFO: `/v3/projects/b3eb9533b0074c75840484d37676fef4` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:31.141305 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-f9db2ff0-2875-4017-8d20-d5dc1982fba4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:31.141971 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74195ad-d8b9-4041-9950-745f734f62c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3eb9533b0074c75840484d37676fef4)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:31.144083 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74195ad-d8b9-4041-9950-745f734f62c8 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:31.263279 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db2ff0-2875-4017-8d20-d5dc1982fba4 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:31.284383 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-b74195ad-d8b9-4041-9950-745f734f62c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3eb9533b0074c75840484d37676fef4', 'request_id': 'req-b74195ad-d8b9-4041-9950-745f734f62c8'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:31.360624 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-b74195ad-d8b9-4041-9950-745f734f62c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3eb9533b0074c75840484d37676fef4', 'request_id': 'req-b74195ad-d8b9-4041-9950-745f734f62c8'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:31.376202 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-b74195ad-d8b9-4041-9950-745f734f62c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3eb9533b0074c75840484d37676fef4', 'request_id': 'req-b74195ad-d8b9-4041-9950-745f734f62c8'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:31.395619 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41282bc7-18b6-4e09-9f23-096a6eebdca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:31.401203 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41282bc7-18b6-4e09-9f23-096a6eebdca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:31.401203 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41282bc7-18b6-4e09-9f23-096a6eebdca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:31.401203 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41282bc7-18b6-4e09-9f23-096a6eebdca5 admin admin] PATH_INFO: `/v3/users/23d76c46a8d543c49518a995396f08c6` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:31.401203 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41282bc7-18b6-4e09-9f23-096a6eebdca5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23d76c46a8d543c49518a995396f08c6)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:31.403758 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41282bc7-18b6-4e09-9f23-096a6eebdca5 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:31.410502 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-b74195ad-d8b9-4041-9950-745f734f62c8 admin admin] The token cache is being invalidate because project b3eb9533b0074c75840484d37676fef4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 19:58:31.411020 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-b74195ad-d8b9-4041-9950-745f734f62c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:31.412013 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-b74195ad-d8b9-4041-9950-745f734f62c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:31.415027 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 896/1786] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 19:58:30 2022] DELETE /identity/v3/projects/b3eb9533b0074c75840484d37676fef4 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:31.420285 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74195ad-d8b9-4041-9950-745f734f62c8 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:31.422146 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-b74195ad-d8b9-4041-9950-745f734f62c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:31.459266 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74195ad-d8b9-4041-9950-745f734f62c8 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:31.472872 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54859175-1fb3-4b20-b431-a14e541fc117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:31.483211 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54859175-1fb3-4b20-b431-a14e541fc117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:31.484815 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54859175-1fb3-4b20-b431-a14e541fc117 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:31.485235 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54859175-1fb3-4b20-b431-a14e541fc117 admin admin] PATH_INFO: `/v3/users/00e49640f0f64c3895ad6ed362b30fef` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:31.489644 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54859175-1fb3-4b20-b431-a14e541fc117 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00e49640f0f64c3895ad6ed362b30fef)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:31.498516 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54859175-1fb3-4b20-b431-a14e541fc117 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:31.713316 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-41282bc7-18b6-4e09-9f23-096a6eebdca5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23d76c46a8d543c49518a995396f08c6'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:31.806433 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-54859175-1fb3-4b20-b431-a14e541fc117 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00e49640f0f64c3895ad6ed362b30fef'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:31.817588 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-41282bc7-18b6-4e09-9f23-096a6eebdca5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23d76c46a8d543c49518a995396f08c6'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:31.819620 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-41282bc7-18b6-4e09-9f23-096a6eebdca5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23d76c46a8d543c49518a995396f08c6'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:31.820099 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-41282bc7-18b6-4e09-9f23-096a6eebdca5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23d76c46a8d543c49518a995396f08c6'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:31.858813 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-41282bc7-18b6-4e09-9f23-096a6eebdca5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23d76c46a8d543c49518a995396f08c6'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:31.915044 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-54859175-1fb3-4b20-b431-a14e541fc117 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00e49640f0f64c3895ad6ed362b30fef'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:31.919814 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-54859175-1fb3-4b20-b431-a14e541fc117 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00e49640f0f64c3895ad6ed362b30fef'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:31.966937 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 891/1787] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 19:58:31 2022] DELETE /identity/v3/users/23d76c46a8d543c49518a995396f08c6 => generated 0 bytes in 824 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:31.970775 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-54859175-1fb3-4b20-b431-a14e541fc117 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00e49640f0f64c3895ad6ed362b30fef'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:31.971958 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d302e-b1cc-4606-8f45-9b0859c1e2d1 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:31.973575 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-54859175-1fb3-4b20-b431-a14e541fc117 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00e49640f0f64c3895ad6ed362b30fef'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:31.974106 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d302e-b1cc-4606-8f45-9b0859c1e2d1 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:31.975408 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d302e-b1cc-4606-8f45-9b0859c1e2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:32.003510 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 897/1788] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 19:58:31 2022] DELETE /identity/v3/users/00e49640f0f64c3895ad6ed362b30fef => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:32.045216 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-6d7d302e-b1cc-4606-8f45-9b0859c1e2d1 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:32.052190 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-6d7d302e-b1cc-4606-8f45-9b0859c1e2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:32.234222 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 892/1789] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:32.248747 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54859175-1fb3-4b20-b431-a14e541fc117 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:32.250228 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-54859175-1fb3-4b20-b431-a14e541fc117 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:32.333511 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54859175-1fb3-4b20-b431-a14e541fc117 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:32.340380 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c3b7d-9f73-416a-95b4-881f04ee1b57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:32.341514 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c3b7d-9f73-416a-95b4-881f04ee1b57 service neutron] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:32.341956 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c3b7d-9f73-416a-95b4-881f04ee1b57 service neutron] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:32.343025 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c3b7d-9f73-416a-95b4-881f04ee1b57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:32.360200 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5c3b7d-9f73-416a-95b4-881f04ee1b57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:32.375626 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5c3b7d-9f73-416a-95b4-881f04ee1b57 service neutron] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:32.391010 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 898/1790] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:58:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:58:32.466212 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e7fe9-ee3d-4bfc-a15b-e91d48dc7fd4 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:32.466611 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e7fe9-ee3d-4bfc-a15b-e91d48dc7fd4 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:32.472818 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e7fe9-ee3d-4bfc-a15b-e91d48dc7fd4 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:32.472818 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 893/1791] 10.222.0.60 () {54 vars in 921 bytes} [Sat Sep 24 19:58:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:58:32.499024 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e3f5b-b8cd-407b-b92c-0f28cc4909b5 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:32.499229 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e3f5b-b8cd-407b-b92c-0f28cc4909b5 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:32.499505 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e3f5b-b8cd-407b-b92c-0f28cc4909b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:32.543993 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-9d0e3f5b-b8cd-407b-b92c-0f28cc4909b5 None None] MFA Rules not processed for user `f3b5047a59bc4547be643ffa78808a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:32.543993 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-9d0e3f5b-b8cd-407b-b92c-0f28cc4909b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:32.712290 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 899/1792] 10.222.0.60 () {58 vars in 1018 bytes} [Sat Sep 24 19:58:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:32.847106 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e7fe9-ee3d-4bfc-a15b-e91d48dc7fd4 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:32.851506 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-9d9e7fe9-ee3d-4bfc-a15b-e91d48dc7fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:32.890573 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:32.909794 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e7fe9-ee3d-4bfc-a15b-e91d48dc7fd4 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:32.931823 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e5784-6dee-49a7-9d21-1af457f9d9a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5047a59bc4547be643ffa78808a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:32.933005 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e5784-6dee-49a7-9d21-1af457f9d9a6 service nova] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:32.939993 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e5784-6dee-49a7-9d21-1af457f9d9a6 service nova] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:32.943098 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e5784-6dee-49a7-9d21-1af457f9d9a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:32.974562 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81e5784-6dee-49a7-9d21-1af457f9d9a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:32.983553 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81e5784-6dee-49a7-9d21-1af457f9d9a6 service nova] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:33.053237 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 894/1793] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:58:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:58:33.113162 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:33.228381 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e3f5b-b8cd-407b-b92c-0f28cc4909b5 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:33.231973 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-9d0e3f5b-b8cd-407b-b92c-0f28cc4909b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:33.285669 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e3f5b-b8cd-407b-b92c-0f28cc4909b5 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:33.297779 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e79b6ac-4ad7-4370-92de-75984fc5b66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:33.298591 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79b6ac-4ad7-4370-92de-75984fc5b66f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:33.299063 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79b6ac-4ad7-4370-92de-75984fc5b66f admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:33.299349 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79b6ac-4ad7-4370-92de-75984fc5b66f admin admin] PATH_INFO: `/v3/projects/1e84c48803614164aef3d52b00e179d9` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:33.308167 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e79b6ac-4ad7-4370-92de-75984fc5b66f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e84c48803614164aef3d52b00e179d9)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:33.314365 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e79b6ac-4ad7-4370-92de-75984fc5b66f admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:33.333400 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b60bd-c39d-4b79-96d6-4008f91bea15 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:33.333668 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b60bd-c39d-4b79-96d6-4008f91bea15 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:33.334630 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b60bd-c39d-4b79-96d6-4008f91bea15 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:33.336106 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 895/1794] 10.222.0.60 () {54 vars in 921 bytes} [Sat Sep 24 19:58:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:58:33.367615 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6147f9f8-9752-4711-95a4-bf819e072e46 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:33.367615 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6147f9f8-9752-4711-95a4-bf819e072e46 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:33.367615 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6147f9f8-9752-4711-95a4-bf819e072e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:33.429993 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-6147f9f8-9752-4711-95a4-bf819e072e46 None None] MFA Rules not processed for user `f3b5047a59bc4547be643ffa78808a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:33.431983 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-6147f9f8-9752-4711-95a4-bf819e072e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:33.484242 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 896/1795] 10.222.0.60 () {58 vars in 1018 bytes} [Sat Sep 24 19:58:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:58:33.566235 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-0e79b6ac-4ad7-4370-92de-75984fc5b66f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e84c48803614164aef3d52b00e179d9', 'request_id': 'req-0e79b6ac-4ad7-4370-92de-75984fc5b66f'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:33.618134 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6147f9f8-9752-4711-95a4-bf819e072e46 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:33.618134 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-6147f9f8-9752-4711-95a4-bf819e072e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:33.641131 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6147f9f8-9752-4711-95a4-bf819e072e46 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:33.691319 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-0e79b6ac-4ad7-4370-92de-75984fc5b66f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e84c48803614164aef3d52b00e179d9', 'request_id': 'req-0e79b6ac-4ad7-4370-92de-75984fc5b66f'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:33.707203 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-0e79b6ac-4ad7-4370-92de-75984fc5b66f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e84c48803614164aef3d52b00e179d9', 'request_id': 'req-0e79b6ac-4ad7-4370-92de-75984fc5b66f'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:33.743347 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-0e79b6ac-4ad7-4370-92de-75984fc5b66f admin admin] The token cache is being invalidate because project 1e84c48803614164aef3d52b00e179d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 19:58:33.743642 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-0e79b6ac-4ad7-4370-92de-75984fc5b66f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:33.751167 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-0e79b6ac-4ad7-4370-92de-75984fc5b66f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:33.753167 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 900/1796] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 19:58:33 2022] DELETE /identity/v3/projects/1e84c48803614164aef3d52b00e179d9 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:33.757260 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e79b6ac-4ad7-4370-92de-75984fc5b66f admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:33.758804 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-0e79b6ac-4ad7-4370-92de-75984fc5b66f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:33.850613 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a784c3-b55a-4e44-9c7f-5398dc55a3c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5047a59bc4547be643ffa78808a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:33.852749 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a784c3-b55a-4e44-9c7f-5398dc55a3c2 service nova] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:33.853625 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a784c3-b55a-4e44-9c7f-5398dc55a3c2 service nova] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:33.858036 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a784c3-b55a-4e44-9c7f-5398dc55a3c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:33.866822 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-85a784c3-b55a-4e44-9c7f-5398dc55a3c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:33.898230 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a784c3-b55a-4e44-9c7f-5398dc55a3c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:33.902304 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a784c3-b55a-4e44-9c7f-5398dc55a3c2 service nova] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:33.905838 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e79b6ac-4ad7-4370-92de-75984fc5b66f admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:33.910967 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b541ab9-8708-481c-9d59-876985efe978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:33.911618 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b541ab9-8708-481c-9d59-876985efe978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:33.912108 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b541ab9-8708-481c-9d59-876985efe978 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:33.912313 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b541ab9-8708-481c-9d59-876985efe978 admin admin] PATH_INFO: `/v3/projects/85811082ae414b738321e989978e940f` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:33.918931 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b541ab9-8708-481c-9d59-876985efe978 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85811082ae414b738321e989978e940f)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:33.918931 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b541ab9-8708-481c-9d59-876985efe978 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:33.942410 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 897/1797] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:58:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 19:58:33.943921 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce407438-a603-4026-8ded-ac2ad427946f None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:33.944378 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce407438-a603-4026-8ded-ac2ad427946f None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:33.944810 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce407438-a603-4026-8ded-ac2ad427946f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:34.019189 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-ce407438-a603-4026-8ded-ac2ad427946f None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:34.019189 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-ce407438-a603-4026-8ded-ac2ad427946f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:34.053680 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 898/1798] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:34.056067 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce6a35-3ae1-4eff-b79d-1599272c1f52 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:34.056312 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce6a35-3ae1-4eff-b79d-1599272c1f52 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:34.056641 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce6a35-3ae1-4eff-b79d-1599272c1f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:34.133327 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-9b541ab9-8708-481c-9d59-876985efe978 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85811082ae414b738321e989978e940f', 'request_id': 'req-9b541ab9-8708-481c-9d59-876985efe978'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:34.157902 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-e9ce6a35-3ae1-4eff-b79d-1599272c1f52 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:34.169165 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-e9ce6a35-3ae1-4eff-b79d-1599272c1f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:34.216785 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-9b541ab9-8708-481c-9d59-876985efe978 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85811082ae414b738321e989978e940f', 'request_id': 'req-9b541ab9-8708-481c-9d59-876985efe978'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:34.223332 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-9b541ab9-8708-481c-9d59-876985efe978 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85811082ae414b738321e989978e940f', 'request_id': 'req-9b541ab9-8708-481c-9d59-876985efe978'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:34.270091 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-9b541ab9-8708-481c-9d59-876985efe978 admin admin] The token cache is being invalidate because project 85811082ae414b738321e989978e940f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 19:58:34.270386 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-9b541ab9-8708-481c-9d59-876985efe978 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:34.274795 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-9b541ab9-8708-481c-9d59-876985efe978 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:34.286298 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:34.286473 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 901/1799] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 19:58:33 2022] DELETE /identity/v3/projects/85811082ae414b738321e989978e940f => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:34.288437 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d0f5a-8d41-4663-bb76-6dc28b158ee9 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:34.293926 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d0f5a-8d41-4663-bb76-6dc28b158ee9 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:34.294512 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d0f5a-8d41-4663-bb76-6dc28b158ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:34.340707 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 899/1800] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:58:34.344462 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce6a35-3ae1-4eff-b79d-1599272c1f52 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:34.360441 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce6a35-3ae1-4eff-b79d-1599272c1f52 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:34.363886 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-408d0f5a-8d41-4663-bb76-6dc28b158ee9 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:34.365333 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-408d0f5a-8d41-4663-bb76-6dc28b158ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:34.382616 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52178461-cd24-41a8-b57f-230382d1766f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:34.383255 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52178461-cd24-41a8-b57f-230382d1766f admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:34.390828 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52178461-cd24-41a8-b57f-230382d1766f admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:34.390961 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 902/1801] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:34.391052 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52178461-cd24-41a8-b57f-230382d1766f admin admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:34.391052 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52178461-cd24-41a8-b57f-230382d1766f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:58:34.392559 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52178461-cd24-41a8-b57f-230382d1766f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:34.393081 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b686d40-fa88-496c-bcf8-023568cd27bb None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:34.393773 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b686d40-fa88-496c-bcf8-023568cd27bb None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:34.394295 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b686d40-fa88-496c-bcf8-023568cd27bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:34.394421 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52178461-cd24-41a8-b57f-230382d1766f admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:34.441525 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-3b686d40-fa88-496c-bcf8-023568cd27bb None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:34.445696 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-3b686d40-fa88-496c-bcf8-023568cd27bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:34.455076 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 900/1802] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 19:58:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:58:34.457024 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52178461-cd24-41a8-b57f-230382d1766f admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:34.474169 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 903/1803] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:34.487880 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b686d40-fa88-496c-bcf8-023568cd27bb None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:34.495511 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52178461-cd24-41a8-b57f-230382d1766f admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:34.517056 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd4e93-e7ce-4794-9ad8-ab20834af2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:34.517753 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd4e93-e7ce-4794-9ad8-ab20834af2ec admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:34.519786 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd4e93-e7ce-4794-9ad8-ab20834af2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:34.519786 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd4e93-e7ce-4794-9ad8-ab20834af2ec admin admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:34.519786 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd4e93-e7ce-4794-9ad8-ab20834af2ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:34.525987 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b686d40-fa88-496c-bcf8-023568cd27bb None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:34.535433 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd4e93-e7ce-4794-9ad8-ab20834af2ec admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:34.545481 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2cc5dd-6d24-4b98-871f-2b47112bdb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:34.546170 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2cc5dd-6d24-4b98-871f-2b47112bdb90 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:34.557584 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2cc5dd-6d24-4b98-871f-2b47112bdb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:34.557584 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2cc5dd-6d24-4b98-871f-2b47112bdb90 admin admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:34.557584 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2cc5dd-6d24-4b98-871f-2b47112bdb90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:58:34.557584 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2cc5dd-6d24-4b98-871f-2b47112bdb90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:34.557584 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2cc5dd-6d24-4b98-871f-2b47112bdb90 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:34.600449 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 904/1804] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 19:58:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:58:34.602089 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2cc5dd-6d24-4b98-871f-2b47112bdb90 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:34.604120 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-0a2cc5dd-6d24-4b98-871f-2b47112bdb90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:34.659297 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 901/1805] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 19:58:34 2022] POST /identity/v3/projects => generated 381 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:58:34.660381 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd4e93-e7ce-4794-9ad8-ab20834af2ec admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:34.664968 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2cc5dd-6d24-4b98-871f-2b47112bdb90 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:34.845436 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29acf75e-ca58-491e-8484-da6f3e213a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:34.846098 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29acf75e-ca58-491e-8484-da6f3e213a89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:34.846426 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29acf75e-ca58-491e-8484-da6f3e213a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:34.846897 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29acf75e-ca58-491e-8484-da6f3e213a89 admin admin] PATH_INFO: `/v3/projects/47a7a28a65cb418a850b5192a1a3a43e` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:34.850780 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29acf75e-ca58-491e-8484-da6f3e213a89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47a7a28a65cb418a850b5192a1a3a43e)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:34.852503 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29acf75e-ca58-491e-8484-da6f3e213a89 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:34.885898 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd4e93-e7ce-4794-9ad8-ab20834af2ec admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:34.901791 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747ad38-b1db-46ba-8ea7-e460a29b45f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:34.902626 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747ad38-b1db-46ba-8ea7-e460a29b45f5 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:34.902805 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747ad38-b1db-46ba-8ea7-e460a29b45f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:34.903270 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747ad38-b1db-46ba-8ea7-e460a29b45f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:34.904079 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6747ad38-b1db-46ba-8ea7-e460a29b45f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:34.907848 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6747ad38-b1db-46ba-8ea7-e460a29b45f5 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:35.094721 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-29acf75e-ca58-491e-8484-da6f3e213a89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47a7a28a65cb418a850b5192a1a3a43e', 'request_id': 'req-29acf75e-ca58-491e-8484-da6f3e213a89'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:35.118225 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 902/1806] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 19:58:34 2022] POST /identity/v3/projects => generated 365 bytes in 458 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:58:35.132024 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747ad38-b1db-46ba-8ea7-e460a29b45f5 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:35.154077 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-29acf75e-ca58-491e-8484-da6f3e213a89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47a7a28a65cb418a850b5192a1a3a43e', 'request_id': 'req-29acf75e-ca58-491e-8484-da6f3e213a89'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:35.161041 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-29acf75e-ca58-491e-8484-da6f3e213a89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47a7a28a65cb418a850b5192a1a3a43e', 'request_id': 'req-29acf75e-ca58-491e-8484-da6f3e213a89'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:35.178923 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-29acf75e-ca58-491e-8484-da6f3e213a89 admin admin] The token cache is being invalidate because project 47a7a28a65cb418a850b5192a1a3a43e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 19:58:35.179549 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-29acf75e-ca58-491e-8484-da6f3e213a89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:35.197958 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-29acf75e-ca58-491e-8484-da6f3e213a89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:35.208013 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 905/1807] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 19:58:34 2022] DELETE /identity/v3/projects/47a7a28a65cb418a850b5192a1a3a43e => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:35.211644 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29acf75e-ca58-491e-8484-da6f3e213a89 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:35.223640 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:35.223640 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-29acf75e-ca58-491e-8484-da6f3e213a89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:35.341777 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747ad38-b1db-46ba-8ea7-e460a29b45f5 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:35.356958 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41cddfc-e6ce-4d1c-a47d-b477d39f0355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:35.357996 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41cddfc-e6ce-4d1c-a47d-b477d39f0355 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:35.364470 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41cddfc-e6ce-4d1c-a47d-b477d39f0355 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:35.364924 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41cddfc-e6ce-4d1c-a47d-b477d39f0355 admin admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:35.365902 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41cddfc-e6ce-4d1c-a47d-b477d39f0355 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:35.374944 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41cddfc-e6ce-4d1c-a47d-b477d39f0355 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:35.410213 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29acf75e-ca58-491e-8484-da6f3e213a89 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:35.430389 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d266f76-d4aa-4fd3-853a-d561159b5a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:35.431554 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d266f76-d4aa-4fd3-853a-d561159b5a30 admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:35.433011 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d266f76-d4aa-4fd3-853a-d561159b5a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:35.433549 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d266f76-d4aa-4fd3-853a-d561159b5a30 admin admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:35.434502 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d266f76-d4aa-4fd3-853a-d561159b5a30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:35.436947 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d266f76-d4aa-4fd3-853a-d561159b5a30 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:35.530265 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 903/1808] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:58:35 2022] POST /identity/v3/users => generated 291 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:58:35.532460 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41cddfc-e6ce-4d1c-a47d-b477d39f0355 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:35.534159 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-c41cddfc-e6ce-4d1c-a47d-b477d39f0355 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:35.559510 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41cddfc-e6ce-4d1c-a47d-b477d39f0355 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:35.566351 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c7b18e-35cf-4753-96af-50e062e0b55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:35.567742 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7b18e-35cf-4753-96af-50e062e0b55e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:35.568064 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7b18e-35cf-4753-96af-50e062e0b55e admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:35.568360 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7b18e-35cf-4753-96af-50e062e0b55e admin admin] PATH_INFO: `/v3/users/419e91ac1b854e49b997a86a2556896c` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:35.569664 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c7b18e-35cf-4753-96af-50e062e0b55e admin admin] RBAC: Authorizing `identity:delete_user(user_id=419e91ac1b854e49b997a86a2556896c)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:35.571707 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c7b18e-35cf-4753-96af-50e062e0b55e admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:35.599812 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 906/1809] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:58:35 2022] POST /identity/v3/users => generated 283 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:58:35.599812 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d266f76-d4aa-4fd3-853a-d561159b5a30 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:35.602701 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-7d266f76-d4aa-4fd3-853a-d561159b5a30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:35.673343 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d266f76-d4aa-4fd3-853a-d561159b5a30 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:35.695514 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43633e5-9eb6-4652-81ea-f94feaaeee54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:35.696610 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43633e5-9eb6-4652-81ea-f94feaaeee54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:35.697048 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43633e5-9eb6-4652-81ea-f94feaaeee54 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:35.697592 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43633e5-9eb6-4652-81ea-f94feaaeee54 admin admin] PATH_INFO: `/v3/projects/d96e69ccc57b4d959502d2892c61dabd` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:35.700833 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43633e5-9eb6-4652-81ea-f94feaaeee54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d96e69ccc57b4d959502d2892c61dabd)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:35.703379 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43633e5-9eb6-4652-81ea-f94feaaeee54 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:35.893941 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:35.919594 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-87c7b18e-35cf-4753-96af-50e062e0b55e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '419e91ac1b854e49b997a86a2556896c'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:35.939037 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-d43633e5-9eb6-4652-81ea-f94feaaeee54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd96e69ccc57b4d959502d2892c61dabd', 'request_id': 'req-d43633e5-9eb6-4652-81ea-f94feaaeee54'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:36.020924 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-87c7b18e-35cf-4753-96af-50e062e0b55e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '419e91ac1b854e49b997a86a2556896c'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:36.021780 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-87c7b18e-35cf-4753-96af-50e062e0b55e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '419e91ac1b854e49b997a86a2556896c'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:36.022535 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-87c7b18e-35cf-4753-96af-50e062e0b55e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '419e91ac1b854e49b997a86a2556896c'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:36.038662 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-87c7b18e-35cf-4753-96af-50e062e0b55e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '419e91ac1b854e49b997a86a2556896c'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:36.084598 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-d43633e5-9eb6-4652-81ea-f94feaaeee54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd96e69ccc57b4d959502d2892c61dabd', 'request_id': 'req-d43633e5-9eb6-4652-81ea-f94feaaeee54'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:36.085451 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 904/1810] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 19:58:35 2022] DELETE /identity/v3/users/419e91ac1b854e49b997a86a2556896c => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:36.086995 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c7b18e-35cf-4753-96af-50e062e0b55e admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:36.090104 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-87c7b18e-35cf-4753-96af-50e062e0b55e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:36.095001 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-d43633e5-9eb6-4652-81ea-f94feaaeee54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd96e69ccc57b4d959502d2892c61dabd', 'request_id': 'req-d43633e5-9eb6-4652-81ea-f94feaaeee54'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:36.121637 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-d43633e5-9eb6-4652-81ea-f94feaaeee54 admin admin] The token cache is being invalidate because project d96e69ccc57b4d959502d2892c61dabd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 19:58:36.127534 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-d43633e5-9eb6-4652-81ea-f94feaaeee54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:36.127534 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-d43633e5-9eb6-4652-81ea-f94feaaeee54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:36.127534 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 907/1811] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 19:58:35 2022] DELETE /identity/v3/projects/d96e69ccc57b4d959502d2892c61dabd => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:36.127534 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43633e5-9eb6-4652-81ea-f94feaaeee54 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:36.128137 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-d43633e5-9eb6-4652-81ea-f94feaaeee54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:36.190197 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:36.220605 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43633e5-9eb6-4652-81ea-f94feaaeee54 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:36.317812 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c7b18e-35cf-4753-96af-50e062e0b55e admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:36.320095 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82710d-0dbc-4e05-8968-756ba0136171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:36.320977 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82710d-0dbc-4e05-8968-756ba0136171 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:36.322118 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82710d-0dbc-4e05-8968-756ba0136171 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:36.322766 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82710d-0dbc-4e05-8968-756ba0136171 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:36.324273 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae82710d-0dbc-4e05-8968-756ba0136171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:36.327356 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae82710d-0dbc-4e05-8968-756ba0136171 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:36.332190 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7013cb0f-4d32-470e-874f-fee6f641609e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:36.337896 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013cb0f-4d32-470e-874f-fee6f641609e admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:36.338857 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013cb0f-4d32-470e-874f-fee6f641609e admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:36.339400 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013cb0f-4d32-470e-874f-fee6f641609e admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:36.340134 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7013cb0f-4d32-470e-874f-fee6f641609e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:36.344967 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 908/1812] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:58:36.346564 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82710d-0dbc-4e05-8968-756ba0136171 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:36.350108 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-ae82710d-0dbc-4e05-8968-756ba0136171 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:36.350437 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7013cb0f-4d32-470e-874f-fee6f641609e admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:36.374581 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82710d-0dbc-4e05-8968-756ba0136171 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:36.384347 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea89cc-85cd-4449-b517-a4f414c7d078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:36.385253 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 905/1813] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:58:36.386134 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea89cc-85cd-4449-b517-a4f414c7d078 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:36.386241 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7013cb0f-4d32-470e-874f-fee6f641609e admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:36.388629 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea89cc-85cd-4449-b517-a4f414c7d078 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:36.389135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea89cc-85cd-4449-b517-a4f414c7d078 admin admin] PATH_INFO: `/v3/users/29368883db644cb69e9bcbfbafbe7e2c` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:36.390586 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea89cc-85cd-4449-b517-a4f414c7d078 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29368883db644cb69e9bcbfbafbe7e2c)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:36.394108 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea89cc-85cd-4449-b517-a4f414c7d078 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:36.424505 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7013cb0f-4d32-470e-874f-fee6f641609e admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:36.434947 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4222b-f018-4ff5-a049-fbe7e3987e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:36.436577 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4222b-f018-4ff5-a049-fbe7e3987e7c admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:36.437168 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4222b-f018-4ff5-a049-fbe7e3987e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:36.437881 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4222b-f018-4ff5-a049-fbe7e3987e7c admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:36.438903 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c4222b-f018-4ff5-a049-fbe7e3987e7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:36.442866 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c4222b-f018-4ff5-a049-fbe7e3987e7c admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:36.457401 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 906/1814] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:58:36.461376 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4222b-f018-4ff5-a049-fbe7e3987e7c admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:36.461863 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-d0c4222b-f018-4ff5-a049-fbe7e3987e7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:36.484671 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4222b-f018-4ff5-a049-fbe7e3987e7c admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:36.492132 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7beebd2-2ab1-47e0-880f-60c75fad9667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:36.493063 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7beebd2-2ab1-47e0-880f-60c75fad9667 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:36.493417 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7beebd2-2ab1-47e0-880f-60c75fad9667 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:36.495839 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7beebd2-2ab1-47e0-880f-60c75fad9667 admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:36.495839 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7beebd2-2ab1-47e0-880f-60c75fad9667 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:36.498181 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7beebd2-2ab1-47e0-880f-60c75fad9667 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:36.517032 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 907/1815] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:58:36.517032 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7beebd2-2ab1-47e0-880f-60c75fad9667 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:36.534083 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7beebd2-2ab1-47e0-880f-60c75fad9667 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:36.540999 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c302804-21ca-474c-91b7-87d623884201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:36.542733 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c302804-21ca-474c-91b7-87d623884201 admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:36.543171 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c302804-21ca-474c-91b7-87d623884201 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:36.543644 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c302804-21ca-474c-91b7-87d623884201 admin admin] PATH_INFO: `/v3/projects/49f27f9db5e1423ba947335100d4b811/users/bb6291fd49f54072920c608aa5ede0fb/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:36.573674 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c302804-21ca-474c-91b7-87d623884201 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49f27f9db5e1423ba947335100d4b811, user_id=bb6291fd49f54072920c608aa5ede0fb, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:36.578441 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c302804-21ca-474c-91b7-87d623884201 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:36.678928 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-3bea89cc-85cd-4449-b517-a4f414c7d078 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29368883db644cb69e9bcbfbafbe7e2c'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:36.737287 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 908/1816] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:58:36 2022] PUT /identity/v3/projects/49f27f9db5e1423ba947335100d4b811/users/bb6291fd49f54072920c608aa5ede0fb/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:36.738547 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c302804-21ca-474c-91b7-87d623884201 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:36.913422 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c302804-21ca-474c-91b7-87d623884201 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:36.927946 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb560dc-a7eb-4c4d-9ad4-9f6e60ad99bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:36.930858 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb560dc-a7eb-4c4d-9ad4-9f6e60ad99bb admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:36.931391 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb560dc-a7eb-4c4d-9ad4-9f6e60ad99bb admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:36.933137 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb560dc-a7eb-4c4d-9ad4-9f6e60ad99bb admin admin] PATH_INFO: `/v3/projects/cbbda6e0ad2a498db42af6ed93222671/users/1c03c8314efb4a29b3837298205ed643/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:36.995049 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb560dc-a7eb-4c4d-9ad4-9f6e60ad99bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbbda6e0ad2a498db42af6ed93222671, user_id=1c03c8314efb4a29b3837298205ed643, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:36.998632 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb560dc-a7eb-4c4d-9ad4-9f6e60ad99bb admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:37.445433 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-3bea89cc-85cd-4449-b517-a4f414c7d078 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29368883db644cb69e9bcbfbafbe7e2c'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:37.450955 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-3bea89cc-85cd-4449-b517-a4f414c7d078 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29368883db644cb69e9bcbfbafbe7e2c'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:37.484395 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-3bea89cc-85cd-4449-b517-a4f414c7d078 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29368883db644cb69e9bcbfbafbe7e2c'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:37.485326 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-3bea89cc-85cd-4449-b517-a4f414c7d078 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29368883db644cb69e9bcbfbafbe7e2c'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:37.503254 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 909/1817] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 19:58:36 2022] DELETE /identity/v3/users/29368883db644cb69e9bcbfbafbe7e2c => generated 0 bytes in 1157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:37.504656 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5774198f-7ec2-48e0-9157-0463ab58684d None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:37.505574 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5774198f-7ec2-48e0-9157-0463ab58684d None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:37.505734 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5774198f-7ec2-48e0-9157-0463ab58684d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:37.557686 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-5774198f-7ec2-48e0-9157-0463ab58684d None None] MFA Rules not processed for user `bb6291fd49f54072920c608aa5ede0fb`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:37.558949 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-5774198f-7ec2-48e0-9157-0463ab58684d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:37.705164 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 909/1818] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:58:36 2022] PUT /identity/v3/projects/cbbda6e0ad2a498db42af6ed93222671/users/1c03c8314efb4a29b3837298205ed643/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 957 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:37.708303 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2d309-f817-4531-8009-87ed4627895a None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:37.709064 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2d309-f817-4531-8009-87ed4627895a None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:37.709548 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2d309-f817-4531-8009-87ed4627895a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:37.750618 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-f1d2d309-f817-4531-8009-87ed4627895a None None] MFA Rules not processed for user `1c03c8314efb4a29b3837298205ed643`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:37.752346 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-f1d2d309-f817-4531-8009-87ed4627895a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:37.769439 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 910/1819] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:37.773964 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5774198f-7ec2-48e0-9157-0463ab58684d None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:37.775549 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-5774198f-7ec2-48e0-9157-0463ab58684d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:37.897578 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:37.902353 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 910/1820] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:37.907168 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d2d309-f817-4531-8009-87ed4627895a None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:37.919219 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-f1d2d309-f817-4531-8009-87ed4627895a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:37.961569 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5774198f-7ec2-48e0-9157-0463ab58684d None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:38.036804 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d2d309-f817-4531-8009-87ed4627895a None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:38.036804 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec7e987-0c9f-4d91-bfaf-ce6b0427f658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:38.036804 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7e987-0c9f-4d91-bfaf-ce6b0427f658 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:38.036804 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7e987-0c9f-4d91-bfaf-ce6b0427f658 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:38.037704 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7e987-0c9f-4d91-bfaf-ce6b0427f658 admin admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:38.037704 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec7e987-0c9f-4d91-bfaf-ce6b0427f658 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:38.041091 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec7e987-0c9f-4d91-bfaf-ce6b0427f658 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:38.078413 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab535d-a98f-4513-a92f-73341d2494a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:38.079203 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab535d-a98f-4513-a92f-73341d2494a2 admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:38.079722 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab535d-a98f-4513-a92f-73341d2494a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:38.080474 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab535d-a98f-4513-a92f-73341d2494a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:38.081219 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adab535d-a98f-4513-a92f-73341d2494a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:38.094473 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adab535d-a98f-4513-a92f-73341d2494a2 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:38.169367 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 911/1821] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 19:58:37 2022] POST /identity/v3/projects => generated 381 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 19:58:38.172279 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec7e987-0c9f-4d91-bfaf-ce6b0427f658 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:38.191993 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:38.201840 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 911/1822] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 19:58:37 2022] POST /identity/v3/projects => generated 367 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 19:58:38.208903 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab535d-a98f-4513-a92f-73341d2494a2 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:38.356719 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec7e987-0c9f-4d91-bfaf-ce6b0427f658 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:38.363161 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f434e4-7eb1-497c-bb29-631a225520eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:38.369081 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f434e4-7eb1-497c-bb29-631a225520eb admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:38.369081 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f434e4-7eb1-497c-bb29-631a225520eb admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:38.369081 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f434e4-7eb1-497c-bb29-631a225520eb admin admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:38.369081 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f434e4-7eb1-497c-bb29-631a225520eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:38.369810 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab535d-a98f-4513-a92f-73341d2494a2 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:38.376543 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be3d4c3-460f-419a-b76a-e3ad6b349117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:38.377898 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3d4c3-460f-419a-b76a-e3ad6b349117 admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:38.378191 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3d4c3-460f-419a-b76a-e3ad6b349117 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:38.379790 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3d4c3-460f-419a-b76a-e3ad6b349117 admin admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:38.380731 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be3d4c3-460f-419a-b76a-e3ad6b349117 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:38.383487 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be3d4c3-460f-419a-b76a-e3ad6b349117 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:38.391853 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f434e4-7eb1-497c-bb29-631a225520eb admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:38.493443 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 912/1823] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:58:38 2022] POST /identity/v3/users => generated 297 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:58:38.498039 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f434e4-7eb1-497c-bb29-631a225520eb admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:38.503626 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 912/1824] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:58:38 2022] POST /identity/v3/users => generated 290 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 19:58:38.508559 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be3d4c3-460f-419a-b76a-e3ad6b349117 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:38.532917 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be3d4c3-460f-419a-b76a-e3ad6b349117 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:38.533168 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f434e4-7eb1-497c-bb29-631a225520eb admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:38.543263 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0447e-0db6-4148-bbcf-efe1116f625b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:38.546181 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0447e-0db6-4148-bbcf-efe1116f625b admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:38.546181 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0447e-0db6-4148-bbcf-efe1116f625b admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:38.546181 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0447e-0db6-4148-bbcf-efe1116f625b admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:38.546181 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0447e-0db6-4148-bbcf-efe1116f625b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:38.546838 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0447e-0db6-4148-bbcf-efe1116f625b admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:38.551635 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f556805-896c-4033-a135-40d642f12d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:38.552697 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f556805-896c-4033-a135-40d642f12d83 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:38.553157 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f556805-896c-4033-a135-40d642f12d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:38.553633 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f556805-896c-4033-a135-40d642f12d83 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:38.554453 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f556805-896c-4033-a135-40d642f12d83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:38.556216 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f556805-896c-4033-a135-40d642f12d83 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:38.584528 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 913/1825] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:58:38 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 19:58:38.590280 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 913/1826] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:58:38 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 19:58:38.590979 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f556805-896c-4033-a135-40d642f12d83 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:38.594237 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0447e-0db6-4148-bbcf-efe1116f625b admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:38.608064 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f556805-896c-4033-a135-40d642f12d83 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:38.618473 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0447e-0db6-4148-bbcf-efe1116f625b admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:38.622309 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e2b08-9ac1-4232-8c93-3e70fb48a5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:38.625987 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e2b08-9ac1-4232-8c93-3e70fb48a5be admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:38.627139 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e2b08-9ac1-4232-8c93-3e70fb48a5be admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:38.627480 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e2b08-9ac1-4232-8c93-3e70fb48a5be admin admin] PATH_INFO: `/v3/projects/ed02534e46e5477e91f8c94ed04bb66b/users/e4b32b04609947fd9a3f0947bdc4b088/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:38.630554 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173044c-2f66-49bd-a981-47af7c5d9f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:38.632217 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173044c-2f66-49bd-a981-47af7c5d9f45 admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:38.632217 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173044c-2f66-49bd-a981-47af7c5d9f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:38.632217 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173044c-2f66-49bd-a981-47af7c5d9f45 admin admin] PATH_INFO: `/v3/projects/cab62efbad744992b7afe5170d9cd722/users/dee3f749a2134f58b198f0435ef11e0e/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:38.674665 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4173044c-2f66-49bd-a981-47af7c5d9f45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cab62efbad744992b7afe5170d9cd722, user_id=dee3f749a2134f58b198f0435ef11e0e, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:38.676578 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220e2b08-9ac1-4232-8c93-3e70fb48a5be admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed02534e46e5477e91f8c94ed04bb66b, user_id=e4b32b04609947fd9a3f0947bdc4b088, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:38.680992 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4173044c-2f66-49bd-a981-47af7c5d9f45 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:38.686326 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220e2b08-9ac1-4232-8c93-3e70fb48a5be admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:38.785396 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 914/1827] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:58:38 2022] PUT /identity/v3/projects/cab62efbad744992b7afe5170d9cd722/users/dee3f749a2134f58b198f0435ef11e0e/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:38.789609 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173044c-2f66-49bd-a981-47af7c5d9f45 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:38.824222 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 914/1828] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:58:38 2022] PUT /identity/v3/projects/ed02534e46e5477e91f8c94ed04bb66b/users/e4b32b04609947fd9a3f0947bdc4b088/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:38.826955 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e2b08-9ac1-4232-8c93-3e70fb48a5be admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:38.923683 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173044c-2f66-49bd-a981-47af7c5d9f45 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:39.015395 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e2b08-9ac1-4232-8c93-3e70fb48a5be admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:39.033130 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260adbb-52f8-4b51-921c-9792310156f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:39.036262 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260adbb-52f8-4b51-921c-9792310156f9 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:39.049046 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1762403-c63e-4aaa-b7cf-79c980b50200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:39.052971 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1762403-c63e-4aaa-b7cf-79c980b50200 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:39.052971 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1762403-c63e-4aaa-b7cf-79c980b50200 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:39.052971 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1762403-c63e-4aaa-b7cf-79c980b50200 admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:39.053652 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260adbb-52f8-4b51-921c-9792310156f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:39.053836 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1762403-c63e-4aaa-b7cf-79c980b50200 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:39.053914 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260adbb-52f8-4b51-921c-9792310156f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:39.053983 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1762403-c63e-4aaa-b7cf-79c980b50200 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:39.054637 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5260adbb-52f8-4b51-921c-9792310156f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:39.058068 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5260adbb-52f8-4b51-921c-9792310156f9 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:39.071158 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 915/1829] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:58:38 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:58:39.073352 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260adbb-52f8-4b51-921c-9792310156f9 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:39.075695 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-5260adbb-52f8-4b51-921c-9792310156f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:39.083376 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 915/1830] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:58:38 2022] GET /identity/v3/roles => generated 1420 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:58:39.084565 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1762403-c63e-4aaa-b7cf-79c980b50200 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:39.095807 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260adbb-52f8-4b51-921c-9792310156f9 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:39.106895 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f27edce-5710-4b25-a587-258b8202dde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:39.108514 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27edce-5710-4b25-a587-258b8202dde1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:39.109192 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1762403-c63e-4aaa-b7cf-79c980b50200 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:39.110740 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27edce-5710-4b25-a587-258b8202dde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:39.111876 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27edce-5710-4b25-a587-258b8202dde1 admin admin] PATH_INFO: `/v3/projects/82e7519500804547ad785d618f3130ad` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:39.113468 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f27edce-5710-4b25-a587-258b8202dde1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82e7519500804547ad785d618f3130ad)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:39.116340 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f27edce-5710-4b25-a587-258b8202dde1 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:39.126678 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cac437-935b-4d8a-a23d-b90a5c4ab55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:39.126678 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cac437-935b-4d8a-a23d-b90a5c4ab55d admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:39.126678 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cac437-935b-4d8a-a23d-b90a5c4ab55d admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:39.126678 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cac437-935b-4d8a-a23d-b90a5c4ab55d admin admin] PATH_INFO: `/v3/projects/ed02534e46e5477e91f8c94ed04bb66b/users/e4b32b04609947fd9a3f0947bdc4b088/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:39.157542 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cac437-935b-4d8a-a23d-b90a5c4ab55d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed02534e46e5477e91f8c94ed04bb66b, user_id=e4b32b04609947fd9a3f0947bdc4b088, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:39.157542 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cac437-935b-4d8a-a23d-b90a5c4ab55d admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:39.170923 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 916/1831] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:58:39 2022] PUT /identity/v3/projects/ed02534e46e5477e91f8c94ed04bb66b/users/e4b32b04609947fd9a3f0947bdc4b088/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:39.171499 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cac437-935b-4d8a-a23d-b90a5c4ab55d admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:39.292291 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-3f27edce-5710-4b25-a587-258b8202dde1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82e7519500804547ad785d618f3130ad', 'request_id': 'req-3f27edce-5710-4b25-a587-258b8202dde1'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:39.331625 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cac437-935b-4d8a-a23d-b90a5c4ab55d admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:39.383094 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-3f27edce-5710-4b25-a587-258b8202dde1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82e7519500804547ad785d618f3130ad', 'request_id': 'req-3f27edce-5710-4b25-a587-258b8202dde1'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:39.397524 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-3f27edce-5710-4b25-a587-258b8202dde1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82e7519500804547ad785d618f3130ad', 'request_id': 'req-3f27edce-5710-4b25-a587-258b8202dde1'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:39.426618 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-3f27edce-5710-4b25-a587-258b8202dde1 admin admin] The token cache is being invalidate because project 82e7519500804547ad785d618f3130ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 19:58:39.433580 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-3f27edce-5710-4b25-a587-258b8202dde1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:39.433580 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-3f27edce-5710-4b25-a587-258b8202dde1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:39.433580 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 916/1832] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 19:58:39 2022] DELETE /identity/v3/projects/82e7519500804547ad785d618f3130ad => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:39.433580 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f27edce-5710-4b25-a587-258b8202dde1 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:39.433580 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-3f27edce-5710-4b25-a587-258b8202dde1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:39.436183 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde4319-6ed5-481b-bb37-1cbf4070569b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:39.436908 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde4319-6ed5-481b-bb37-1cbf4070569b admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:39.437188 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde4319-6ed5-481b-bb37-1cbf4070569b admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:39.437401 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde4319-6ed5-481b-bb37-1cbf4070569b admin admin] PATH_INFO: `/v3/projects/cab62efbad744992b7afe5170d9cd722/users/dee3f749a2134f58b198f0435ef11e0e/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:39.439516 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dde4319-6ed5-481b-bb37-1cbf4070569b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cab62efbad744992b7afe5170d9cd722, user_id=dee3f749a2134f58b198f0435ef11e0e, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:39.442236 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dde4319-6ed5-481b-bb37-1cbf4070569b admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:39.462135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f27edce-5710-4b25-a587-258b8202dde1 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:39.465535 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 917/1833] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:58:39 2022] PUT /identity/v3/projects/cab62efbad744992b7afe5170d9cd722/users/dee3f749a2134f58b198f0435ef11e0e/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:39.465535 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6700a-1219-44bd-94ce-bbbb46cfca97 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:39.465853 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6700a-1219-44bd-94ce-bbbb46cfca97 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:39.466091 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6700a-1219-44bd-94ce-bbbb46cfca97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:39.535361 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-c8f6700a-1219-44bd-94ce-bbbb46cfca97 None None] MFA Rules not processed for user `e4b32b04609947fd9a3f0947bdc4b088`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:39.537034 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-c8f6700a-1219-44bd-94ce-bbbb46cfca97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:39.558869 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5655f-20d4-44ea-9c01-0f2fffbb9e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:39.559553 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5655f-20d4-44ea-9c01-0f2fffbb9e89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:39.559955 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5655f-20d4-44ea-9c01-0f2fffbb9e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:39.560244 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5655f-20d4-44ea-9c01-0f2fffbb9e89 admin admin] PATH_INFO: `/v3/projects/b80df21c491349c9a230e63ddaea5859` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:39.561463 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb5655f-20d4-44ea-9c01-0f2fffbb9e89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b80df21c491349c9a230e63ddaea5859)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:39.563495 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb5655f-20d4-44ea-9c01-0f2fffbb9e89 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:39.623087 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 918/1834] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:39 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:39.624354 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1cb6a-0c21-4192-bcfd-0d31438786a7 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:39.624654 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1cb6a-0c21-4192-bcfd-0d31438786a7 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:39.625060 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1cb6a-0c21-4192-bcfd-0d31438786a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:39.659191 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-86c1cb6a-0c21-4192-bcfd-0d31438786a7 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:39.660615 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-86c1cb6a-0c21-4192-bcfd-0d31438786a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:39.676938 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 919/1835] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:39.679234 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d88c46-0b57-490f-a80f-48864dc408bb None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:39.679527 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d88c46-0b57-490f-a80f-48864dc408bb None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:39.679859 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d88c46-0b57-490f-a80f-48864dc408bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:39.700080 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-eeb5655f-20d4-44ea-9c01-0f2fffbb9e89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b80df21c491349c9a230e63ddaea5859', 'request_id': 'req-eeb5655f-20d4-44ea-9c01-0f2fffbb9e89'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:39.719042 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-18d88c46-0b57-490f-a80f-48864dc408bb None None] MFA Rules not processed for user `dee3f749a2134f58b198f0435ef11e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:39.720252 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-18d88c46-0b57-490f-a80f-48864dc408bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:39.774593 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-eeb5655f-20d4-44ea-9c01-0f2fffbb9e89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b80df21c491349c9a230e63ddaea5859', 'request_id': 'req-eeb5655f-20d4-44ea-9c01-0f2fffbb9e89'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:39.783437 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-eeb5655f-20d4-44ea-9c01-0f2fffbb9e89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b80df21c491349c9a230e63ddaea5859', 'request_id': 'req-eeb5655f-20d4-44ea-9c01-0f2fffbb9e89'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:39.804060 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-eeb5655f-20d4-44ea-9c01-0f2fffbb9e89 admin admin] The token cache is being invalidate because project b80df21c491349c9a230e63ddaea5859 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 19:58:39.804464 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-eeb5655f-20d4-44ea-9c01-0f2fffbb9e89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:39.805226 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-eeb5655f-20d4-44ea-9c01-0f2fffbb9e89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:39.807154 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 917/1836] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 19:58:39 2022] DELETE /identity/v3/projects/b80df21c491349c9a230e63ddaea5859 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:39.812159 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5655f-20d4-44ea-9c01-0f2fffbb9e89 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:39.812159 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-eeb5655f-20d4-44ea-9c01-0f2fffbb9e89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:39.824719 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 920/1837] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:39 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:39.826253 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90206079-a2cd-495a-adab-417556aa49bd None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:39.826546 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90206079-a2cd-495a-adab-417556aa49bd None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:39.826818 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90206079-a2cd-495a-adab-417556aa49bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:39.854236 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-90206079-a2cd-495a-adab-417556aa49bd None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:39.856043 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-90206079-a2cd-495a-adab-417556aa49bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:39.891480 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5655f-20d4-44ea-9c01-0f2fffbb9e89 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:39.896686 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f30df-c1f0-4d60-8fea-07636a43e579 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:39.897305 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f30df-c1f0-4d60-8fea-07636a43e579 service cinder] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:39.897620 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f30df-c1f0-4d60-8fea-07636a43e579 service cinder] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:39.897899 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f30df-c1f0-4d60-8fea-07636a43e579 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:39.899967 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-d05f30df-c1f0-4d60-8fea-07636a43e579 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:39.921463 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 921/1838] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:39.922916 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa850dd-6e5d-48b1-a945-9113d3d6db3a None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:39.923209 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa850dd-6e5d-48b1-a945-9113d3d6db3a None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:39.923482 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa850dd-6e5d-48b1-a945-9113d3d6db3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:39.945437 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-1aa850dd-6e5d-48b1-a945-9113d3d6db3a None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:39.946674 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-1aa850dd-6e5d-48b1-a945-9113d3d6db3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:39.956042 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 922/1839] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:39.956838 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa850dd-6e5d-48b1-a945-9113d3d6db3a None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:39.958110 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-1aa850dd-6e5d-48b1-a945-9113d3d6db3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:39.964947 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f30df-c1f0-4d60-8fea-07636a43e579 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:39.966397 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f30df-c1f0-4d60-8fea-07636a43e579 service cinder] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:39.970367 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa850dd-6e5d-48b1-a945-9113d3d6db3a None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:39.974339 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a30dc1a-64a4-4b2a-a2b5-8a1ba1f0df95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:39.975106 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30dc1a-64a4-4b2a-a2b5-8a1ba1f0df95 service cinder] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:39.975793 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 918/1840] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:58:39 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:58:39.976520 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:39.976648 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f30df-c1f0-4d60-8fea-07636a43e579 service cinder] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:39.976968 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30dc1a-64a4-4b2a-a2b5-8a1ba1f0df95 service cinder] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:39.977260 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30dc1a-64a4-4b2a-a2b5-8a1ba1f0df95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:39.979226 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-8a30dc1a-64a4-4b2a-a2b5-8a1ba1f0df95 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:39.986631 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f30df-c1f0-4d60-8fea-07636a43e579 service cinder] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:39.991398 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a30dc1a-64a4-4b2a-a2b5-8a1ba1f0df95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:39.992148 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e81ed-b12c-49a3-a067-b4cc3d6918c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:39.992813 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e81ed-b12c-49a3-a067-b4cc3d6918c2 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:39.992949 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a30dc1a-64a4-4b2a-a2b5-8a1ba1f0df95 service cinder] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:39.993209 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e81ed-b12c-49a3-a067-b4cc3d6918c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:39.993581 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e81ed-b12c-49a3-a067-b4cc3d6918c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:39.994942 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56e81ed-b12c-49a3-a067-b4cc3d6918c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:58:39.995318 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56e81ed-b12c-49a3-a067-b4cc3d6918c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:39.996946 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56e81ed-b12c-49a3-a067-b4cc3d6918c2 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:40.003998 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 923/1841] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:58:39 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:58:40.005391 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2477f0-54b0-442f-9a95-9d37d69ec1fe None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:40.012009 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2477f0-54b0-442f-9a95-9d37d69ec1fe None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:40.012009 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2477f0-54b0-442f-9a95-9d37d69ec1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:40.012419 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 919/1842] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 19:58:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:58:40.015729 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e81ed-b12c-49a3-a067-b4cc3d6918c2 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:40.028199 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e81ed-b12c-49a3-a067-b4cc3d6918c2 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:40.034445 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b335c2-7d6b-4945-b586-10ff7344daba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:40.035078 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b335c2-7d6b-4945-b586-10ff7344daba admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:40.035366 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b335c2-7d6b-4945-b586-10ff7344daba admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:40.035648 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b335c2-7d6b-4945-b586-10ff7344daba admin admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:40.036510 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b335c2-7d6b-4945-b586-10ff7344daba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:40.036877 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-ec2477f0-54b0-442f-9a95-9d37d69ec1fe None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:40.038325 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-ec2477f0-54b0-442f-9a95-9d37d69ec1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:40.038723 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b335c2-7d6b-4945-b586-10ff7344daba admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:40.047252 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 924/1843] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:40.054982 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2477f0-54b0-442f-9a95-9d37d69ec1fe None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:40.065211 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2477f0-54b0-442f-9a95-9d37d69ec1fe None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:40.069842 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a5afd5-346a-49e9-8c73-8ea8dc6fc3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:40.070448 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5afd5-346a-49e9-8c73-8ea8dc6fc3bb admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:40.070729 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5afd5-346a-49e9-8c73-8ea8dc6fc3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:40.071003 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5afd5-346a-49e9-8c73-8ea8dc6fc3bb admin admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:40.071717 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a5afd5-346a-49e9-8c73-8ea8dc6fc3bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:58:40.072025 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a5afd5-346a-49e9-8c73-8ea8dc6fc3bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:40.074686 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a5afd5-346a-49e9-8c73-8ea8dc6fc3bb admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:40.086605 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 925/1844] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 19:58:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:58:40.091453 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a5afd5-346a-49e9-8c73-8ea8dc6fc3bb admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:40.101007 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a5afd5-346a-49e9-8c73-8ea8dc6fc3bb admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:40.106276 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5f197-b281-4202-a540-080c293a329f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:40.106787 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5f197-b281-4202-a540-080c293a329f admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:40.107063 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5f197-b281-4202-a540-080c293a329f admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:40.107339 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5f197-b281-4202-a540-080c293a329f admin admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:40.107956 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a5f197-b281-4202-a540-080c293a329f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:40.109855 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a5f197-b281-4202-a540-080c293a329f admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:40.156374 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 920/1845] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 19:58:40 2022] POST /identity/v3/projects => generated 377 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:58:40.157948 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b335c2-7d6b-4945-b586-10ff7344daba admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:40.228497 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b335c2-7d6b-4945-b586-10ff7344daba admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:40.234162 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb13c15-e125-4cbe-85c7-73d5fc8b43e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:40.234774 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb13c15-e125-4cbe-85c7-73d5fc8b43e6 admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:40.235051 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb13c15-e125-4cbe-85c7-73d5fc8b43e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:40.235320 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb13c15-e125-4cbe-85c7-73d5fc8b43e6 admin admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:40.235950 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb13c15-e125-4cbe-85c7-73d5fc8b43e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:40.236979 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 926/1846] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 19:58:40 2022] POST /identity/v3/projects => generated 387 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 19:58:40.238192 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb13c15-e125-4cbe-85c7-73d5fc8b43e6 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:40.241346 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5f197-b281-4202-a540-080c293a329f admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:40.308214 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5f197-b281-4202-a540-080c293a329f admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:40.318390 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41cd39a-030d-43b2-b4f2-c53eea445f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:40.319022 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41cd39a-030d-43b2-b4f2-c53eea445f1f admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:40.319299 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41cd39a-030d-43b2-b4f2-c53eea445f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:40.319569 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41cd39a-030d-43b2-b4f2-c53eea445f1f admin admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:40.320202 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41cd39a-030d-43b2-b4f2-c53eea445f1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:40.322185 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41cd39a-030d-43b2-b4f2-c53eea445f1f admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:40.367561 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:40.376603 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 921/1847] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:58:40 2022] POST /identity/v3/users => generated 289 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:58:40.376603 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb13c15-e125-4cbe-85c7-73d5fc8b43e6 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:40.429949 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb13c15-e125-4cbe-85c7-73d5fc8b43e6 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:40.442904 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 927/1848] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:58:40 2022] POST /identity/v3/users => generated 294 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:58:40.442904 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41cd39a-030d-43b2-b4f2-c53eea445f1f admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:40.480309 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be11c9b-a521-475f-92c6-c473d0cedde9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:40.480929 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be11c9b-a521-475f-92c6-c473d0cedde9 service cinder] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:40.481209 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be11c9b-a521-475f-92c6-c473d0cedde9 service cinder] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:40.481481 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be11c9b-a521-475f-92c6-c473d0cedde9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:40.483294 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-4be11c9b-a521-475f-92c6-c473d0cedde9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:40.496964 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41cd39a-030d-43b2-b4f2-c53eea445f1f admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:40.500514 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53afff7-6c30-4184-a46f-44fa4d6d5221 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:40.501112 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53afff7-6c30-4184-a46f-44fa4d6d5221 service cinder] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:40.501383 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53afff7-6c30-4184-a46f-44fa4d6d5221 service cinder] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:40.501681 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53afff7-6c30-4184-a46f-44fa4d6d5221 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:40.503379 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-a53afff7-6c30-4184-a46f-44fa4d6d5221 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:40.542703 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be11c9b-a521-475f-92c6-c473d0cedde9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:40.544223 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be11c9b-a521-475f-92c6-c473d0cedde9 service cinder] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:40.553243 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 922/1849] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:58:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:58:40.554155 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be11c9b-a521-475f-92c6-c473d0cedde9 service cinder] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:40.565758 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be11c9b-a521-475f-92c6-c473d0cedde9 service cinder] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:40.565967 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53afff7-6c30-4184-a46f-44fa4d6d5221 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:40.567675 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53afff7-6c30-4184-a46f-44fa4d6d5221 service cinder] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:40.571951 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb1db11-c5bd-4f74-88d3-573d9b6bdc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:40.574449 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1db11-c5bd-4f74-88d3-573d9b6bdc52 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:40.574449 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1db11-c5bd-4f74-88d3-573d9b6bdc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:40.574449 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1db11-c5bd-4f74-88d3-573d9b6bdc52 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:40.574449 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb1db11-c5bd-4f74-88d3-573d9b6bdc52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:40.575770 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb1db11-c5bd-4f74-88d3-573d9b6bdc52 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:40.589803 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 923/1850] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:58:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:58:40.590720 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb1db11-c5bd-4f74-88d3-573d9b6bdc52 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:40.595121 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 928/1851] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:58:40 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:58:40.596136 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53afff7-6c30-4184-a46f-44fa4d6d5221 service cinder] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:40.602503 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb1db11-c5bd-4f74-88d3-573d9b6bdc52 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:40.608125 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f066525c-7d79-409c-acf6-d92b796c6f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:40.609000 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066525c-7d79-409c-acf6-d92b796c6f2f admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:40.609384 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066525c-7d79-409c-acf6-d92b796c6f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:40.609861 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066525c-7d79-409c-acf6-d92b796c6f2f admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:40.610639 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f066525c-7d79-409c-acf6-d92b796c6f2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:40.612629 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f066525c-7d79-409c-acf6-d92b796c6f2f admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:40.623484 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53afff7-6c30-4184-a46f-44fa4d6d5221 service cinder] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:40.626177 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 924/1852] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:58:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:58:40.630536 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f066525c-7d79-409c-acf6-d92b796c6f2f admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:40.641123 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f066525c-7d79-409c-acf6-d92b796c6f2f admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:40.641531 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d6c99-4c8a-483d-9a6d-ddca601f39e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:40.642418 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d6c99-4c8a-483d-9a6d-ddca601f39e5 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:40.642851 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d6c99-4c8a-483d-9a6d-ddca601f39e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:40.643267 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d6c99-4c8a-483d-9a6d-ddca601f39e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:40.644070 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3d6c99-4c8a-483d-9a6d-ddca601f39e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:40.645853 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3d6c99-4c8a-483d-9a6d-ddca601f39e5 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:40.646980 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6d0cb-7c42-49b2-9d7c-b6afc63cb969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:40.647784 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6d0cb-7c42-49b2-9d7c-b6afc63cb969 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:40.648127 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6d0cb-7c42-49b2-9d7c-b6afc63cb969 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:40.648582 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6d0cb-7c42-49b2-9d7c-b6afc63cb969 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:40.649338 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e6d0cb-7c42-49b2-9d7c-b6afc63cb969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:40.651612 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e6d0cb-7c42-49b2-9d7c-b6afc63cb969 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:40.665534 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 925/1853] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:58:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:58:40.667319 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 929/1854] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:58:40 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:58:40.673250 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6d0cb-7c42-49b2-9d7c-b6afc63cb969 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:40.674420 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d6c99-4c8a-483d-9a6d-ddca601f39e5 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:40.695127 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d6c99-4c8a-483d-9a6d-ddca601f39e5 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:40.699898 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6d0cb-7c42-49b2-9d7c-b6afc63cb969 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:40.705487 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa97c54-dc2f-4478-a95d-0f232e619a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:40.706397 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa97c54-dc2f-4478-a95d-0f232e619a2b admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:40.706816 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa97c54-dc2f-4478-a95d-0f232e619a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:40.707243 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa97c54-dc2f-4478-a95d-0f232e619a2b admin admin] PATH_INFO: `/v3/projects/c82f1b2ab15b4a958734c9cae7435f71/users/47eefb1c52774d2eac5a6395f87080cf/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:40.708675 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a976d390-40e3-4c3e-a669-6d56e5e44168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:40.709793 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976d390-40e3-4c3e-a669-6d56e5e44168 admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:40.710581 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976d390-40e3-4c3e-a669-6d56e5e44168 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:40.711390 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976d390-40e3-4c3e-a669-6d56e5e44168 admin admin] PATH_INFO: `/v3/projects/1784f3a2dd2a4183819fb4a97984fce7/users/0a0f1c1bc9a74d23a5b703b083e0d197/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:40.745249 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa97c54-dc2f-4478-a95d-0f232e619a2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c82f1b2ab15b4a958734c9cae7435f71, user_id=47eefb1c52774d2eac5a6395f87080cf, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:40.746018 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a976d390-40e3-4c3e-a669-6d56e5e44168 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1784f3a2dd2a4183819fb4a97984fce7, user_id=0a0f1c1bc9a74d23a5b703b083e0d197, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:40.749215 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa97c54-dc2f-4478-a95d-0f232e619a2b admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:40.751218 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a976d390-40e3-4c3e-a669-6d56e5e44168 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:40.827655 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 930/1855] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:58:40 2022] PUT /identity/v3/projects/c82f1b2ab15b4a958734c9cae7435f71/users/47eefb1c52774d2eac5a6395f87080cf/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:40.839918 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e996dc96-430d-432e-bf46-b96b2f2c2668 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:40.840201 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e996dc96-430d-432e-bf46-b96b2f2c2668 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:40.840472 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e996dc96-430d-432e-bf46-b96b2f2c2668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:40.867228 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-e996dc96-430d-432e-bf46-b96b2f2c2668 None None] MFA Rules not processed for user `47eefb1c52774d2eac5a6395f87080cf`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:40.868408 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-e996dc96-430d-432e-bf46-b96b2f2c2668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:40.883746 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 926/1856] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:58:40 2022] PUT /identity/v3/projects/1784f3a2dd2a4183819fb4a97984fce7/users/0a0f1c1bc9a74d23a5b703b083e0d197/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:40.894926 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc97d17-d4d4-46f1-b86b-8a9ca8b824f9 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:40.895494 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc97d17-d4d4-46f1-b86b-8a9ca8b824f9 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:40.895494 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc97d17-d4d4-46f1-b86b-8a9ca8b824f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:40.938992 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-bdc97d17-d4d4-46f1-b86b-8a9ca8b824f9 None None] MFA Rules not processed for user `0a0f1c1bc9a74d23a5b703b083e0d197`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:40.940216 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-bdc97d17-d4d4-46f1-b86b-8a9ca8b824f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:40.945955 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 931/1857] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:40 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:40.951620 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e996dc96-430d-432e-bf46-b96b2f2c2668 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:41.035255 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 927/1858] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:58:41.036734 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e996dc96-430d-432e-bf46-b96b2f2c2668 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:41.039498 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc97d17-d4d4-46f1-b86b-8a9ca8b824f9 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:41.118825 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbc0da6-8034-4868-9772-97bfe65edf21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:41.120196 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc0da6-8034-4868-9772-97bfe65edf21 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:41.120416 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc0da6-8034-4868-9772-97bfe65edf21 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:41.120778 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc0da6-8034-4868-9772-97bfe65edf21 admin admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:41.121424 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbc0da6-8034-4868-9772-97bfe65edf21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:41.126925 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbc0da6-8034-4868-9772-97bfe65edf21 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:41.133612 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc97d17-d4d4-46f1-b86b-8a9ca8b824f9 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:41.138580 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d1843-e212-4cc2-aca7-b0d2e9e8349c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:41.139189 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d1843-e212-4cc2-aca7-b0d2e9e8349c admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:41.139469 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d1843-e212-4cc2-aca7-b0d2e9e8349c admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:41.139741 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d1843-e212-4cc2-aca7-b0d2e9e8349c admin admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:41.140509 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0d1843-e212-4cc2-aca7-b0d2e9e8349c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:41.142496 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0d1843-e212-4cc2-aca7-b0d2e9e8349c admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:41.213352 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 932/1859] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 19:58:40 2022] POST /identity/v3/projects => generated 389 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 19:58:41.219080 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbc0da6-8034-4868-9772-97bfe65edf21 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:41.241697 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 928/1860] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 19:58:41 2022] POST /identity/v3/projects => generated 377 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:58:41.242748 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d1843-e212-4cc2-aca7-b0d2e9e8349c admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:41.282685 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbc0da6-8034-4868-9772-97bfe65edf21 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:41.362150 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d1843-e212-4cc2-aca7-b0d2e9e8349c admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:41.370103 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:41.378063 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f13fca8-7377-460e-b2b0-88ea519b4be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:41.378905 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13fca8-7377-460e-b2b0-88ea519b4be6 admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:41.379284 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13fca8-7377-460e-b2b0-88ea519b4be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:41.379662 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13fca8-7377-460e-b2b0-88ea519b4be6 admin admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:41.380425 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f13fca8-7377-460e-b2b0-88ea519b4be6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:41.384324 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f13fca8-7377-460e-b2b0-88ea519b4be6 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:41.436155 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8979c8-8cad-4b24-9499-7c02d22535cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:41.438802 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8979c8-8cad-4b24-9499-7c02d22535cd admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:41.439088 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8979c8-8cad-4b24-9499-7c02d22535cd admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:41.439356 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8979c8-8cad-4b24-9499-7c02d22535cd admin admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:41.440025 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8979c8-8cad-4b24-9499-7c02d22535cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:41.442014 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8979c8-8cad-4b24-9499-7c02d22535cd admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:41.521475 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 929/1861] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:58:41 2022] POST /identity/v3/users => generated 295 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 19:58:41.526140 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f13fca8-7377-460e-b2b0-88ea519b4be6 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:41.549816 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 933/1862] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:58:41 2022] POST /identity/v3/users => generated 301 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 19:58:41.553715 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8979c8-8cad-4b24-9499-7c02d22535cd admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:41.558670 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f13fca8-7377-460e-b2b0-88ea519b4be6 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:41.568937 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c9fcd0-b12f-4bd2-9f90-95d2824a8db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:41.569584 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c9fcd0-b12f-4bd2-9f90-95d2824a8db4 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:41.569891 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c9fcd0-b12f-4bd2-9f90-95d2824a8db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:41.573887 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c9fcd0-b12f-4bd2-9f90-95d2824a8db4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:41.573887 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c9fcd0-b12f-4bd2-9f90-95d2824a8db4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:41.574614 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c9fcd0-b12f-4bd2-9f90-95d2824a8db4 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:41.576962 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8979c8-8cad-4b24-9499-7c02d22535cd admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:41.591080 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 930/1863] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:58:41 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 19:58:41.592402 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c9fcd0-b12f-4bd2-9f90-95d2824a8db4 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:41.593621 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f7706d-4982-4de3-843a-4ecf9b8f15a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:41.594271 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7706d-4982-4de3-843a-4ecf9b8f15a2 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:41.596550 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7706d-4982-4de3-843a-4ecf9b8f15a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:41.597834 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7706d-4982-4de3-843a-4ecf9b8f15a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:41.600156 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f7706d-4982-4de3-843a-4ecf9b8f15a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:41.610665 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f7706d-4982-4de3-843a-4ecf9b8f15a2 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:41.610827 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c9fcd0-b12f-4bd2-9f90-95d2824a8db4 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:41.615140 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f438f826-ac8f-4e18-afe0-f92f2d20af27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:41.616212 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438f826-ac8f-4e18-afe0-f92f2d20af27 admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:41.616755 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438f826-ac8f-4e18-afe0-f92f2d20af27 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:41.617232 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438f826-ac8f-4e18-afe0-f92f2d20af27 admin admin] PATH_INFO: `/v3/projects/cf70c62c717344c293df44f3cb98c1cd/users/1c21dcc619554f1d99573fcb12d3bb50/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:41.637382 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 934/1864] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:58:41 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 19:58:41.641750 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f7706d-4982-4de3-843a-4ecf9b8f15a2 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:41.645612 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f438f826-ac8f-4e18-afe0-f92f2d20af27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf70c62c717344c293df44f3cb98c1cd, user_id=1c21dcc619554f1d99573fcb12d3bb50, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:41.649979 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f438f826-ac8f-4e18-afe0-f92f2d20af27 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:41.653300 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f7706d-4982-4de3-843a-4ecf9b8f15a2 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:41.658587 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6441948d-6082-4ccc-a846-4ccf632b525b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:41.659216 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441948d-6082-4ccc-a846-4ccf632b525b admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:41.659511 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441948d-6082-4ccc-a846-4ccf632b525b admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:41.659767 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441948d-6082-4ccc-a846-4ccf632b525b admin admin] PATH_INFO: `/v3/projects/2995fcba5c2d4627a6e97e74f28f37ab/users/94f0d04c815e4cac8b580ee345622cd9/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:41.687323 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6441948d-6082-4ccc-a846-4ccf632b525b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2995fcba5c2d4627a6e97e74f28f37ab, user_id=94f0d04c815e4cac8b580ee345622cd9, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:41.690559 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6441948d-6082-4ccc-a846-4ccf632b525b admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:41.750809 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 931/1865] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:58:41 2022] PUT /identity/v3/projects/cf70c62c717344c293df44f3cb98c1cd/users/1c21dcc619554f1d99573fcb12d3bb50/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:41.754785 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f438f826-ac8f-4e18-afe0-f92f2d20af27 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:41.812461 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 935/1866] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:58:41 2022] PUT /identity/v3/projects/2995fcba5c2d4627a6e97e74f28f37ab/users/94f0d04c815e4cac8b580ee345622cd9/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 19:58:41.816457 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6441948d-6082-4ccc-a846-4ccf632b525b admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:41.835422 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f438f826-ac8f-4e18-afe0-f92f2d20af27 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:41.950880 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b935a-a5e4-4773-84d4-1f27ba269e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:41.951621 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b935a-a5e4-4773-84d4-1f27ba269e48 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:41.951887 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b935a-a5e4-4773-84d4-1f27ba269e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:41.952055 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6441948d-6082-4ccc-a846-4ccf632b525b admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:41.952366 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b935a-a5e4-4773-84d4-1f27ba269e48 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:41.953105 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2b935a-a5e4-4773-84d4-1f27ba269e48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:41.954888 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2b935a-a5e4-4773-84d4-1f27ba269e48 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:41.958955 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd41d5e-bf88-4865-b937-9c8359610146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:41.959575 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd41d5e-bf88-4865-b937-9c8359610146 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:41.959863 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd41d5e-bf88-4865-b937-9c8359610146 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:41.960119 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd41d5e-bf88-4865-b937-9c8359610146 admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:41.960757 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd41d5e-bf88-4865-b937-9c8359610146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:41.962370 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd41d5e-bf88-4865-b937-9c8359610146 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:41.969541 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 932/1867] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:58:41 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:58:41.971632 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b935a-a5e4-4773-84d4-1f27ba269e48 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:41.976078 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 936/1868] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:58:41 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 19:58:41.981340 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd41d5e-bf88-4865-b937-9c8359610146 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:41.984865 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b935a-a5e4-4773-84d4-1f27ba269e48 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:41.991180 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fb318c-0452-40ba-b07e-3e3eae0ce914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:41.991970 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb318c-0452-40ba-b07e-3e3eae0ce914 admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:41.992405 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb318c-0452-40ba-b07e-3e3eae0ce914 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:41.992652 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb318c-0452-40ba-b07e-3e3eae0ce914 admin admin] PATH_INFO: `/v3/projects/cf70c62c717344c293df44f3cb98c1cd/users/1c21dcc619554f1d99573fcb12d3bb50/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:41.995601 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fb318c-0452-40ba-b07e-3e3eae0ce914 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf70c62c717344c293df44f3cb98c1cd, user_id=1c21dcc619554f1d99573fcb12d3bb50, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:41.997714 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd41d5e-bf88-4865-b937-9c8359610146 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:41.998715 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fb318c-0452-40ba-b07e-3e3eae0ce914 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:42.003547 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012bd2db-0095-482e-87db-785241fc2a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:42.004732 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012bd2db-0095-482e-87db-785241fc2a5a admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:42.004732 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012bd2db-0095-482e-87db-785241fc2a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:42.004913 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012bd2db-0095-482e-87db-785241fc2a5a admin admin] PATH_INFO: `/v3/projects/2995fcba5c2d4627a6e97e74f28f37ab/users/94f0d04c815e4cac8b580ee345622cd9/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:42.007712 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012bd2db-0095-482e-87db-785241fc2a5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2995fcba5c2d4627a6e97e74f28f37ab, user_id=94f0d04c815e4cac8b580ee345622cd9, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:42.012236 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 933/1869] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:58:41 2022] PUT /identity/v3/projects/cf70c62c717344c293df44f3cb98c1cd/users/1c21dcc619554f1d99573fcb12d3bb50/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 19:58:42.017190 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012bd2db-0095-482e-87db-785241fc2a5a admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:42.023884 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ac39e-082d-4e84-b96b-e5844df30903 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:42.024176 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ac39e-082d-4e84-b96b-e5844df30903 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:42.027789 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ac39e-082d-4e84-b96b-e5844df30903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:42.031647 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 937/1870] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:58:41 2022] PUT /identity/v3/projects/2995fcba5c2d4627a6e97e74f28f37ab/users/94f0d04c815e4cac8b580ee345622cd9/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 19:58:42.042270 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f310dd-c4eb-41ee-9e33-34263ccdcdfa None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:42.042548 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f310dd-c4eb-41ee-9e33-34263ccdcdfa None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:42.042882 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f310dd-c4eb-41ee-9e33-34263ccdcdfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:42.058758 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-028ac39e-082d-4e84-b96b-e5844df30903 None None] MFA Rules not processed for user `1c21dcc619554f1d99573fcb12d3bb50`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:42.059999 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-028ac39e-082d-4e84-b96b-e5844df30903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:42.081955 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:42.084130 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-54f310dd-c4eb-41ee-9e33-34263ccdcdfa None None] MFA Rules not processed for user `94f0d04c815e4cac8b580ee345622cd9`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:42.085326 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-54f310dd-c4eb-41ee-9e33-34263ccdcdfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:42.150002 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 934/1871] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:42 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:42.157777 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ac39e-082d-4e84-b96b-e5844df30903 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:42.163788 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 938/1872] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:42 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:58:42.175745 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f310dd-c4eb-41ee-9e33-34263ccdcdfa None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:42.216782 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ac39e-082d-4e84-b96b-e5844df30903 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:42.221103 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f918f205-03de-4b62-888b-8f2a2cbf97c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:42.221948 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918f205-03de-4b62-888b-8f2a2cbf97c8 service cinder] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:42.222404 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918f205-03de-4b62-888b-8f2a2cbf97c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:42.222689 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918f205-03de-4b62-888b-8f2a2cbf97c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:42.242113 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f310dd-c4eb-41ee-9e33-34263ccdcdfa None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:42.242113 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbdf399-b2e6-4957-a046-8e1dbe308eae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:42.242113 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdf399-b2e6-4957-a046-8e1dbe308eae service cinder] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:42.242113 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdf399-b2e6-4957-a046-8e1dbe308eae service cinder] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:42.242526 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdf399-b2e6-4957-a046-8e1dbe308eae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:42.255153 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbdf399-b2e6-4957-a046-8e1dbe308eae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:42.256810 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbdf399-b2e6-4957-a046-8e1dbe308eae service cinder] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:42.268483 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 939/1873] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:58:42 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:58:42.288703 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f918f205-03de-4b62-888b-8f2a2cbf97c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:42.290856 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f918f205-03de-4b62-888b-8f2a2cbf97c8 service cinder] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:42.301706 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 935/1874] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:58:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 19:58:42.419726 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbdf399-b2e6-4957-a046-8e1dbe308eae service cinder] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:42.483551 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbdf399-b2e6-4957-a046-8e1dbe308eae service cinder] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:42.488160 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c41086-4d5d-46b9-924d-fab81c17a3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:42.488838 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c41086-4d5d-46b9-924d-fab81c17a3ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:42.489114 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c41086-4d5d-46b9-924d-fab81c17a3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:42.489382 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c41086-4d5d-46b9-924d-fab81c17a3ed admin admin] PATH_INFO: `/v3/users/47eefb1c52774d2eac5a6395f87080cf` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:42.490550 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c41086-4d5d-46b9-924d-fab81c17a3ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=47eefb1c52774d2eac5a6395f87080cf)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:42.492539 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c41086-4d5d-46b9-924d-fab81c17a3ed admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:42.642646 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-85c41086-4d5d-46b9-924d-fab81c17a3ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47eefb1c52774d2eac5a6395f87080cf'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:42.696635 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-85c41086-4d5d-46b9-924d-fab81c17a3ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47eefb1c52774d2eac5a6395f87080cf'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:42.697341 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-85c41086-4d5d-46b9-924d-fab81c17a3ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47eefb1c52774d2eac5a6395f87080cf'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:42.698446 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-85c41086-4d5d-46b9-924d-fab81c17a3ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47eefb1c52774d2eac5a6395f87080cf'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:42.711256 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-85c41086-4d5d-46b9-924d-fab81c17a3ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47eefb1c52774d2eac5a6395f87080cf'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:42.723837 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 940/1875] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 19:58:42 2022] DELETE /identity/v3/users/47eefb1c52774d2eac5a6395f87080cf => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:42.728406 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b9688-db75-44ad-8308-57b1e54cb2d5 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:42.729215 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b9688-db75-44ad-8308-57b1e54cb2d5 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:42.729728 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b9688-db75-44ad-8308-57b1e54cb2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:42.748973 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-e73b9688-db75-44ad-8308-57b1e54cb2d5 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:42.750126 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-e73b9688-db75-44ad-8308-57b1e54cb2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:42.809518 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 936/1876] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:42.819425 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c41086-4d5d-46b9-924d-fab81c17a3ed admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:42.820844 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-85c41086-4d5d-46b9-924d-fab81c17a3ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:42.877424 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c41086-4d5d-46b9-924d-fab81c17a3ed admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:42.881040 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c3b6c-127d-42dd-8e2b-0fdaae66252b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:42.881674 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c3b6c-127d-42dd-8e2b-0fdaae66252b service neutron] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:42.881949 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c3b6c-127d-42dd-8e2b-0fdaae66252b service neutron] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:42.882215 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c3b6c-127d-42dd-8e2b-0fdaae66252b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:42.891048 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c3b6c-127d-42dd-8e2b-0fdaae66252b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:42.892460 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c3b6c-127d-42dd-8e2b-0fdaae66252b service neutron] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:42.901573 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 941/1877] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:58:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 19:58:43.347946 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b9688-db75-44ad-8308-57b1e54cb2d5 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:43.349833 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-e73b9688-db75-44ad-8308-57b1e54cb2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:43.364774 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b9688-db75-44ad-8308-57b1e54cb2d5 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:43.375734 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187003d0-1129-4423-ad44-e8500f0c8baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:43.378423 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187003d0-1129-4423-ad44-e8500f0c8baa admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:43.378423 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187003d0-1129-4423-ad44-e8500f0c8baa admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:43.378423 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187003d0-1129-4423-ad44-e8500f0c8baa admin admin] PATH_INFO: `/v3/projects/c82f1b2ab15b4a958734c9cae7435f71` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:43.378811 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187003d0-1129-4423-ad44-e8500f0c8baa admin admin] RBAC: Authorizing `identity:delete_project(project_id=c82f1b2ab15b4a958734c9cae7435f71)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:43.381073 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187003d0-1129-4423-ad44-e8500f0c8baa admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:43.517370 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-187003d0-1129-4423-ad44-e8500f0c8baa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c82f1b2ab15b4a958734c9cae7435f71', 'request_id': 'req-187003d0-1129-4423-ad44-e8500f0c8baa'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:43.621550 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-187003d0-1129-4423-ad44-e8500f0c8baa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c82f1b2ab15b4a958734c9cae7435f71', 'request_id': 'req-187003d0-1129-4423-ad44-e8500f0c8baa'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:43.627436 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-187003d0-1129-4423-ad44-e8500f0c8baa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c82f1b2ab15b4a958734c9cae7435f71', 'request_id': 'req-187003d0-1129-4423-ad44-e8500f0c8baa'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:43.640511 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-187003d0-1129-4423-ad44-e8500f0c8baa admin admin] The token cache is being invalidate because project c82f1b2ab15b4a958734c9cae7435f71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 19:58:43.640808 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-187003d0-1129-4423-ad44-e8500f0c8baa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:43.641467 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-187003d0-1129-4423-ad44-e8500f0c8baa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:43.642990 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 937/1878] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 19:58:43 2022] DELETE /identity/v3/projects/c82f1b2ab15b4a958734c9cae7435f71 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:43.647536 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c3b6c-127d-42dd-8e2b-0fdaae66252b service neutron] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:43.656861 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c3b6c-127d-42dd-8e2b-0fdaae66252b service neutron] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:43.716297 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a82619b-6487-4cae-9197-78151e0df991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:43.717016 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82619b-6487-4cae-9197-78151e0df991 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:43.717301 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82619b-6487-4cae-9197-78151e0df991 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:43.717611 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82619b-6487-4cae-9197-78151e0df991 admin admin] PATH_INFO: `/v3/users/94f0d04c815e4cac8b580ee345622cd9` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:43.718805 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a82619b-6487-4cae-9197-78151e0df991 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94f0d04c815e4cac8b580ee345622cd9)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:43.721108 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a82619b-6487-4cae-9197-78151e0df991 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:43.725435 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:43.811403 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:43.924415 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-8a82619b-6487-4cae-9197-78151e0df991 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94f0d04c815e4cac8b580ee345622cd9'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:43.997125 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-8a82619b-6487-4cae-9197-78151e0df991 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94f0d04c815e4cac8b580ee345622cd9'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:44.001332 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-8a82619b-6487-4cae-9197-78151e0df991 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94f0d04c815e4cac8b580ee345622cd9'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:44.001332 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-8a82619b-6487-4cae-9197-78151e0df991 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94f0d04c815e4cac8b580ee345622cd9'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:44.016642 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-8a82619b-6487-4cae-9197-78151e0df991 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94f0d04c815e4cac8b580ee345622cd9'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:44.030624 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 942/1879] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 19:58:43 2022] DELETE /identity/v3/users/94f0d04c815e4cac8b580ee345622cd9 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:44.161964 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187003d0-1129-4423-ad44-e8500f0c8baa admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:44.163408 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-187003d0-1129-4423-ad44-e8500f0c8baa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:44.221457 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187003d0-1129-4423-ad44-e8500f0c8baa admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:44.276145 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a23cf4d-f14e-4b63-ac2c-6f6caac624fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:44.276876 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23cf4d-f14e-4b63-ac2c-6f6caac624fc service cinder] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:44.281752 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23cf4d-f14e-4b63-ac2c-6f6caac624fc service cinder] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:44.282073 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23cf4d-f14e-4b63-ac2c-6f6caac624fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:44.284289 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-7a23cf4d-f14e-4b63-ac2c-6f6caac624fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:44.372422 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a23cf4d-f14e-4b63-ac2c-6f6caac624fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:44.374010 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a23cf4d-f14e-4b63-ac2c-6f6caac624fc service cinder] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:44.385137 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 938/1880] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:58:44 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:58:44.545277 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a82619b-6487-4cae-9197-78151e0df991 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:44.546714 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-8a82619b-6487-4cae-9197-78151e0df991 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:44.631297 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a82619b-6487-4cae-9197-78151e0df991 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:44.635984 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7836c5de-00a4-4a83-a0ef-e91c9c326c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:44.636630 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836c5de-00a4-4a83-a0ef-e91c9c326c3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:44.636907 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836c5de-00a4-4a83-a0ef-e91c9c326c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:44.637176 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836c5de-00a4-4a83-a0ef-e91c9c326c3d admin admin] PATH_INFO: `/v3/projects/2995fcba5c2d4627a6e97e74f28f37ab` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:44.638373 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7836c5de-00a4-4a83-a0ef-e91c9c326c3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2995fcba5c2d4627a6e97e74f28f37ab)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:44.640337 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7836c5de-00a4-4a83-a0ef-e91c9c326c3d admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:44.761049 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-7836c5de-00a4-4a83-a0ef-e91c9c326c3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2995fcba5c2d4627a6e97e74f28f37ab', 'request_id': 'req-7836c5de-00a4-4a83-a0ef-e91c9c326c3d'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:44.767290 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-7836c5de-00a4-4a83-a0ef-e91c9c326c3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2995fcba5c2d4627a6e97e74f28f37ab', 'request_id': 'req-7836c5de-00a4-4a83-a0ef-e91c9c326c3d'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:44.848839 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-7836c5de-00a4-4a83-a0ef-e91c9c326c3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2995fcba5c2d4627a6e97e74f28f37ab', 'request_id': 'req-7836c5de-00a4-4a83-a0ef-e91c9c326c3d'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:44.860296 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-7836c5de-00a4-4a83-a0ef-e91c9c326c3d admin admin] The token cache is being invalidate because project 2995fcba5c2d4627a6e97e74f28f37ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 19:58:44.860588 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-7836c5de-00a4-4a83-a0ef-e91c9c326c3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:44.867325 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-7836c5de-00a4-4a83-a0ef-e91c9c326c3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:44.867325 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 943/1881] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 19:58:44 2022] DELETE /identity/v3/projects/2995fcba5c2d4627a6e97e74f28f37ab => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:44.868046 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdcc37-ed76-4b3a-8421-234e5210a68e None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:44.868334 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdcc37-ed76-4b3a-8421-234e5210a68e None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:44.868612 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdcc37-ed76-4b3a-8421-234e5210a68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:44.888488 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-7dbdcc37-ed76-4b3a-8421-234e5210a68e None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:44.889719 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-7dbdcc37-ed76-4b3a-8421-234e5210a68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:44.948016 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 939/1882] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:44.955652 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d8cc9-b506-4a72-81ab-d56885f2d9dc None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:44.955931 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d8cc9-b506-4a72-81ab-d56885f2d9dc None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:44.956197 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d8cc9-b506-4a72-81ab-d56885f2d9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:44.976563 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-319d8cc9-b506-4a72-81ab-d56885f2d9dc None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:44.977827 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-319d8cc9-b506-4a72-81ab-d56885f2d9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:44.987766 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 944/1883] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:58:44.992125 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbdcc37-ed76-4b3a-8421-234e5210a68e None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:45.003770 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbdcc37-ed76-4b3a-8421-234e5210a68e None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:45.008496 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ea2d27-a196-4d28-bb3b-4191650dff3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:45.009147 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea2d27-a196-4d28-bb3b-4191650dff3c admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:45.009436 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea2d27-a196-4d28-bb3b-4191650dff3c admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:45.009740 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea2d27-a196-4d28-bb3b-4191650dff3c admin admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:45.010742 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ea2d27-a196-4d28-bb3b-4191650dff3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:58:45.011045 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ea2d27-a196-4d28-bb3b-4191650dff3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:45.012616 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ea2d27-a196-4d28-bb3b-4191650dff3c admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:45.024830 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 940/1884] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 19:58:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:58:45.029147 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d8cc9-b506-4a72-81ab-d56885f2d9dc None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:45.038584 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d8cc9-b506-4a72-81ab-d56885f2d9dc None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:45.044331 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a345f94-47e2-45c3-837f-82eb903fb2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:45.044935 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a345f94-47e2-45c3-837f-82eb903fb2ff admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:45.045270 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a345f94-47e2-45c3-837f-82eb903fb2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:45.045579 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a345f94-47e2-45c3-837f-82eb903fb2ff admin admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:45.046235 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a345f94-47e2-45c3-837f-82eb903fb2ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:45.048221 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a345f94-47e2-45c3-837f-82eb903fb2ff admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:45.219213 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 945/1885] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 19:58:45 2022] POST /identity/v3/projects => generated 379 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:58:45.223084 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ea2d27-a196-4d28-bb3b-4191650dff3c admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:45.233931 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ea2d27-a196-4d28-bb3b-4191650dff3c admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:45.289588 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f804c15b-3479-4686-a2c1-f320b70a470b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:45.290208 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804c15b-3479-4686-a2c1-f320b70a470b admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:45.290471 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804c15b-3479-4686-a2c1-f320b70a470b admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:45.290740 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804c15b-3479-4686-a2c1-f320b70a470b admin admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:45.291954 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f804c15b-3479-4686-a2c1-f320b70a470b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:45.293882 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f804c15b-3479-4686-a2c1-f320b70a470b admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:45.406352 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 941/1886] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:58:45 2022] POST /identity/v3/users => generated 290 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:58:45.411088 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a345f94-47e2-45c3-837f-82eb903fb2ff admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:45.421980 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a345f94-47e2-45c3-837f-82eb903fb2ff admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:45.426675 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8730b2-6308-4e51-b378-a77d96d81e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:45.427308 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8730b2-6308-4e51-b378-a77d96d81e06 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:45.427584 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8730b2-6308-4e51-b378-a77d96d81e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:45.427853 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8730b2-6308-4e51-b378-a77d96d81e06 admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:45.428501 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8730b2-6308-4e51-b378-a77d96d81e06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:45.430180 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8730b2-6308-4e51-b378-a77d96d81e06 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:45.443908 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 946/1887] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:58:45.448980 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f804c15b-3479-4686-a2c1-f320b70a470b admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:45.459910 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f804c15b-3479-4686-a2c1-f320b70a470b admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:45.465714 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be0dadd-1b6d-458f-bbeb-ca46bbcabbe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:45.466331 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0dadd-1b6d-458f-bbeb-ca46bbcabbe5 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:45.466612 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0dadd-1b6d-458f-bbeb-ca46bbcabbe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:45.466885 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0dadd-1b6d-458f-bbeb-ca46bbcabbe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:45.467531 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be0dadd-1b6d-458f-bbeb-ca46bbcabbe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:45.469097 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be0dadd-1b6d-458f-bbeb-ca46bbcabbe5 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:45.485558 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 942/1888] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:58:45.485693 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8730b2-6308-4e51-b378-a77d96d81e06 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:45.495831 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8730b2-6308-4e51-b378-a77d96d81e06 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:45.500276 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51af6c76-77a9-4107-933f-8a10a0a27de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:45.500946 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af6c76-77a9-4107-933f-8a10a0a27de3 admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:45.501223 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af6c76-77a9-4107-933f-8a10a0a27de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:45.501517 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af6c76-77a9-4107-933f-8a10a0a27de3 admin admin] PATH_INFO: `/v3/projects/4ba5f6a5863647afa0a15486a43d1632/users/98464f51767f4b048893ae7b4d7761e2/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:45.516934 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51af6c76-77a9-4107-933f-8a10a0a27de3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ba5f6a5863647afa0a15486a43d1632, user_id=98464f51767f4b048893ae7b4d7761e2, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:45.519855 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51af6c76-77a9-4107-933f-8a10a0a27de3 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:45.558008 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be0dadd-1b6d-458f-bbeb-ca46bbcabbe5 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:45.559886 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-5be0dadd-1b6d-458f-bbeb-ca46bbcabbe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:45.575919 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be0dadd-1b6d-458f-bbeb-ca46bbcabbe5 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:45.581047 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f317cb4e-50a2-4dbb-8a16-30808726a25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:45.586100 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317cb4e-50a2-4dbb-8a16-30808726a25f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:45.589995 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317cb4e-50a2-4dbb-8a16-30808726a25f admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:45.591589 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317cb4e-50a2-4dbb-8a16-30808726a25f admin admin] PATH_INFO: `/v3/users/1c03c8314efb4a29b3837298205ed643` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:45.591743 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 947/1889] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:58:45 2022] PUT /identity/v3/projects/4ba5f6a5863647afa0a15486a43d1632/users/98464f51767f4b048893ae7b4d7761e2/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:45.592391 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f317cb4e-50a2-4dbb-8a16-30808726a25f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c03c8314efb4a29b3837298205ed643)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:45.594632 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f317cb4e-50a2-4dbb-8a16-30808726a25f admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:45.608846 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75411b73-7ed7-4a16-b6e9-6a35f5da9ee4 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:45.609192 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75411b73-7ed7-4a16-b6e9-6a35f5da9ee4 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:45.614703 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75411b73-7ed7-4a16-b6e9-6a35f5da9ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:45.655731 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-75411b73-7ed7-4a16-b6e9-6a35f5da9ee4 None None] MFA Rules not processed for user `98464f51767f4b048893ae7b4d7761e2`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:45.657230 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-75411b73-7ed7-4a16-b6e9-6a35f5da9ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:45.745933 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 948/1890] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:45.746996 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75411b73-7ed7-4a16-b6e9-6a35f5da9ee4 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:45.830073 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-f317cb4e-50a2-4dbb-8a16-30808726a25f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c03c8314efb4a29b3837298205ed643'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:45.855177 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75411b73-7ed7-4a16-b6e9-6a35f5da9ee4 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:45.860806 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c6a9c1-7e21-4302-96b6-6503eb36fd1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:45.861426 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6a9c1-7e21-4302-96b6-6503eb36fd1f admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:45.861750 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6a9c1-7e21-4302-96b6-6503eb36fd1f admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:45.862018 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6a9c1-7e21-4302-96b6-6503eb36fd1f admin admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:45.862649 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c6a9c1-7e21-4302-96b6-6503eb36fd1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:45.864723 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c6a9c1-7e21-4302-96b6-6503eb36fd1f admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:45.924192 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-f317cb4e-50a2-4dbb-8a16-30808726a25f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c03c8314efb4a29b3837298205ed643'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:45.925463 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-f317cb4e-50a2-4dbb-8a16-30808726a25f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c03c8314efb4a29b3837298205ed643'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:45.941515 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-f317cb4e-50a2-4dbb-8a16-30808726a25f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c03c8314efb4a29b3837298205ed643'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:45.942232 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-f317cb4e-50a2-4dbb-8a16-30808726a25f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c03c8314efb4a29b3837298205ed643'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:45.955500 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 943/1891] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 19:58:45 2022] DELETE /identity/v3/users/1c03c8314efb4a29b3837298205ed643 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 19:58:45.959710 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 949/1892] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 19:58:45 2022] POST /identity/v3/projects => generated 377 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 19:58:45.960503 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641de56-9daf-44cd-af07-e3fe6b6f8e10 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:45.966853 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641de56-9daf-44cd-af07-e3fe6b6f8e10 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:45.966853 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641de56-9daf-44cd-af07-e3fe6b6f8e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:45.969646 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c6a9c1-7e21-4302-96b6-6503eb36fd1f admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:45.971356 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-b9c6a9c1-7e21-4302-96b6-6503eb36fd1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:45.982262 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-b641de56-9daf-44cd-af07-e3fe6b6f8e10 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:45.983476 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-b641de56-9daf-44cd-af07-e3fe6b6f8e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:46.015382 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:46.039395 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c6a9c1-7e21-4302-96b6-6503eb36fd1f admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:46.051351 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 944/1893] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:46.051891 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:46.052188 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e4b75-c30e-4464-a4dc-fb2747ee1af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:46.052824 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e4b75-c30e-4464-a4dc-fb2747ee1af8 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:46.053133 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e4b75-c30e-4464-a4dc-fb2747ee1af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:46.053408 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e4b75-c30e-4464-a4dc-fb2747ee1af8 admin admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:46.054075 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243e4b75-c30e-4464-a4dc-fb2747ee1af8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:46.056066 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243e4b75-c30e-4464-a4dc-fb2747ee1af8 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:46.058869 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b641de56-9daf-44cd-af07-e3fe6b6f8e10 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:46.060592 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-b641de56-9daf-44cd-af07-e3fe6b6f8e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:46.128689 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b641de56-9daf-44cd-af07-e3fe6b6f8e10 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:46.135154 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d841a18-547b-4162-bfd0-011593b06051 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:46.135857 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d841a18-547b-4162-bfd0-011593b06051 service neutron] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:46.136135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d841a18-547b-4162-bfd0-011593b06051 service neutron] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:46.136430 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d841a18-547b-4162-bfd0-011593b06051 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:46.146061 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d841a18-547b-4162-bfd0-011593b06051 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:46.147554 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d841a18-547b-4162-bfd0-011593b06051 service neutron] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:46.158145 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 945/1894] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:58:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 19:58:46.229742 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 950/1895] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:58:45 2022] POST /identity/v3/users => generated 289 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 19:58:46.231291 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d841a18-547b-4162-bfd0-011593b06051 service neutron] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:46.246975 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d841a18-547b-4162-bfd0-011593b06051 service neutron] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:46.266700 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7402e132-0a7b-4e47-9525-c3cb8d86ba62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:46.266700 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402e132-0a7b-4e47-9525-c3cb8d86ba62 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:46.266972 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402e132-0a7b-4e47-9525-c3cb8d86ba62 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:46.267058 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402e132-0a7b-4e47-9525-c3cb8d86ba62 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:46.267712 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7402e132-0a7b-4e47-9525-c3cb8d86ba62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:46.269327 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7402e132-0a7b-4e47-9525-c3cb8d86ba62 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:46.280847 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 946/1896] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:58:46.284871 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e4b75-c30e-4464-a4dc-fb2747ee1af8 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:46.296101 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e4b75-c30e-4464-a4dc-fb2747ee1af8 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:46.300892 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e84d46a-daf7-4c26-aaa1-50fccce95a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:46.301521 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84d46a-daf7-4c26-aaa1-50fccce95a9a admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:46.301802 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84d46a-daf7-4c26-aaa1-50fccce95a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:46.302074 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84d46a-daf7-4c26-aaa1-50fccce95a9a admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:46.302710 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e84d46a-daf7-4c26-aaa1-50fccce95a9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:46.304323 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e84d46a-daf7-4c26-aaa1-50fccce95a9a admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:46.317702 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 951/1897] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:58:46.318914 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7402e132-0a7b-4e47-9525-c3cb8d86ba62 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:46.329651 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7402e132-0a7b-4e47-9525-c3cb8d86ba62 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:46.334672 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f0723-8c36-48e9-ad8d-2c0aaff6aae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:46.335330 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f0723-8c36-48e9-ad8d-2c0aaff6aae3 admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:46.335602 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f0723-8c36-48e9-ad8d-2c0aaff6aae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:46.335875 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f0723-8c36-48e9-ad8d-2c0aaff6aae3 admin admin] PATH_INFO: `/v3/projects/8c115d966ccd467aa20eb845ae0b3f9c/users/38c3fbd3dd1b41a684e96784d63114bd/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:46.353620 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37f0723-8c36-48e9-ad8d-2c0aaff6aae3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c115d966ccd467aa20eb845ae0b3f9c, user_id=38c3fbd3dd1b41a684e96784d63114bd, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:46.356505 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37f0723-8c36-48e9-ad8d-2c0aaff6aae3 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:46.473995 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 947/1898] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:58:46 2022] PUT /identity/v3/projects/8c115d966ccd467aa20eb845ae0b3f9c/users/38c3fbd3dd1b41a684e96784d63114bd/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:46.484140 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e62adc-e7dd-47eb-8f05-35b4390c8736 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:46.484505 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e62adc-e7dd-47eb-8f05-35b4390c8736 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:46.484855 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e62adc-e7dd-47eb-8f05-35b4390c8736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:46.519342 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-51e62adc-e7dd-47eb-8f05-35b4390c8736 None None] MFA Rules not processed for user `38c3fbd3dd1b41a684e96784d63114bd`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:46.520796 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-51e62adc-e7dd-47eb-8f05-35b4390c8736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:46.625945 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 952/1899] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:46.628667 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f0723-8c36-48e9-ad8d-2c0aaff6aae3 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:46.665459 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e62adc-e7dd-47eb-8f05-35b4390c8736 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:46.667932 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-51e62adc-e7dd-47eb-8f05-35b4390c8736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:46.722221 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f0723-8c36-48e9-ad8d-2c0aaff6aae3 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:46.728162 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c7ad5f-079a-456b-aec3-2c4b47fdc463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:46.729762 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7ad5f-079a-456b-aec3-2c4b47fdc463 admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:46.730062 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7ad5f-079a-456b-aec3-2c4b47fdc463 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:46.730428 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7ad5f-079a-456b-aec3-2c4b47fdc463 admin admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:46.731261 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c7ad5f-079a-456b-aec3-2c4b47fdc463 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:46.733557 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c7ad5f-079a-456b-aec3-2c4b47fdc463 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:46.771700 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e62adc-e7dd-47eb-8f05-35b4390c8736 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:46.781525 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb000343-d973-4677-a9e9-efec391dc836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:46.782347 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb000343-d973-4677-a9e9-efec391dc836 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:46.782725 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb000343-d973-4677-a9e9-efec391dc836 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:46.783167 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb000343-d973-4677-a9e9-efec391dc836 admin admin] PATH_INFO: `/v3/projects/cbbda6e0ad2a498db42af6ed93222671` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:46.784457 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb000343-d973-4677-a9e9-efec391dc836 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbbda6e0ad2a498db42af6ed93222671)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:46.786606 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb000343-d973-4677-a9e9-efec391dc836 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:46.850140 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 948/1900] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 19:58:46 2022] POST /identity/v3/projects => generated 377 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:58:46.854978 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c7ad5f-079a-456b-aec3-2c4b47fdc463 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:46.919603 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-bb000343-d973-4677-a9e9-efec391dc836 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbbda6e0ad2a498db42af6ed93222671', 'request_id': 'req-bb000343-d973-4677-a9e9-efec391dc836'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:46.927979 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-bb000343-d973-4677-a9e9-efec391dc836 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbbda6e0ad2a498db42af6ed93222671', 'request_id': 'req-bb000343-d973-4677-a9e9-efec391dc836'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:46.989053 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c7ad5f-079a-456b-aec3-2c4b47fdc463 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:47.029431 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-bb000343-d973-4677-a9e9-efec391dc836 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbbda6e0ad2a498db42af6ed93222671', 'request_id': 'req-bb000343-d973-4677-a9e9-efec391dc836'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:47.063107 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-bb000343-d973-4677-a9e9-efec391dc836 admin admin] The token cache is being invalidate because project cbbda6e0ad2a498db42af6ed93222671 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 19:58:47.064195 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-bb000343-d973-4677-a9e9-efec391dc836 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:47.064601 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-bb000343-d973-4677-a9e9-efec391dc836 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:47.066929 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 953/1901] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 19:58:46 2022] DELETE /identity/v3/projects/cbbda6e0ad2a498db42af6ed93222671 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:47.070570 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb000343-d973-4677-a9e9-efec391dc836 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:47.072445 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-bb000343-d973-4677-a9e9-efec391dc836 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:47.118854 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1aa81b-8a22-4d92-b9d3-6a6ae1708b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:47.120552 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1aa81b-8a22-4d92-b9d3-6a6ae1708b6d admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:47.121078 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1aa81b-8a22-4d92-b9d3-6a6ae1708b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:47.121574 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1aa81b-8a22-4d92-b9d3-6a6ae1708b6d admin admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:47.122279 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1aa81b-8a22-4d92-b9d3-6a6ae1708b6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:47.124709 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1aa81b-8a22-4d92-b9d3-6a6ae1708b6d admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:47.157481 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb000343-d973-4677-a9e9-efec391dc836 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:47.162188 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a0d22-ad59-40eb-a815-695afd11a9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:47.166423 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a0d22-ad59-40eb-a815-695afd11a9a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:47.166423 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a0d22-ad59-40eb-a815-695afd11a9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:47.166423 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a0d22-ad59-40eb-a815-695afd11a9a6 admin admin] PATH_INFO: `/v3/users/dee3f749a2134f58b198f0435ef11e0e` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:47.166423 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7a0d22-ad59-40eb-a815-695afd11a9a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dee3f749a2134f58b198f0435ef11e0e)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:47.167179 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7a0d22-ad59-40eb-a815-695afd11a9a6 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:47.422922 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 949/1902] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:58:46 2022] POST /identity/v3/users => generated 295 bytes in 566 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 19:58:47.426459 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1aa81b-8a22-4d92-b9d3-6a6ae1708b6d admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:47.428588 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-2a1aa81b-8a22-4d92-b9d3-6a6ae1708b6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:47.444690 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1aa81b-8a22-4d92-b9d3-6a6ae1708b6d admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:47.451269 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94400642-a4c5-4e08-88e8-53cca31a5f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:47.451890 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94400642-a4c5-4e08-88e8-53cca31a5f18 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:47.452168 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94400642-a4c5-4e08-88e8-53cca31a5f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:47.452437 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94400642-a4c5-4e08-88e8-53cca31a5f18 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:47.453774 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94400642-a4c5-4e08-88e8-53cca31a5f18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:47.455469 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94400642-a4c5-4e08-88e8-53cca31a5f18 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:47.470277 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 950/1903] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:58:47 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:58:47.471562 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94400642-a4c5-4e08-88e8-53cca31a5f18 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:47.482432 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94400642-a4c5-4e08-88e8-53cca31a5f18 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:47.487087 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b1c76-cf27-4947-8e91-10aa83eb7e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:47.487724 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b1c76-cf27-4947-8e91-10aa83eb7e93 admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:47.488031 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b1c76-cf27-4947-8e91-10aa83eb7e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:47.488306 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b1c76-cf27-4947-8e91-10aa83eb7e93 admin admin] PATH_INFO: `/v3/projects/a86a71047272429fa275b787425cc3c2/users/8088c6ecb432401d85a762c6a052b2be/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:47.503679 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98b1c76-cf27-4947-8e91-10aa83eb7e93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a86a71047272429fa275b787425cc3c2, user_id=8088c6ecb432401d85a762c6a052b2be, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:47.506348 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98b1c76-cf27-4947-8e91-10aa83eb7e93 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:47.567611 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-2d7a0d22-ad59-40eb-a815-695afd11a9a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dee3f749a2134f58b198f0435ef11e0e'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:47.651798 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-2d7a0d22-ad59-40eb-a815-695afd11a9a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dee3f749a2134f58b198f0435ef11e0e'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:47.654120 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:47.654820 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-2d7a0d22-ad59-40eb-a815-695afd11a9a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dee3f749a2134f58b198f0435ef11e0e'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:47.655576 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-2d7a0d22-ad59-40eb-a815-695afd11a9a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dee3f749a2134f58b198f0435ef11e0e'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:47.661381 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 951/1904] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:58:47 2022] PUT /identity/v3/projects/a86a71047272429fa275b787425cc3c2/users/8088c6ecb432401d85a762c6a052b2be/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 19:58:47.662938 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b1c76-cf27-4947-8e91-10aa83eb7e93 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:47.664906 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-b98b1c76-cf27-4947-8e91-10aa83eb7e93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:47.688363 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-2d7a0d22-ad59-40eb-a815-695afd11a9a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dee3f749a2134f58b198f0435ef11e0e'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:47.701620 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 954/1905] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 19:58:47 2022] DELETE /identity/v3/users/dee3f749a2134f58b198f0435ef11e0e => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 19:58:47.751576 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b1c76-cf27-4947-8e91-10aa83eb7e93 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:47.833667 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa2864-26ce-4b7b-a132-7bc42788bf1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:47.834313 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa2864-26ce-4b7b-a132-7bc42788bf1b admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:47.834686 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa2864-26ce-4b7b-a132-7bc42788bf1b admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:47.835080 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa2864-26ce-4b7b-a132-7bc42788bf1b admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:47.835807 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aa2864-26ce-4b7b-a132-7bc42788bf1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:47.837538 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aa2864-26ce-4b7b-a132-7bc42788bf1b admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:47.850121 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 952/1906] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:58:47 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:58:47.854231 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a0d22-ad59-40eb-a815-695afd11a9a6 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:47.879544 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a0d22-ad59-40eb-a815-695afd11a9a6 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:47.887062 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08461e41-4eb7-476c-9247-a7db38a174f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:47.887737 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08461e41-4eb7-476c-9247-a7db38a174f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:47.888015 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08461e41-4eb7-476c-9247-a7db38a174f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:47.888284 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08461e41-4eb7-476c-9247-a7db38a174f5 admin admin] PATH_INFO: `/v3/projects/a86a71047272429fa275b787425cc3c2/users/8088c6ecb432401d85a762c6a052b2be/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:47.890580 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08461e41-4eb7-476c-9247-a7db38a174f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a86a71047272429fa275b787425cc3c2, user_id=8088c6ecb432401d85a762c6a052b2be, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:47.894670 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08461e41-4eb7-476c-9247-a7db38a174f5 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:47.915839 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 955/1907] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:58:47 2022] PUT /identity/v3/projects/a86a71047272429fa275b787425cc3c2/users/8088c6ecb432401d85a762c6a052b2be/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:47.917854 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906198d5-6a9b-4ae3-a7dd-16ab96a11a65 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:47.918152 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906198d5-6a9b-4ae3-a7dd-16ab96a11a65 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:47.918427 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906198d5-6a9b-4ae3-a7dd-16ab96a11a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:47.949022 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-906198d5-6a9b-4ae3-a7dd-16ab96a11a65 None None] MFA Rules not processed for user `8088c6ecb432401d85a762c6a052b2be`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:47.950275 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-906198d5-6a9b-4ae3-a7dd-16ab96a11a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:48.057772 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 953/1908] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:47 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:48.089786 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08461e41-4eb7-476c-9247-a7db38a174f5 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:48.089786 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-08461e41-4eb7-476c-9247-a7db38a174f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:48.161740 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08461e41-4eb7-476c-9247-a7db38a174f5 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:48.170428 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd904b-0c03-40f8-b4a3-a5277becd47c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:48.171080 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd904b-0c03-40f8-b4a3-a5277becd47c service cinder] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:48.171360 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd904b-0c03-40f8-b4a3-a5277becd47c service cinder] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:48.171555 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd904b-0c03-40f8-b4a3-a5277becd47c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:48.183255 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd904b-0c03-40f8-b4a3-a5277becd47c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:48.184725 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd904b-0c03-40f8-b4a3-a5277becd47c service cinder] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:48.199623 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 956/1909] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:58:48 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:58:48.245551 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906198d5-6a9b-4ae3-a7dd-16ab96a11a65 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:48.247315 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-906198d5-6a9b-4ae3-a7dd-16ab96a11a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:48.320098 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd904b-0c03-40f8-b4a3-a5277becd47c service cinder] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:48.331012 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd904b-0c03-40f8-b4a3-a5277becd47c service cinder] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:48.338424 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e726f44-d617-4acd-a673-1452ae13dc8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:48.338648 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906198d5-6a9b-4ae3-a7dd-16ab96a11a65 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:48.339251 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e726f44-d617-4acd-a673-1452ae13dc8b service cinder] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:48.340423 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e726f44-d617-4acd-a673-1452ae13dc8b service cinder] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:48.340423 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e726f44-d617-4acd-a673-1452ae13dc8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:48.341998 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-7e726f44-d617-4acd-a673-1452ae13dc8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:48.343475 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16254380-6650-4f16-91e2-c6972e03d598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:48.344270 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16254380-6650-4f16-91e2-c6972e03d598 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:48.344625 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16254380-6650-4f16-91e2-c6972e03d598 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:48.344884 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16254380-6650-4f16-91e2-c6972e03d598 admin admin] PATH_INFO: `/v3/projects/cab62efbad744992b7afe5170d9cd722` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:48.346243 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16254380-6650-4f16-91e2-c6972e03d598 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cab62efbad744992b7afe5170d9cd722)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:48.349256 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16254380-6650-4f16-91e2-c6972e03d598 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:48.425301 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e726f44-d617-4acd-a673-1452ae13dc8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:48.426706 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e726f44-d617-4acd-a673-1452ae13dc8b service cinder] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:48.436258 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 957/1910] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:58:48 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 19:58:48.520097 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-16254380-6650-4f16-91e2-c6972e03d598 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cab62efbad744992b7afe5170d9cd722', 'request_id': 'req-16254380-6650-4f16-91e2-c6972e03d598'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:48.563709 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:48.694494 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-16254380-6650-4f16-91e2-c6972e03d598 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cab62efbad744992b7afe5170d9cd722', 'request_id': 'req-16254380-6650-4f16-91e2-c6972e03d598'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:48.704323 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-16254380-6650-4f16-91e2-c6972e03d598 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cab62efbad744992b7afe5170d9cd722', 'request_id': 'req-16254380-6650-4f16-91e2-c6972e03d598'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:48.717272 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-16254380-6650-4f16-91e2-c6972e03d598 admin admin] The token cache is being invalidate because project cab62efbad744992b7afe5170d9cd722 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 19:58:48.717652 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-16254380-6650-4f16-91e2-c6972e03d598 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:48.718324 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-16254380-6650-4f16-91e2-c6972e03d598 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:48.720005 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 954/1911] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 19:58:48 2022] DELETE /identity/v3/projects/cab62efbad744992b7afe5170d9cd722 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:48.725436 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ddd1a-5972-4275-9d7b-f87b9cbc8a19 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:48.725759 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ddd1a-5972-4275-9d7b-f87b9cbc8a19 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:48.726102 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ddd1a-5972-4275-9d7b-f87b9cbc8a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:48.748602 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-152ddd1a-5972-4275-9d7b-f87b9cbc8a19 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:48.750813 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-152ddd1a-5972-4275-9d7b-f87b9cbc8a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:48.826279 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 958/1912] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:48.834278 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d0b6c-98f6-418b-b69d-2da837b1da9a None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:48.834578 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d0b6c-98f6-418b-b69d-2da837b1da9a None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:48.834849 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d0b6c-98f6-418b-b69d-2da837b1da9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:48.855466 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-ae3d0b6c-98f6-418b-b69d-2da837b1da9a None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:48.856676 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-ae3d0b6c-98f6-418b-b69d-2da837b1da9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:48.864859 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 955/1913] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:48.869314 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ddd1a-5972-4275-9d7b-f87b9cbc8a19 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:48.879158 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ddd1a-5972-4275-9d7b-f87b9cbc8a19 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:48.882496 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db789090-d1fe-4695-a1e1-2983e702eedc None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:48.882789 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db789090-d1fe-4695-a1e1-2983e702eedc None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:48.883064 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db789090-d1fe-4695-a1e1-2983e702eedc None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:48.885309 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149249b6-783b-40ca-8154-3a84c9e9a68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:48.885959 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 956/1914] 10.222.0.60 () {54 vars in 921 bytes} [Sat Sep 24 19:58:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:58:48.886050 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149249b6-783b-40ca-8154-3a84c9e9a68e admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:48.886254 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149249b6-783b-40ca-8154-3a84c9e9a68e admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:48.886674 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149249b6-783b-40ca-8154-3a84c9e9a68e admin admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:48.887466 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149249b6-783b-40ca-8154-3a84c9e9a68e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:58:48.887976 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149249b6-783b-40ca-8154-3a84c9e9a68e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:48.889831 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149249b6-783b-40ca-8154-3a84c9e9a68e admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:48.898284 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42a811-6ac8-4801-91b3-f75e1e956da8 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:48.898568 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42a811-6ac8-4801-91b3-f75e1e956da8 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:48.898841 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42a811-6ac8-4801-91b3-f75e1e956da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:48.904334 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 959/1915] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 19:58:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:58:48.908570 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149249b6-783b-40ca-8154-3a84c9e9a68e admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:48.919567 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149249b6-783b-40ca-8154-3a84c9e9a68e admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:48.921523 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-3b42a811-6ac8-4801-91b3-f75e1e956da8 None None] MFA Rules not processed for user `f3b5047a59bc4547be643ffa78808a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:48.922797 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-3b42a811-6ac8-4801-91b3-f75e1e956da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:48.924754 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e424894a-3000-4d14-95b1-53d58e782c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:48.925525 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e424894a-3000-4d14-95b1-53d58e782c13 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:48.925988 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e424894a-3000-4d14-95b1-53d58e782c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:48.926092 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e424894a-3000-4d14-95b1-53d58e782c13 admin admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:48.926761 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e424894a-3000-4d14-95b1-53d58e782c13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:48.937688 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e424894a-3000-4d14-95b1-53d58e782c13 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:49.039665 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 957/1916] 10.222.0.60 () {58 vars in 1018 bytes} [Sat Sep 24 19:58:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:49.070096 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b42a811-6ac8-4801-91b3-f75e1e956da8 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:49.073075 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-3b42a811-6ac8-4801-91b3-f75e1e956da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:49.083627 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 960/1917] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 19:58:48 2022] POST /identity/v3/projects => generated 375 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:58:49.089342 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e424894a-3000-4d14-95b1-53d58e782c13 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:49.091276 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b42a811-6ac8-4801-91b3-f75e1e956da8 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:49.202686 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf4a1a-3873-4e09-9815-347a9cb061a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5047a59bc4547be643ffa78808a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:49.204019 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf4a1a-3873-4e09-9815-347a9cb061a6 service nova] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:49.207331 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf4a1a-3873-4e09-9815-347a9cb061a6 service nova] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:49.207331 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf4a1a-3873-4e09-9815-347a9cb061a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:49.209973 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e424894a-3000-4d14-95b1-53d58e782c13 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:49.216365 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8024c032-3fe6-498b-aadd-621031b2a7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:49.217648 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024c032-3fe6-498b-aadd-621031b2a7a6 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:49.217648 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024c032-3fe6-498b-aadd-621031b2a7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:49.218689 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024c032-3fe6-498b-aadd-621031b2a7a6 admin admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:49.219745 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8024c032-3fe6-498b-aadd-621031b2a7a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:49.221107 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdf4a1a-3873-4e09-9815-347a9cb061a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:49.222560 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8024c032-3fe6-498b-aadd-621031b2a7a6 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:49.223078 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdf4a1a-3873-4e09-9815-347a9cb061a6 service nova] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:49.238091 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 958/1918] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:58:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:58:49.358067 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 961/1919] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:58:49 2022] POST /identity/v3/users => generated 288 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:58:49.370495 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf4a1a-3873-4e09-9815-347a9cb061a6 service nova] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:49.393040 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf4a1a-3873-4e09-9815-347a9cb061a6 service nova] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:49.426251 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90850c5b-10f3-4bd0-85c0-c86eaae3ddf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:49.426886 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90850c5b-10f3-4bd0-85c0-c86eaae3ddf7 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:49.427170 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90850c5b-10f3-4bd0-85c0-c86eaae3ddf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:49.427453 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90850c5b-10f3-4bd0-85c0-c86eaae3ddf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:49.434259 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90850c5b-10f3-4bd0-85c0-c86eaae3ddf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:49.435980 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90850c5b-10f3-4bd0-85c0-c86eaae3ddf7 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:49.474005 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 959/1920] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:58:49.478235 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8024c032-3fe6-498b-aadd-621031b2a7a6 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:49.501662 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8024c032-3fe6-498b-aadd-621031b2a7a6 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:49.510034 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d8683-da90-46f2-be83-bf66dda52332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:49.511142 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d8683-da90-46f2-be83-bf66dda52332 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:49.511504 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d8683-da90-46f2-be83-bf66dda52332 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:49.511855 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d8683-da90-46f2-be83-bf66dda52332 admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:49.513333 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47d8683-da90-46f2-be83-bf66dda52332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:49.515578 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47d8683-da90-46f2-be83-bf66dda52332 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:49.533538 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 962/1921] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:58:49.536741 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90850c5b-10f3-4bd0-85c0-c86eaae3ddf7 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:49.551931 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90850c5b-10f3-4bd0-85c0-c86eaae3ddf7 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:49.589782 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7fc7e2-06d0-4344-8c2d-a259cb3fd03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:49.590673 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7fc7e2-06d0-4344-8c2d-a259cb3fd03c admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:49.590962 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7fc7e2-06d0-4344-8c2d-a259cb3fd03c admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:49.591243 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7fc7e2-06d0-4344-8c2d-a259cb3fd03c admin admin] PATH_INFO: `/v3/projects/c6b74a17c07f4b14bac10889d8fac1cb/users/9ffb3c89e8bd4143ab87bd38191d9f3c/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:49.627132 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7fc7e2-06d0-4344-8c2d-a259cb3fd03c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6b74a17c07f4b14bac10889d8fac1cb, user_id=9ffb3c89e8bd4143ab87bd38191d9f3c, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:49.630611 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7fc7e2-06d0-4344-8c2d-a259cb3fd03c admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:49.721535 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 960/1922] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:58:49 2022] PUT /identity/v3/projects/c6b74a17c07f4b14bac10889d8fac1cb/users/9ffb3c89e8bd4143ab87bd38191d9f3c/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:49.726980 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6a9f8-82de-4676-9345-b282f85f35f7 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:49.727268 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6a9f8-82de-4676-9345-b282f85f35f7 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:49.727544 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6a9f8-82de-4676-9345-b282f85f35f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:49.780721 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-42f6a9f8-82de-4676-9345-b282f85f35f7 None None] MFA Rules not processed for user `9ffb3c89e8bd4143ab87bd38191d9f3c`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:49.782251 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-42f6a9f8-82de-4676-9345-b282f85f35f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:49.880715 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 963/1923] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:49.886197 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7fc7e2-06d0-4344-8c2d-a259cb3fd03c admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:49.959073 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7fc7e2-06d0-4344-8c2d-a259cb3fd03c admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:49.965816 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b27e8-1479-4414-a7ba-f7b953cca5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:49.966927 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b27e8-1479-4414-a7ba-f7b953cca5a8 admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:49.967490 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b27e8-1479-4414-a7ba-f7b953cca5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:49.968230 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b27e8-1479-4414-a7ba-f7b953cca5a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:49.969171 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b27e8-1479-4414-a7ba-f7b953cca5a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:49.972223 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b27e8-1479-4414-a7ba-f7b953cca5a8 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:50.004529 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f6a9f8-82de-4676-9345-b282f85f35f7 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:50.006509 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-42f6a9f8-82de-4676-9345-b282f85f35f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:50.021688 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f6a9f8-82de-4676-9345-b282f85f35f7 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:50.026403 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521ee10-545b-4c77-9540-f4f3e797c1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:50.027041 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521ee10-545b-4c77-9540-f4f3e797c1a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:50.027317 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521ee10-545b-4c77-9540-f4f3e797c1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:50.027617 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521ee10-545b-4c77-9540-f4f3e797c1a2 admin admin] PATH_INFO: `/v3/users/bb6291fd49f54072920c608aa5ede0fb` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:50.030667 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2521ee10-545b-4c77-9540-f4f3e797c1a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb6291fd49f54072920c608aa5ede0fb)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:50.030768 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2521ee10-545b-4c77-9540-f4f3e797c1a2 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:50.048704 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:50.095964 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 961/1924] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 19:58:49 2022] POST /identity/v3/projects => generated 373 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:58:50.096945 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b27e8-1479-4414-a7ba-f7b953cca5a8 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:50.165447 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b27e8-1479-4414-a7ba-f7b953cca5a8 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:50.170986 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcbb1fe-807e-465d-996f-014a1d78a521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:50.171589 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcbb1fe-807e-465d-996f-014a1d78a521 admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:50.171871 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcbb1fe-807e-465d-996f-014a1d78a521 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:50.172164 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcbb1fe-807e-465d-996f-014a1d78a521 admin admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:50.172790 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcbb1fe-807e-465d-996f-014a1d78a521 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:50.174837 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcbb1fe-807e-465d-996f-014a1d78a521 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:50.285008 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-2521ee10-545b-4c77-9540-f4f3e797c1a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb6291fd49f54072920c608aa5ede0fb'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:50.301100 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 962/1925] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:58:50 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 19:58:50.304871 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcbb1fe-807e-465d-996f-014a1d78a521 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:50.315035 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcbb1fe-807e-465d-996f-014a1d78a521 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:50.319597 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef43c8-3a84-49ac-9286-b61049739017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:50.320179 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef43c8-3a84-49ac-9286-b61049739017 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:50.320458 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef43c8-3a84-49ac-9286-b61049739017 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:50.320731 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef43c8-3a84-49ac-9286-b61049739017 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:50.321365 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef43c8-3a84-49ac-9286-b61049739017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:50.323802 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef43c8-3a84-49ac-9286-b61049739017 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:50.334058 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 963/1926] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:58:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 19:58:50.341206 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef43c8-3a84-49ac-9286-b61049739017 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:50.350506 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef43c8-3a84-49ac-9286-b61049739017 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:50.355555 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6064d9be-0fbb-4adf-a4bc-48bc11b675fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:50.356219 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064d9be-0fbb-4adf-a4bc-48bc11b675fd admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:50.356499 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064d9be-0fbb-4adf-a4bc-48bc11b675fd admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:50.356770 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064d9be-0fbb-4adf-a4bc-48bc11b675fd admin admin] PATH_INFO: `/v3/projects/bb1b2e9e8f4040c2a885a7e13f2276c0/users/426d0c025fa2408f804b6e4a8b63b2d3/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:50.358059 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-2521ee10-545b-4c77-9540-f4f3e797c1a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb6291fd49f54072920c608aa5ede0fb'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:50.360677 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-2521ee10-545b-4c77-9540-f4f3e797c1a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb6291fd49f54072920c608aa5ede0fb'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:50.360677 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-2521ee10-545b-4c77-9540-f4f3e797c1a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb6291fd49f54072920c608aa5ede0fb'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:50.372267 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6064d9be-0fbb-4adf-a4bc-48bc11b675fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb1b2e9e8f4040c2a885a7e13f2276c0, user_id=426d0c025fa2408f804b6e4a8b63b2d3, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:50.374987 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6064d9be-0fbb-4adf-a4bc-48bc11b675fd admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:50.391894 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-2521ee10-545b-4c77-9540-f4f3e797c1a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb6291fd49f54072920c608aa5ede0fb'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:50.408553 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 964/1927] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 19:58:50 2022] DELETE /identity/v3/users/bb6291fd49f54072920c608aa5ede0fb => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 19:58:50.412798 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0798c-070d-401b-bd8a-0ebc885d7e96 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:50.413217 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0798c-070d-401b-bd8a-0ebc885d7e96 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:50.413516 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0798c-070d-401b-bd8a-0ebc885d7e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:50.434847 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-f8b0798c-070d-401b-bd8a-0ebc885d7e96 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:50.436075 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-f8b0798c-070d-401b-bd8a-0ebc885d7e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:50.458549 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 964/1928] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:58:50 2022] PUT /identity/v3/projects/bb1b2e9e8f4040c2a885a7e13f2276c0/users/426d0c025fa2408f804b6e4a8b63b2d3/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 19:58:50.463503 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6064d9be-0fbb-4adf-a4bc-48bc11b675fd admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:50.465363 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-6064d9be-0fbb-4adf-a4bc-48bc11b675fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:50.523447 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 965/1929] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:50.533662 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b0798c-070d-401b-bd8a-0ebc885d7e96 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:50.537354 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-f8b0798c-070d-401b-bd8a-0ebc885d7e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:50.560221 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6064d9be-0fbb-4adf-a4bc-48bc11b675fd admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:50.566403 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93962c96-30ec-4b88-868d-cffb5ad147a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:50.567626 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93962c96-30ec-4b88-868d-cffb5ad147a2 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:50.567934 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93962c96-30ec-4b88-868d-cffb5ad147a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:50.568220 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93962c96-30ec-4b88-868d-cffb5ad147a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:50.569170 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93962c96-30ec-4b88-868d-cffb5ad147a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:50.588542 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93962c96-30ec-4b88-868d-cffb5ad147a2 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:50.588542 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 965/1930] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:58:50 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:58:50.593055 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93962c96-30ec-4b88-868d-cffb5ad147a2 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:50.603579 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93962c96-30ec-4b88-868d-cffb5ad147a2 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:50.608228 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c8086-29f8-4133-89dc-a6e59ab15c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:50.609025 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c8086-29f8-4133-89dc-a6e59ab15c77 admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:50.609217 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c8086-29f8-4133-89dc-a6e59ab15c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:50.609514 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c8086-29f8-4133-89dc-a6e59ab15c77 admin admin] PATH_INFO: `/v3/projects/bb1b2e9e8f4040c2a885a7e13f2276c0/users/426d0c025fa2408f804b6e4a8b63b2d3/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:50.611455 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093c8086-29f8-4133-89dc-a6e59ab15c77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb1b2e9e8f4040c2a885a7e13f2276c0, user_id=426d0c025fa2408f804b6e4a8b63b2d3, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:50.612211 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b0798c-070d-401b-bd8a-0ebc885d7e96 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:50.614266 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093c8086-29f8-4133-89dc-a6e59ab15c77 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:50.657579 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 966/1931] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:58:50 2022] PUT /identity/v3/projects/bb1b2e9e8f4040c2a885a7e13f2276c0/users/426d0c025fa2408f804b6e4a8b63b2d3/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 19:58:50.657579 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c8086-29f8-4133-89dc-a6e59ab15c77 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:50.657579 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-093c8086-29f8-4133-89dc-a6e59ab15c77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:50.682724 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4b5ae-45d1-4f93-b7a2-20fea794961e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:50.683361 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4b5ae-45d1-4f93-b7a2-20fea794961e service neutron] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:50.683643 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4b5ae-45d1-4f93-b7a2-20fea794961e service neutron] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:50.683964 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4b5ae-45d1-4f93-b7a2-20fea794961e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:50.695390 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e4b5ae-45d1-4f93-b7a2-20fea794961e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:50.697176 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e4b5ae-45d1-4f93-b7a2-20fea794961e service neutron] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:50.708864 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 966/1932] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:58:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:58:50.710170 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100db45a-dec2-4759-a57e-fcd2d4e1a73c None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:50.710449 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100db45a-dec2-4759-a57e-fcd2d4e1a73c None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:50.710718 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100db45a-dec2-4759-a57e-fcd2d4e1a73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:50.763164 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-100db45a-dec2-4759-a57e-fcd2d4e1a73c None None] MFA Rules not processed for user `426d0c025fa2408f804b6e4a8b63b2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:50.767975 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-100db45a-dec2-4759-a57e-fcd2d4e1a73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:50.788123 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c8086-29f8-4133-89dc-a6e59ab15c77 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:50.795669 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e561943-cccc-4561-86e2-0625602903ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:50.796547 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e561943-cccc-4561-86e2-0625602903ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:50.797022 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e561943-cccc-4561-86e2-0625602903ee admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:50.797474 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e561943-cccc-4561-86e2-0625602903ee admin admin] PATH_INFO: `/v3/users/0a0f1c1bc9a74d23a5b703b083e0d197` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:50.799434 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e561943-cccc-4561-86e2-0625602903ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a0f1c1bc9a74d23a5b703b083e0d197)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:50.801558 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e561943-cccc-4561-86e2-0625602903ee admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:50.946351 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 967/1933] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:50 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:50.965728 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100db45a-dec2-4759-a57e-fcd2d4e1a73c None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:50.967981 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-100db45a-dec2-4759-a57e-fcd2d4e1a73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:51.034390 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-7e561943-cccc-4561-86e2-0625602903ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a0f1c1bc9a74d23a5b703b083e0d197'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:51.051197 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100db45a-dec2-4759-a57e-fcd2d4e1a73c None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:51.055926 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b91db60-31a9-4580-a75c-3fe2c5268b55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:51.057472 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b91db60-31a9-4580-a75c-3fe2c5268b55 service cinder] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:51.057472 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b91db60-31a9-4580-a75c-3fe2c5268b55 service cinder] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:51.059742 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b91db60-31a9-4580-a75c-3fe2c5268b55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:51.060368 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-8b91db60-31a9-4580-a75c-3fe2c5268b55 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:51.113686 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-7e561943-cccc-4561-86e2-0625602903ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a0f1c1bc9a74d23a5b703b083e0d197'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:51.115519 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-7e561943-cccc-4561-86e2-0625602903ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a0f1c1bc9a74d23a5b703b083e0d197'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:51.136923 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-7e561943-cccc-4561-86e2-0625602903ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a0f1c1bc9a74d23a5b703b083e0d197'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:51.137982 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-7e561943-cccc-4561-86e2-0625602903ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a0f1c1bc9a74d23a5b703b083e0d197'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:51.155862 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 967/1934] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 19:58:50 2022] DELETE /identity/v3/users/0a0f1c1bc9a74d23a5b703b083e0d197 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 19:58:51.159057 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b91db60-31a9-4580-a75c-3fe2c5268b55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:51.159057 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b91db60-31a9-4580-a75c-3fe2c5268b55 service cinder] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:51.161981 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2705968-fb25-4f89-891c-02813f177420 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:51.162271 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2705968-fb25-4f89-891c-02813f177420 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:51.162548 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2705968-fb25-4f89-891c-02813f177420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:51.169190 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 968/1935] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:58:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:58:51.192549 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-e2705968-fb25-4f89-891c-02813f177420 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:51.193822 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-e2705968-fb25-4f89-891c-02813f177420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:51.263378 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 968/1936] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:58:51.276391 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b91db60-31a9-4580-a75c-3fe2c5268b55 service cinder] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:51.314914 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=81,keystone:DELETE=14,keystone:INSERT=5 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:51.324209 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2705968-fb25-4f89-891c-02813f177420 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:51.325776 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-e2705968-fb25-4f89-891c-02813f177420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:51.346807 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2705968-fb25-4f89-891c-02813f177420 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:51.354148 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b91db60-31a9-4580-a75c-3fe2c5268b55 service cinder] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:51.356830 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c84e4-4079-41cf-8ea6-1cf7f449680f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:51.358929 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c84e4-4079-41cf-8ea6-1cf7f449680f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:51.359211 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c84e4-4079-41cf-8ea6-1cf7f449680f admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:51.359489 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c84e4-4079-41cf-8ea6-1cf7f449680f admin admin] PATH_INFO: `/v3/projects/49f27f9db5e1423ba947335100d4b811` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:51.361205 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c84e4-4079-41cf-8ea6-1cf7f449680f admin admin] RBAC: Authorizing `identity:delete_project(project_id=49f27f9db5e1423ba947335100d4b811)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:51.365300 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c84e4-4079-41cf-8ea6-1cf7f449680f admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:51.411753 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6d6ab-67af-45e8-adf3-f174d86a3f61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:51.412379 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6d6ab-67af-45e8-adf3-f174d86a3f61 service neutron] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:51.412653 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6d6ab-67af-45e8-adf3-f174d86a3f61 service neutron] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:51.412925 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6d6ab-67af-45e8-adf3-f174d86a3f61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:51.422319 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f6d6ab-67af-45e8-adf3-f174d86a3f61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:51.423762 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f6d6ab-67af-45e8-adf3-f174d86a3f61 service neutron] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:51.434609 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 969/1937] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:58:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:58:51.474403 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-3b2c84e4-4079-41cf-8ea6-1cf7f449680f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49f27f9db5e1423ba947335100d4b811', 'request_id': 'req-3b2c84e4-4079-41cf-8ea6-1cf7f449680f'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:51.576171 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-3b2c84e4-4079-41cf-8ea6-1cf7f449680f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49f27f9db5e1423ba947335100d4b811', 'request_id': 'req-3b2c84e4-4079-41cf-8ea6-1cf7f449680f'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:51.582506 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-3b2c84e4-4079-41cf-8ea6-1cf7f449680f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49f27f9db5e1423ba947335100d4b811', 'request_id': 'req-3b2c84e4-4079-41cf-8ea6-1cf7f449680f'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:51.594469 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-3b2c84e4-4079-41cf-8ea6-1cf7f449680f admin admin] The token cache is being invalidate because project 49f27f9db5e1423ba947335100d4b811 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 19:58:51.594760 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-3b2c84e4-4079-41cf-8ea6-1cf7f449680f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:51.595434 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-3b2c84e4-4079-41cf-8ea6-1cf7f449680f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:51.596972 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 969/1938] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 19:58:51 2022] DELETE /identity/v3/projects/49f27f9db5e1423ba947335100d4b811 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 19:58:51.601089 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6d6ab-67af-45e8-adf3-f174d86a3f61 service neutron] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:51.612865 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6d6ab-67af-45e8-adf3-f174d86a3f61 service neutron] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:51.693571 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d337f-d94d-4ace-9a0c-8fcf28ff843f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:51.694402 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d337f-d94d-4ace-9a0c-8fcf28ff843f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:51.694830 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d337f-d94d-4ace-9a0c-8fcf28ff843f admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:51.695611 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d337f-d94d-4ace-9a0c-8fcf28ff843f admin admin] PATH_INFO: `/v3/users/e4b32b04609947fd9a3f0947bdc4b088` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:51.697024 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d337f-d94d-4ace-9a0c-8fcf28ff843f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4b32b04609947fd9a3f0947bdc4b088)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:51.700328 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d337f-d94d-4ace-9a0c-8fcf28ff843f admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:51.880853 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c84e4-4079-41cf-8ea6-1cf7f449680f admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:51.882511 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-3b2c84e4-4079-41cf-8ea6-1cf7f449680f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:51.907111 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c84e4-4079-41cf-8ea6-1cf7f449680f admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:51.911900 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74974cdd-3db9-4a35-be75-3811ab6b6c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:51.912546 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74974cdd-3db9-4a35-be75-3811ab6b6c92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:51.912824 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74974cdd-3db9-4a35-be75-3811ab6b6c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:51.913092 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74974cdd-3db9-4a35-be75-3811ab6b6c92 admin admin] PATH_INFO: `/v3/projects/1784f3a2dd2a4183819fb4a97984fce7` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:51.914231 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74974cdd-3db9-4a35-be75-3811ab6b6c92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1784f3a2dd2a4183819fb4a97984fce7)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:51.917322 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74974cdd-3db9-4a35-be75-3811ab6b6c92 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:51.958109 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-6a2d337f-d94d-4ace-9a0c-8fcf28ff843f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4b32b04609947fd9a3f0947bdc4b088'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:52.025578 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-6a2d337f-d94d-4ace-9a0c-8fcf28ff843f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4b32b04609947fd9a3f0947bdc4b088'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:52.026468 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-6a2d337f-d94d-4ace-9a0c-8fcf28ff843f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4b32b04609947fd9a3f0947bdc4b088'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:52.027211 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-6a2d337f-d94d-4ace-9a0c-8fcf28ff843f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4b32b04609947fd9a3f0947bdc4b088'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:52.040731 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-6a2d337f-d94d-4ace-9a0c-8fcf28ff843f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4b32b04609947fd9a3f0947bdc4b088'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:52.049954 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-74974cdd-3db9-4a35-be75-3811ab6b6c92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1784f3a2dd2a4183819fb4a97984fce7', 'request_id': 'req-74974cdd-3db9-4a35-be75-3811ab6b6c92'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:52.057545 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 970/1939] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 19:58:51 2022] DELETE /identity/v3/users/e4b32b04609947fd9a3f0947bdc4b088 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 19:58:52.176308 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-74974cdd-3db9-4a35-be75-3811ab6b6c92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1784f3a2dd2a4183819fb4a97984fce7', 'request_id': 'req-74974cdd-3db9-4a35-be75-3811ab6b6c92'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:52.188653 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-74974cdd-3db9-4a35-be75-3811ab6b6c92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1784f3a2dd2a4183819fb4a97984fce7', 'request_id': 'req-74974cdd-3db9-4a35-be75-3811ab6b6c92'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:52.221094 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-74974cdd-3db9-4a35-be75-3811ab6b6c92 admin admin] The token cache is being invalidate because project 1784f3a2dd2a4183819fb4a97984fce7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 19:58:52.221399 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-74974cdd-3db9-4a35-be75-3811ab6b6c92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:52.222148 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-74974cdd-3db9-4a35-be75-3811ab6b6c92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:52.226273 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 970/1940] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 19:58:51 2022] DELETE /identity/v3/projects/1784f3a2dd2a4183819fb4a97984fce7 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 19:58:52.229585 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d337f-d94d-4ace-9a0c-8fcf28ff843f admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:52.231011 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-6a2d337f-d94d-4ace-9a0c-8fcf28ff843f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:52.301174 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d337f-d94d-4ace-9a0c-8fcf28ff843f admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:52.305882 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93dec90-24c3-46f8-bb6f-9a909c40c7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:52.307076 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93dec90-24c3-46f8-bb6f-9a909c40c7f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:52.307528 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93dec90-24c3-46f8-bb6f-9a909c40c7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:52.307805 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93dec90-24c3-46f8-bb6f-9a909c40c7f6 admin admin] PATH_INFO: `/v3/users/1c21dcc619554f1d99573fcb12d3bb50` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:52.308939 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93dec90-24c3-46f8-bb6f-9a909c40c7f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c21dcc619554f1d99573fcb12d3bb50)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:52.310914 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93dec90-24c3-46f8-bb6f-9a909c40c7f6 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:52.507340 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-b93dec90-24c3-46f8-bb6f-9a909c40c7f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c21dcc619554f1d99573fcb12d3bb50'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:52.622538 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-b93dec90-24c3-46f8-bb6f-9a909c40c7f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c21dcc619554f1d99573fcb12d3bb50'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:52.623332 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-b93dec90-24c3-46f8-bb6f-9a909c40c7f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c21dcc619554f1d99573fcb12d3bb50'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:52.624176 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-b93dec90-24c3-46f8-bb6f-9a909c40c7f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c21dcc619554f1d99573fcb12d3bb50'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:52.631665 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74974cdd-3db9-4a35-be75-3811ab6b6c92 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:52.632999 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-74974cdd-3db9-4a35-be75-3811ab6b6c92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:52.639075 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-b93dec90-24c3-46f8-bb6f-9a909c40c7f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c21dcc619554f1d99573fcb12d3bb50'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:52.661725 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 971/1941] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 19:58:52 2022] DELETE /identity/v3/users/1c21dcc619554f1d99573fcb12d3bb50 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:52.729223 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74974cdd-3db9-4a35-be75-3811ab6b6c92 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:52.786074 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2cffa-484f-4fc8-aacd-f29807ff0adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:52.786713 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2cffa-484f-4fc8-aacd-f29807ff0adc admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:52.786997 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2cffa-484f-4fc8-aacd-f29807ff0adc admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:52.787273 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2cffa-484f-4fc8-aacd-f29807ff0adc admin admin] PATH_INFO: `/v3/projects/ed02534e46e5477e91f8c94ed04bb66b` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:52.788415 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a2cffa-484f-4fc8-aacd-f29807ff0adc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed02534e46e5477e91f8c94ed04bb66b)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:52.790358 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a2cffa-484f-4fc8-aacd-f29807ff0adc admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:52.956932 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-16a2cffa-484f-4fc8-aacd-f29807ff0adc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed02534e46e5477e91f8c94ed04bb66b', 'request_id': 'req-16a2cffa-484f-4fc8-aacd-f29807ff0adc'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:53.048921 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:53.079196 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-16a2cffa-484f-4fc8-aacd-f29807ff0adc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed02534e46e5477e91f8c94ed04bb66b', 'request_id': 'req-16a2cffa-484f-4fc8-aacd-f29807ff0adc'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:53.093077 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-16a2cffa-484f-4fc8-aacd-f29807ff0adc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed02534e46e5477e91f8c94ed04bb66b', 'request_id': 'req-16a2cffa-484f-4fc8-aacd-f29807ff0adc'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:53.105059 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-16a2cffa-484f-4fc8-aacd-f29807ff0adc admin admin] The token cache is being invalidate because project ed02534e46e5477e91f8c94ed04bb66b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 19:58:53.105463 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-16a2cffa-484f-4fc8-aacd-f29807ff0adc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:53.106332 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-16a2cffa-484f-4fc8-aacd-f29807ff0adc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:53.108277 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 971/1942] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 19:58:52 2022] DELETE /identity/v3/projects/ed02534e46e5477e91f8c94ed04bb66b => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 19:58:53.113060 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab217765-7455-427b-b261-772035c59a62 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:53.113340 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab217765-7455-427b-b261-772035c59a62 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:53.113640 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab217765-7455-427b-b261-772035c59a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:53.134250 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-ab217765-7455-427b-b261-772035c59a62 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:53.135641 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-ab217765-7455-427b-b261-772035c59a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:53.193755 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 972/1943] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:58:53.202876 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190bb6aa-3b4a-46af-aff1-a70b752b25c9 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:53.203212 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190bb6aa-3b4a-46af-aff1-a70b752b25c9 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:53.203683 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190bb6aa-3b4a-46af-aff1-a70b752b25c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:53.223588 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-190bb6aa-3b4a-46af-aff1-a70b752b25c9 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:53.224762 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-190bb6aa-3b4a-46af-aff1-a70b752b25c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:53.233572 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 972/1944] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:53.237768 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab217765-7455-427b-b261-772035c59a62 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:53.248523 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab217765-7455-427b-b261-772035c59a62 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:53.253368 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec3e4c-729b-49c2-8e02-a249d1a060b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:53.254018 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec3e4c-729b-49c2-8e02-a249d1a060b5 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:53.254372 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec3e4c-729b-49c2-8e02-a249d1a060b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:53.254632 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec3e4c-729b-49c2-8e02-a249d1a060b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:53.255316 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ec3e4c-729b-49c2-8e02-a249d1a060b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:58:53.255746 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ec3e4c-729b-49c2-8e02-a249d1a060b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:53.257432 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ec3e4c-729b-49c2-8e02-a249d1a060b5 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:53.271550 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 973/1945] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 19:58:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:58:53.276585 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190bb6aa-3b4a-46af-aff1-a70b752b25c9 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:53.286020 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190bb6aa-3b4a-46af-aff1-a70b752b25c9 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:53.291366 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c715cf3-ccb9-457b-a090-175c96545ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:53.291977 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c715cf3-ccb9-457b-a090-175c96545ab6 admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:53.292257 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c715cf3-ccb9-457b-a090-175c96545ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:53.292535 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c715cf3-ccb9-457b-a090-175c96545ab6 admin admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:53.293186 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c715cf3-ccb9-457b-a090-175c96545ab6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:53.295532 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c715cf3-ccb9-457b-a090-175c96545ab6 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:53.318629 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec3e4c-729b-49c2-8e02-a249d1a060b5 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:53.322821 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-c7ec3e4c-729b-49c2-8e02-a249d1a060b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:53.346683 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec3e4c-729b-49c2-8e02-a249d1a060b5 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:53.352757 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35591fc3-63c6-44cd-a56b-6b3a8f74fa30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:53.354670 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35591fc3-63c6-44cd-a56b-6b3a8f74fa30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:53.355153 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35591fc3-63c6-44cd-a56b-6b3a8f74fa30 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:53.355304 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35591fc3-63c6-44cd-a56b-6b3a8f74fa30 admin admin] PATH_INFO: `/v3/projects/cf70c62c717344c293df44f3cb98c1cd` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:53.356594 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35591fc3-63c6-44cd-a56b-6b3a8f74fa30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf70c62c717344c293df44f3cb98c1cd)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:53.359507 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35591fc3-63c6-44cd-a56b-6b3a8f74fa30 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:53.442505 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 973/1946] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 19:58:53 2022] POST /identity/v3/projects => generated 383 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:58:53.446228 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c715cf3-ccb9-457b-a090-175c96545ab6 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:53.545273 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c715cf3-ccb9-457b-a090-175c96545ab6 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:53.553665 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-35591fc3-63c6-44cd-a56b-6b3a8f74fa30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf70c62c717344c293df44f3cb98c1cd', 'request_id': 'req-35591fc3-63c6-44cd-a56b-6b3a8f74fa30'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:53.561046 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-35591fc3-63c6-44cd-a56b-6b3a8f74fa30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf70c62c717344c293df44f3cb98c1cd', 'request_id': 'req-35591fc3-63c6-44cd-a56b-6b3a8f74fa30'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:53.608361 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8710f5da-2fc8-4b46-b373-dd2b002f382b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:53.609157 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8710f5da-2fc8-4b46-b373-dd2b002f382b admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:53.609525 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8710f5da-2fc8-4b46-b373-dd2b002f382b admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:53.609866 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8710f5da-2fc8-4b46-b373-dd2b002f382b admin admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:53.610564 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8710f5da-2fc8-4b46-b373-dd2b002f382b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:53.612498 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8710f5da-2fc8-4b46-b373-dd2b002f382b admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:53.701874 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-35591fc3-63c6-44cd-a56b-6b3a8f74fa30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf70c62c717344c293df44f3cb98c1cd', 'request_id': 'req-35591fc3-63c6-44cd-a56b-6b3a8f74fa30'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:53.713365 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-35591fc3-63c6-44cd-a56b-6b3a8f74fa30 admin admin] The token cache is being invalidate because project cf70c62c717344c293df44f3cb98c1cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 19:58:53.713695 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-35591fc3-63c6-44cd-a56b-6b3a8f74fa30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:53.714352 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-35591fc3-63c6-44cd-a56b-6b3a8f74fa30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:53.715859 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 974/1947] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 19:58:53 2022] DELETE /identity/v3/projects/cf70c62c717344c293df44f3cb98c1cd => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:53.720432 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259839c-40a9-4730-99f9-bfe77f75fbca None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:53.720712 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259839c-40a9-4730-99f9-bfe77f75fbca None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:53.720979 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259839c-40a9-4730-99f9-bfe77f75fbca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:53.739298 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 974/1948] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:58:53 2022] POST /identity/v3/users => generated 292 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 19:58:53.743423 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8710f5da-2fc8-4b46-b373-dd2b002f382b admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:53.744572 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-9259839c-40a9-4730-99f9-bfe77f75fbca None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:53.745899 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-8710f5da-2fc8-4b46-b373-dd2b002f382b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:53.746027 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-9259839c-40a9-4730-99f9-bfe77f75fbca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:53.756761 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 975/1949] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:58:53.759578 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8710f5da-2fc8-4b46-b373-dd2b002f382b admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:53.767150 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e2945-847b-44c4-a621-c38c41f2d2c0 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:53.767440 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e2945-847b-44c4-a621-c38c41f2d2c0 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:53.767713 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e2945-847b-44c4-a621-c38c41f2d2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:53.770130 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff64ea23-5556-4a31-a973-f72b5d510a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:53.770953 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64ea23-5556-4a31-a973-f72b5d510a59 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:53.771267 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64ea23-5556-4a31-a973-f72b5d510a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:53.771541 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64ea23-5556-4a31-a973-f72b5d510a59 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:53.772192 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff64ea23-5556-4a31-a973-f72b5d510a59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:53.773955 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff64ea23-5556-4a31-a973-f72b5d510a59 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:53.787177 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 975/1950] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:58:53 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:58:53.788473 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-ea0e2945-847b-44c4-a621-c38c41f2d2c0 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:53.791486 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-ea0e2945-847b-44c4-a621-c38c41f2d2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:53.792168 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff64ea23-5556-4a31-a973-f72b5d510a59 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:53.798744 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 976/1951] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:58:53.802963 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff64ea23-5556-4a31-a973-f72b5d510a59 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:53.803661 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0e2945-847b-44c4-a621-c38c41f2d2c0 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:53.807927 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7233a7bc-b4e2-4b77-a60f-28253c03c49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:53.808533 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233a7bc-b4e2-4b77-a60f-28253c03c49d admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:53.808809 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233a7bc-b4e2-4b77-a60f-28253c03c49d admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:53.809082 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233a7bc-b4e2-4b77-a60f-28253c03c49d admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:53.809784 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7233a7bc-b4e2-4b77-a60f-28253c03c49d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:53.811381 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7233a7bc-b4e2-4b77-a60f-28253c03c49d admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:53.814267 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0e2945-847b-44c4-a621-c38c41f2d2c0 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:53.822195 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab6ab07-2e57-4da8-94cf-05ef6ed62b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:53.822884 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab6ab07-2e57-4da8-94cf-05ef6ed62b05 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:53.823353 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 976/1952] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:58:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 19:58:53.825746 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab6ab07-2e57-4da8-94cf-05ef6ed62b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:53.827534 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab6ab07-2e57-4da8-94cf-05ef6ed62b05 admin admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:53.827758 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7233a7bc-b4e2-4b77-a60f-28253c03c49d admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:53.828316 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab6ab07-2e57-4da8-94cf-05ef6ed62b05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:58:53.828654 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab6ab07-2e57-4da8-94cf-05ef6ed62b05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:53.830331 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab6ab07-2e57-4da8-94cf-05ef6ed62b05 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:53.839401 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7233a7bc-b4e2-4b77-a60f-28253c03c49d admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:53.845021 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2373441-b52d-4705-8df6-30384227ed5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:53.845798 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2373441-b52d-4705-8df6-30384227ed5b admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:53.846242 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2373441-b52d-4705-8df6-30384227ed5b admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:53.846517 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2373441-b52d-4705-8df6-30384227ed5b admin admin] PATH_INFO: `/v3/projects/25ad6cd861064bdb9de552d8a9d88089/users/c7aa895b68cd401f91e3953d61a50626/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:53.847598 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 977/1953] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 19:58:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:58:53.852758 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab6ab07-2e57-4da8-94cf-05ef6ed62b05 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:53.864197 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab6ab07-2e57-4da8-94cf-05ef6ed62b05 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:53.868691 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2373441-b52d-4705-8df6-30384227ed5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=25ad6cd861064bdb9de552d8a9d88089, user_id=c7aa895b68cd401f91e3953d61a50626, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:53.870599 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cbde04-2181-465f-bc20-73f6a170d006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:53.878804 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbde04-2181-465f-bc20-73f6a170d006 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:53.878804 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbde04-2181-465f-bc20-73f6a170d006 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:53.878804 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbde04-2181-465f-bc20-73f6a170d006 admin admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:53.879070 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2373441-b52d-4705-8df6-30384227ed5b admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:53.879156 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cbde04-2181-465f-bc20-73f6a170d006 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:53.879156 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cbde04-2181-465f-bc20-73f6a170d006 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:53.976064 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 978/1954] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 19:58:53 2022] POST /identity/v3/projects => generated 385 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 19:58:53.980044 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cbde04-2181-465f-bc20-73f6a170d006 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:53.981240 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 977/1955] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:58:53 2022] PUT /identity/v3/projects/25ad6cd861064bdb9de552d8a9d88089/users/c7aa895b68cd401f91e3953d61a50626/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 19:58:53.997548 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30898b1e-247b-4310-9265-2c68bc107c25 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:53.997877 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30898b1e-247b-4310-9265-2c68bc107c25 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:53.998357 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30898b1e-247b-4310-9265-2c68bc107c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:54.041640 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-30898b1e-247b-4310-9265-2c68bc107c25 None None] MFA Rules not processed for user `c7aa895b68cd401f91e3953d61a50626`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:54.042883 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-30898b1e-247b-4310-9265-2c68bc107c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:54.066047 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cbde04-2181-465f-bc20-73f6a170d006 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:54.072313 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae953ad-1d16-4366-94b1-25f2f897a4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:54.073712 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae953ad-1d16-4366-94b1-25f2f897a4ff admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:54.074147 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae953ad-1d16-4366-94b1-25f2f897a4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:54.077557 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae953ad-1d16-4366-94b1-25f2f897a4ff admin admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:54.078331 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae953ad-1d16-4366-94b1-25f2f897a4ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:54.080395 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae953ad-1d16-4366-94b1-25f2f897a4ff admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:54.136931 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 978/1956] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:54.149015 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30898b1e-247b-4310-9265-2c68bc107c25 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:54.150796 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-30898b1e-247b-4310-9265-2c68bc107c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:54.183187 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:54.213197 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30898b1e-247b-4310-9265-2c68bc107c25 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:54.216905 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb5d321-4a89-43cd-9e65-cf5b3c55138c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:54.217551 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5d321-4a89-43cd-9e65-cf5b3c55138c service cinder] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:54.217952 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5d321-4a89-43cd-9e65-cf5b3c55138c service cinder] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:54.218106 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5d321-4a89-43cd-9e65-cf5b3c55138c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:54.226635 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 979/1957] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:58:53 2022] POST /identity/v3/users => generated 293 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 19:58:54.226782 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb5d321-4a89-43cd-9e65-cf5b3c55138c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:54.228647 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb5d321-4a89-43cd-9e65-cf5b3c55138c service cinder] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:54.231905 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae953ad-1d16-4366-94b1-25f2f897a4ff admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:54.238447 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 979/1958] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:58:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 19:58:54.241689 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae953ad-1d16-4366-94b1-25f2f897a4ff admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:54.246760 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dac79b-6a50-4d0b-967f-3c23146e3bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:54.247372 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dac79b-6a50-4d0b-967f-3c23146e3bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:54.247653 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dac79b-6a50-4d0b-967f-3c23146e3bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:54.247925 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dac79b-6a50-4d0b-967f-3c23146e3bd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:54.248571 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dac79b-6a50-4d0b-967f-3c23146e3bd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:54.250205 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dac79b-6a50-4d0b-967f-3c23146e3bd8 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:54.256772 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:54.264918 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 980/1959] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:58:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 19:58:54.265998 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb5d321-4a89-43cd-9e65-cf5b3c55138c service cinder] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:54.277678 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb5d321-4a89-43cd-9e65-cf5b3c55138c service cinder] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:54.282340 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f053ba51-9917-437e-9451-803fdbde8d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:54.282936 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053ba51-9917-437e-9451-803fdbde8d4f admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:54.283238 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053ba51-9917-437e-9451-803fdbde8d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:54.283506 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053ba51-9917-437e-9451-803fdbde8d4f admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:54.284259 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f053ba51-9917-437e-9451-803fdbde8d4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:54.285871 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f053ba51-9917-437e-9451-803fdbde8d4f admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:54.297138 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 980/1960] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:58:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 19:58:54.301221 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dac79b-6a50-4d0b-967f-3c23146e3bd8 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:54.312113 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dac79b-6a50-4d0b-967f-3c23146e3bd8 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:54.316957 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009760ca-ebb4-45a4-96f7-ed23f1eaf52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:54.317648 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009760ca-ebb4-45a4-96f7-ed23f1eaf52c admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:54.318118 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009760ca-ebb4-45a4-96f7-ed23f1eaf52c admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:54.318390 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009760ca-ebb4-45a4-96f7-ed23f1eaf52c admin admin] PATH_INFO: `/v3/projects/e22fadef5ce042c4bc394c6488b5e5fb/users/d8a70dc511cc41e49b41439177ea844e/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:54.335318 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009760ca-ebb4-45a4-96f7-ed23f1eaf52c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e22fadef5ce042c4bc394c6488b5e5fb, user_id=d8a70dc511cc41e49b41439177ea844e, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:54.339106 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009760ca-ebb4-45a4-96f7-ed23f1eaf52c admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:54.474095 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 981/1961] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:58:54 2022] PUT /identity/v3/projects/e22fadef5ce042c4bc394c6488b5e5fb/users/d8a70dc511cc41e49b41439177ea844e/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 19:58:54.490707 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61187e-36bf-4c74-8896-01b0c31dfe91 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:54.491011 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61187e-36bf-4c74-8896-01b0c31dfe91 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:54.491292 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61187e-36bf-4c74-8896-01b0c31dfe91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:54.522584 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-fc61187e-36bf-4c74-8896-01b0c31dfe91 None None] MFA Rules not processed for user `d8a70dc511cc41e49b41439177ea844e`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:54.524330 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-fc61187e-36bf-4c74-8896-01b0c31dfe91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:54.636227 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 981/1962] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:54.640793 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009760ca-ebb4-45a4-96f7-ed23f1eaf52c admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:54.748385 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc61187e-36bf-4c74-8896-01b0c31dfe91 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:54.755348 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-fc61187e-36bf-4c74-8896-01b0c31dfe91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:54.778565 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009760ca-ebb4-45a4-96f7-ed23f1eaf52c admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:54.785057 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183fb654-0a18-4832-b401-ba8e27e65f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:54.785703 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183fb654-0a18-4832-b401-ba8e27e65f83 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:54.785981 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183fb654-0a18-4832-b401-ba8e27e65f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:54.786248 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183fb654-0a18-4832-b401-ba8e27e65f83 admin admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:54.787357 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183fb654-0a18-4832-b401-ba8e27e65f83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:54.789272 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183fb654-0a18-4832-b401-ba8e27e65f83 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:54.855066 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc61187e-36bf-4c74-8896-01b0c31dfe91 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:54.860225 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c7b0e-fe3c-4338-9a42-619cf9f359f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:54.860964 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c7b0e-fe3c-4338-9a42-619cf9f359f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:54.861658 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c7b0e-fe3c-4338-9a42-619cf9f359f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:54.861658 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c7b0e-fe3c-4338-9a42-619cf9f359f1 admin admin] PATH_INFO: `/v3/users/98464f51767f4b048893ae7b4d7761e2` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:54.862750 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2c7b0e-fe3c-4338-9a42-619cf9f359f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98464f51767f4b048893ae7b4d7761e2)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:54.864742 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2c7b0e-fe3c-4338-9a42-619cf9f359f1 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:54.923495 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 982/1963] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 19:58:54 2022] POST /identity/v3/projects => generated 387 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 19:58:54.928596 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183fb654-0a18-4832-b401-ba8e27e65f83 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:54.997455 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183fb654-0a18-4832-b401-ba8e27e65f83 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:55.002191 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1733c-e627-4686-b44e-fa96ccf52a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:55.002800 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1733c-e627-4686-b44e-fa96ccf52a99 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:55.003081 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1733c-e627-4686-b44e-fa96ccf52a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:55.003354 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1733c-e627-4686-b44e-fa96ccf52a99 admin admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:55.003980 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc1733c-e627-4686-b44e-fa96ccf52a99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:55.005941 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc1733c-e627-4686-b44e-fa96ccf52a99 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:55.105868 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 983/1964] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:58:54 2022] POST /identity/v3/users => generated 300 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:58:55.115132 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1733c-e627-4686-b44e-fa96ccf52a99 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:55.116571 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-5f2c7b0e-fe3c-4338-9a42-619cf9f359f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98464f51767f4b048893ae7b4d7761e2'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:55.126150 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1733c-e627-4686-b44e-fa96ccf52a99 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:55.130847 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51335494-773d-4a90-b25c-9ce90a62f153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:55.131457 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51335494-773d-4a90-b25c-9ce90a62f153 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:55.131734 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51335494-773d-4a90-b25c-9ce90a62f153 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:55.132245 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51335494-773d-4a90-b25c-9ce90a62f153 admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:55.132673 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51335494-773d-4a90-b25c-9ce90a62f153 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:55.134914 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51335494-773d-4a90-b25c-9ce90a62f153 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:55.145599 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 984/1965] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:58:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 19:58:55.150108 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51335494-773d-4a90-b25c-9ce90a62f153 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:55.159516 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51335494-773d-4a90-b25c-9ce90a62f153 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:55.164822 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d92d68d-366f-4ea5-8111-08284603ac9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:55.165705 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92d68d-366f-4ea5-8111-08284603ac9c admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:55.165983 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92d68d-366f-4ea5-8111-08284603ac9c admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:55.166236 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92d68d-366f-4ea5-8111-08284603ac9c admin admin] PATH_INFO: `/v3/projects/0a85fb10f85c4c42945e328d1f4b6ea5/users/c9679e1ec7f0406e98394c140ab114ba/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:55.182206 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d92d68d-366f-4ea5-8111-08284603ac9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a85fb10f85c4c42945e328d1f4b6ea5, user_id=c9679e1ec7f0406e98394c140ab114ba, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:55.184838 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d92d68d-366f-4ea5-8111-08284603ac9c admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:55.223924 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-5f2c7b0e-fe3c-4338-9a42-619cf9f359f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98464f51767f4b048893ae7b4d7761e2'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:55.223924 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-5f2c7b0e-fe3c-4338-9a42-619cf9f359f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98464f51767f4b048893ae7b4d7761e2'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:55.240960 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-5f2c7b0e-fe3c-4338-9a42-619cf9f359f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98464f51767f4b048893ae7b4d7761e2'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:55.241996 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-5f2c7b0e-fe3c-4338-9a42-619cf9f359f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98464f51767f4b048893ae7b4d7761e2'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:55.256829 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 982/1966] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 19:58:54 2022] DELETE /identity/v3/users/98464f51767f4b048893ae7b4d7761e2 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:55.261944 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea381f6d-9bdb-409c-8715-1cb5872ded59 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:55.262348 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea381f6d-9bdb-409c-8715-1cb5872ded59 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:55.262700 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea381f6d-9bdb-409c-8715-1cb5872ded59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:55.274450 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 985/1967] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:58:55 2022] PUT /identity/v3/projects/0a85fb10f85c4c42945e328d1f4b6ea5/users/c9679e1ec7f0406e98394c140ab114ba/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 19:58:55.278327 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d92d68d-366f-4ea5-8111-08284603ac9c admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:55.280525 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-7d92d68d-366f-4ea5-8111-08284603ac9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:55.288330 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-ea381f6d-9bdb-409c-8715-1cb5872ded59 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:55.289885 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-ea381f6d-9bdb-409c-8715-1cb5872ded59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:55.381221 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d92d68d-366f-4ea5-8111-08284603ac9c admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:55.389031 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac0c3e-30bc-4a94-9c85-4e74fd8713c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:55.392540 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac0c3e-30bc-4a94-9c85-4e74fd8713c8 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:55.392540 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac0c3e-30bc-4a94-9c85-4e74fd8713c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:55.392540 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac0c3e-30bc-4a94-9c85-4e74fd8713c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:55.392540 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ac0c3e-30bc-4a94-9c85-4e74fd8713c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:55.392846 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 983/1968] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:55.398400 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ac0c3e-30bc-4a94-9c85-4e74fd8713c8 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:55.402504 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea381f6d-9bdb-409c-8715-1cb5872ded59 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:55.404292 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-ea381f6d-9bdb-409c-8715-1cb5872ded59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:55.416903 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 986/1969] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:58:55 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 19:58:55.421354 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac0c3e-30bc-4a94-9c85-4e74fd8713c8 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:55.440441 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac0c3e-30bc-4a94-9c85-4e74fd8713c8 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:55.447847 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b1a1e-467f-460c-b3b7-f76e4937aad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:55.448770 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b1a1e-467f-460c-b3b7-f76e4937aad1 admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:55.449044 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b1a1e-467f-460c-b3b7-f76e4937aad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:55.459778 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b1a1e-467f-460c-b3b7-f76e4937aad1 admin admin] PATH_INFO: `/v3/projects/0a85fb10f85c4c42945e328d1f4b6ea5/users/c9679e1ec7f0406e98394c140ab114ba/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:55.459778 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64b1a1e-467f-460c-b3b7-f76e4937aad1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a85fb10f85c4c42945e328d1f4b6ea5, user_id=c9679e1ec7f0406e98394c140ab114ba, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:55.459778 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64b1a1e-467f-460c-b3b7-f76e4937aad1 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:55.475329 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 987/1970] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:58:55 2022] PUT /identity/v3/projects/0a85fb10f85c4c42945e328d1f4b6ea5/users/c9679e1ec7f0406e98394c140ab114ba/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 19:58:55.489204 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abe471-f88f-4edf-8d1c-d76658d66b69 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:55.489784 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abe471-f88f-4edf-8d1c-d76658d66b69 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:55.490237 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abe471-f88f-4edf-8d1c-d76658d66b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:55.500993 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea381f6d-9bdb-409c-8715-1cb5872ded59 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:55.531614 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-b9abe471-f88f-4edf-8d1c-d76658d66b69 None None] MFA Rules not processed for user `c9679e1ec7f0406e98394c140ab114ba`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:55.533035 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-b9abe471-f88f-4edf-8d1c-d76658d66b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:55.582079 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ae67c8-1349-417c-9dee-47771acfc30a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:55.583271 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae67c8-1349-417c-9dee-47771acfc30a service neutron] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:55.584077 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae67c8-1349-417c-9dee-47771acfc30a service neutron] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:55.584534 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae67c8-1349-417c-9dee-47771acfc30a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:55.623936 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 988/1971] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:55 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:55.628021 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9abe471-f88f-4edf-8d1c-d76658d66b69 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:55.630318 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-b9abe471-f88f-4edf-8d1c-d76658d66b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:55.670562 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ae67c8-1349-417c-9dee-47771acfc30a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:55.672251 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ae67c8-1349-417c-9dee-47771acfc30a service neutron] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:55.683871 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 984/1972] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:58:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 19:58:55.684709 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ae67c8-1349-417c-9dee-47771acfc30a service neutron] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:55.686736 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-27ae67c8-1349-417c-9dee-47771acfc30a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:55.710632 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9abe471-f88f-4edf-8d1c-d76658d66b69 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:55.716308 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4719fae-8cc3-4733-8b30-e15e00ffc9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:55.719314 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4719fae-8cc3-4733-8b30-e15e00ffc9b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:55.719735 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4719fae-8cc3-4733-8b30-e15e00ffc9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:55.720151 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4719fae-8cc3-4733-8b30-e15e00ffc9b1 admin admin] PATH_INFO: `/v3/users/9ffb3c89e8bd4143ab87bd38191d9f3c` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:55.721905 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4719fae-8cc3-4733-8b30-e15e00ffc9b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ffb3c89e8bd4143ab87bd38191d9f3c)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:55.724438 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4719fae-8cc3-4733-8b30-e15e00ffc9b1 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:55.786406 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ae67c8-1349-417c-9dee-47771acfc30a service neutron] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:55.795338 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9240df9-9878-44a6-b285-58e87f1c0a6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:55.796401 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9240df9-9878-44a6-b285-58e87f1c0a6c service cinder] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:55.796686 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9240df9-9878-44a6-b285-58e87f1c0a6c service cinder] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:55.797149 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9240df9-9878-44a6-b285-58e87f1c0a6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:55.810347 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9240df9-9878-44a6-b285-58e87f1c0a6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:55.811823 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9240df9-9878-44a6-b285-58e87f1c0a6c service cinder] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:55.826143 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 985/1973] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:58:55 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:58:56.009059 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-c4719fae-8cc3-4733-8b30-e15e00ffc9b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ffb3c89e8bd4143ab87bd38191d9f3c'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:56.086104 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-c4719fae-8cc3-4733-8b30-e15e00ffc9b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ffb3c89e8bd4143ab87bd38191d9f3c'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:56.086975 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-c4719fae-8cc3-4733-8b30-e15e00ffc9b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ffb3c89e8bd4143ab87bd38191d9f3c'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:56.087647 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-c4719fae-8cc3-4733-8b30-e15e00ffc9b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ffb3c89e8bd4143ab87bd38191d9f3c'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:56.104950 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-c4719fae-8cc3-4733-8b30-e15e00ffc9b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ffb3c89e8bd4143ab87bd38191d9f3c'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:56.119662 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 989/1974] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 19:58:55 2022] DELETE /identity/v3/users/9ffb3c89e8bd4143ab87bd38191d9f3c => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:56.124822 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479886b-8cc0-46c4-b696-ad0c87dfe1a2 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:56.125639 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479886b-8cc0-46c4-b696-ad0c87dfe1a2 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:56.125930 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479886b-8cc0-46c4-b696-ad0c87dfe1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:56.151691 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-9479886b-8cc0-46c4-b696-ad0c87dfe1a2 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:56.152693 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-9479886b-8cc0-46c4-b696-ad0c87dfe1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:56.244048 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 986/1975] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:56.253527 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4719fae-8cc3-4733-8b30-e15e00ffc9b1 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:56.255041 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-c4719fae-8cc3-4733-8b30-e15e00ffc9b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:56.292670 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479886b-8cc0-46c4-b696-ad0c87dfe1a2 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:56.294105 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-9479886b-8cc0-46c4-b696-ad0c87dfe1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:56.314004 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479886b-8cc0-46c4-b696-ad0c87dfe1a2 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:56.316476 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4719fae-8cc3-4733-8b30-e15e00ffc9b1 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:56.324587 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d70bf8a-dfb3-4efb-befc-dc00d0377e02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:56.325257 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70bf8a-dfb3-4efb-befc-dc00d0377e02 service neutron] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:56.325480 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70bf8a-dfb3-4efb-befc-dc00d0377e02 service neutron] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:56.325773 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70bf8a-dfb3-4efb-befc-dc00d0377e02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:56.326850 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ef030-9820-4faf-8cc9-df058a444b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:56.327532 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ef030-9820-4faf-8cc9-df058a444b73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:56.327812 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ef030-9820-4faf-8cc9-df058a444b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:56.328089 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ef030-9820-4faf-8cc9-df058a444b73 admin admin] PATH_INFO: `/v3/projects/4ba5f6a5863647afa0a15486a43d1632` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:56.329278 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ef030-9820-4faf-8cc9-df058a444b73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ba5f6a5863647afa0a15486a43d1632)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:56.331267 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ef030-9820-4faf-8cc9-df058a444b73 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:56.336181 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d70bf8a-dfb3-4efb-befc-dc00d0377e02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:56.338351 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d70bf8a-dfb3-4efb-befc-dc00d0377e02 service neutron] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:56.352983 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 990/1976] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:58:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:58:56.465653 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-564ef030-9820-4faf-8cc9-df058a444b73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ba5f6a5863647afa0a15486a43d1632', 'request_id': 'req-564ef030-9820-4faf-8cc9-df058a444b73'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:56.547462 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-564ef030-9820-4faf-8cc9-df058a444b73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ba5f6a5863647afa0a15486a43d1632', 'request_id': 'req-564ef030-9820-4faf-8cc9-df058a444b73'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:56.553638 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-564ef030-9820-4faf-8cc9-df058a444b73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ba5f6a5863647afa0a15486a43d1632', 'request_id': 'req-564ef030-9820-4faf-8cc9-df058a444b73'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:56.566064 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-564ef030-9820-4faf-8cc9-df058a444b73 admin admin] The token cache is being invalidate because project 4ba5f6a5863647afa0a15486a43d1632 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 19:58:56.566353 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-564ef030-9820-4faf-8cc9-df058a444b73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:56.567023 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-564ef030-9820-4faf-8cc9-df058a444b73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:56.569043 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 987/1977] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 19:58:56 2022] DELETE /identity/v3/projects/4ba5f6a5863647afa0a15486a43d1632 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 19:58:56.576645 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d70bf8a-dfb3-4efb-befc-dc00d0377e02 service neutron] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:56.586810 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d70bf8a-dfb3-4efb-befc-dc00d0377e02 service neutron] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:56.656911 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a671e3e-8a67-4bfe-80c3-662f75d0ed5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:56.658324 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a671e3e-8a67-4bfe-80c3-662f75d0ed5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:56.658773 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a671e3e-8a67-4bfe-80c3-662f75d0ed5a admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:56.659048 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a671e3e-8a67-4bfe-80c3-662f75d0ed5a admin admin] PATH_INFO: `/v3/users/38c3fbd3dd1b41a684e96784d63114bd` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:56.668997 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a671e3e-8a67-4bfe-80c3-662f75d0ed5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=38c3fbd3dd1b41a684e96784d63114bd)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:56.671520 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a671e3e-8a67-4bfe-80c3-662f75d0ed5a admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:56.815332 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ef030-9820-4faf-8cc9-df058a444b73 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:56.817443 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-564ef030-9820-4faf-8cc9-df058a444b73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:56.846148 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ef030-9820-4faf-8cc9-df058a444b73 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:56.846461 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ce05d3-9485-4402-bd53-5cc1e763cba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:56.846910 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce05d3-9485-4402-bd53-5cc1e763cba2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:56.847193 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce05d3-9485-4402-bd53-5cc1e763cba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:56.847471 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce05d3-9485-4402-bd53-5cc1e763cba2 admin admin] PATH_INFO: `/v3/projects/c6b74a17c07f4b14bac10889d8fac1cb` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:56.848842 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ce05d3-9485-4402-bd53-5cc1e763cba2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6b74a17c07f4b14bac10889d8fac1cb)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:56.850812 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ce05d3-9485-4402-bd53-5cc1e763cba2 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:56.927481 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-1a671e3e-8a67-4bfe-80c3-662f75d0ed5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38c3fbd3dd1b41a684e96784d63114bd'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:56.987422 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-c6ce05d3-9485-4402-bd53-5cc1e763cba2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6b74a17c07f4b14bac10889d8fac1cb', 'request_id': 'req-c6ce05d3-9485-4402-bd53-5cc1e763cba2'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:57.071596 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-1a671e3e-8a67-4bfe-80c3-662f75d0ed5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38c3fbd3dd1b41a684e96784d63114bd'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:57.073979 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-1a671e3e-8a67-4bfe-80c3-662f75d0ed5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38c3fbd3dd1b41a684e96784d63114bd'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:57.074610 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-1a671e3e-8a67-4bfe-80c3-662f75d0ed5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38c3fbd3dd1b41a684e96784d63114bd'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:57.088864 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-1a671e3e-8a67-4bfe-80c3-662f75d0ed5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38c3fbd3dd1b41a684e96784d63114bd'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:57.105073 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 991/1978] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 19:58:56 2022] DELETE /identity/v3/users/38c3fbd3dd1b41a684e96784d63114bd => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:57.204671 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-c6ce05d3-9485-4402-bd53-5cc1e763cba2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6b74a17c07f4b14bac10889d8fac1cb', 'request_id': 'req-c6ce05d3-9485-4402-bd53-5cc1e763cba2'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:57.219754 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-c6ce05d3-9485-4402-bd53-5cc1e763cba2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6b74a17c07f4b14bac10889d8fac1cb', 'request_id': 'req-c6ce05d3-9485-4402-bd53-5cc1e763cba2'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:57.236311 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-c6ce05d3-9485-4402-bd53-5cc1e763cba2 admin admin] The token cache is being invalidate because project c6b74a17c07f4b14bac10889d8fac1cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 19:58:57.236863 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-c6ce05d3-9485-4402-bd53-5cc1e763cba2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:57.237936 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-c6ce05d3-9485-4402-bd53-5cc1e763cba2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:57.240229 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 988/1979] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 19:58:56 2022] DELETE /identity/v3/projects/c6b74a17c07f4b14bac10889d8fac1cb => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:57.254116 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a671e3e-8a67-4bfe-80c3-662f75d0ed5a admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:57.261396 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-1a671e3e-8a67-4bfe-80c3-662f75d0ed5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:57.294626 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ce05d3-9485-4402-bd53-5cc1e763cba2 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:57.296035 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-c6ce05d3-9485-4402-bd53-5cc1e763cba2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:57.355385 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a671e3e-8a67-4bfe-80c3-662f75d0ed5a admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:57.365543 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd52c0-fa19-48e5-b9cf-31c65b25aecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:57.366337 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd52c0-fa19-48e5-b9cf-31c65b25aecd admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:57.370424 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd52c0-fa19-48e5-b9cf-31c65b25aecd admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:57.370424 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd52c0-fa19-48e5-b9cf-31c65b25aecd admin admin] PATH_INFO: `/v3/users/426d0c025fa2408f804b6e4a8b63b2d3` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:57.370424 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cd52c0-fa19-48e5-b9cf-31c65b25aecd admin admin] RBAC: Authorizing `identity:delete_user(user_id=426d0c025fa2408f804b6e4a8b63b2d3)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:57.370852 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cd52c0-fa19-48e5-b9cf-31c65b25aecd admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:57.407135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ce05d3-9485-4402-bd53-5cc1e763cba2 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:57.416733 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada98f9-80eb-411c-915f-495cb1a95778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:57.418720 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada98f9-80eb-411c-915f-495cb1a95778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:57.419071 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada98f9-80eb-411c-915f-495cb1a95778 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:57.419354 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada98f9-80eb-411c-915f-495cb1a95778 admin admin] PATH_INFO: `/v3/users/d8a70dc511cc41e49b41439177ea844e` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:57.420797 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada98f9-80eb-411c-915f-495cb1a95778 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8a70dc511cc41e49b41439177ea844e)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:57.429726 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada98f9-80eb-411c-915f-495cb1a95778 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:57.499192 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:57.628274 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:57.652288 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-92cd52c0-fa19-48e5-b9cf-31c65b25aecd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '426d0c025fa2408f804b6e4a8b63b2d3'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:57.674405 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-eada98f9-80eb-411c-915f-495cb1a95778 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8a70dc511cc41e49b41439177ea844e'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:57.747407 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-92cd52c0-fa19-48e5-b9cf-31c65b25aecd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '426d0c025fa2408f804b6e4a8b63b2d3'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:57.748022 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-92cd52c0-fa19-48e5-b9cf-31c65b25aecd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '426d0c025fa2408f804b6e4a8b63b2d3'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:57.748636 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-92cd52c0-fa19-48e5-b9cf-31c65b25aecd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '426d0c025fa2408f804b6e4a8b63b2d3'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:57.762212 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-92cd52c0-fa19-48e5-b9cf-31c65b25aecd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '426d0c025fa2408f804b6e4a8b63b2d3'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:57.774345 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 992/1980] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 19:58:57 2022] DELETE /identity/v3/users/426d0c025fa2408f804b6e4a8b63b2d3 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:57.794639 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd52c0-fa19-48e5-b9cf-31c65b25aecd admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:57.796196 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-92cd52c0-fa19-48e5-b9cf-31c65b25aecd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:57.810592 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-eada98f9-80eb-411c-915f-495cb1a95778 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8a70dc511cc41e49b41439177ea844e'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:57.811356 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-eada98f9-80eb-411c-915f-495cb1a95778 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8a70dc511cc41e49b41439177ea844e'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:57.849845 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-eada98f9-80eb-411c-915f-495cb1a95778 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8a70dc511cc41e49b41439177ea844e'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:57.850872 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-eada98f9-80eb-411c-915f-495cb1a95778 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8a70dc511cc41e49b41439177ea844e'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:57.868245 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 989/1981] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 19:58:57 2022] DELETE /identity/v3/users/d8a70dc511cc41e49b41439177ea844e => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:57.873798 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d97219-c63f-460d-a780-fb0325708709 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:57.874306 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d97219-c63f-460d-a780-fb0325708709 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:57.874789 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d97219-c63f-460d-a780-fb0325708709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:57.903352 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-63d97219-c63f-460d-a780-fb0325708709 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:57.903352 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-63d97219-c63f-460d-a780-fb0325708709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:57.915622 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd52c0-fa19-48e5-b9cf-31c65b25aecd admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:57.989807 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f610864-02c4-40e1-814b-dc3fbd893f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:57.990430 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f610864-02c4-40e1-814b-dc3fbd893f6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:57.990741 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 990/1982] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:57.990886 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f610864-02c4-40e1-814b-dc3fbd893f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:57.991279 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f610864-02c4-40e1-814b-dc3fbd893f6b admin admin] PATH_INFO: `/v3/projects/8c115d966ccd467aa20eb845ae0b3f9c` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:57.995095 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f610864-02c4-40e1-814b-dc3fbd893f6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c115d966ccd467aa20eb845ae0b3f9c)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:57.997296 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f610864-02c4-40e1-814b-dc3fbd893f6b admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:58.002275 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d97219-c63f-460d-a780-fb0325708709 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:58.003862 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-63d97219-c63f-460d-a780-fb0325708709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:58.142993 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d97219-c63f-460d-a780-fb0325708709 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:58.157618 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-5f610864-02c4-40e1-814b-dc3fbd893f6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c115d966ccd467aa20eb845ae0b3f9c', 'request_id': 'req-5f610864-02c4-40e1-814b-dc3fbd893f6b'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:58.171833 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-5f610864-02c4-40e1-814b-dc3fbd893f6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c115d966ccd467aa20eb845ae0b3f9c', 'request_id': 'req-5f610864-02c4-40e1-814b-dc3fbd893f6b'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:58.236011 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f505dd0b-38d9-4010-911b-af094998d832 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:58.237105 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505dd0b-38d9-4010-911b-af094998d832 service neutron] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:58.238303 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505dd0b-38d9-4010-911b-af094998d832 service neutron] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:58.238531 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505dd0b-38d9-4010-911b-af094998d832 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:58.308235 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-5f610864-02c4-40e1-814b-dc3fbd893f6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c115d966ccd467aa20eb845ae0b3f9c', 'request_id': 'req-5f610864-02c4-40e1-814b-dc3fbd893f6b'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:58.311582 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f505dd0b-38d9-4010-911b-af094998d832 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:58.316756 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f505dd0b-38d9-4010-911b-af094998d832 service neutron] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:58.324509 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-5f610864-02c4-40e1-814b-dc3fbd893f6b admin admin] The token cache is being invalidate because project 8c115d966ccd467aa20eb845ae0b3f9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 19:58:58.325738 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-5f610864-02c4-40e1-814b-dc3fbd893f6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:58.326885 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 991/1983] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:58:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 19:58:58.327219 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-5f610864-02c4-40e1-814b-dc3fbd893f6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:58.329014 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 993/1984] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 19:58:57 2022] DELETE /identity/v3/projects/8c115d966ccd467aa20eb845ae0b3f9c => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 19:58:58.333099 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f505dd0b-38d9-4010-911b-af094998d832 service neutron] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:58.335897 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-f505dd0b-38d9-4010-911b-af094998d832 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:58.378230 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f505dd0b-38d9-4010-911b-af094998d832 service neutron] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:58.385253 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f881e02e-212e-4ee6-a095-c9da84870f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:58.385807 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881e02e-212e-4ee6-a095-c9da84870f8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:58.386085 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881e02e-212e-4ee6-a095-c9da84870f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:58.386373 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881e02e-212e-4ee6-a095-c9da84870f8c admin admin] PATH_INFO: `/v3/users/8088c6ecb432401d85a762c6a052b2be` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:58.387680 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f881e02e-212e-4ee6-a095-c9da84870f8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8088c6ecb432401d85a762c6a052b2be)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:58.390509 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f881e02e-212e-4ee6-a095-c9da84870f8c admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:58.478541 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f610864-02c4-40e1-814b-dc3fbd893f6b admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:58.480569 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-5f610864-02c4-40e1-814b-dc3fbd893f6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:58.505433 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f610864-02c4-40e1-814b-dc3fbd893f6b admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:58.513935 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df0e20a-942e-447b-80f1-1bd924e4583c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:58.514823 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df0e20a-942e-447b-80f1-1bd924e4583c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:58.515560 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df0e20a-942e-447b-80f1-1bd924e4583c admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:58.515560 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df0e20a-942e-447b-80f1-1bd924e4583c admin admin] PATH_INFO: `/v3/projects/bb1b2e9e8f4040c2a885a7e13f2276c0` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:58.517823 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df0e20a-942e-447b-80f1-1bd924e4583c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb1b2e9e8f4040c2a885a7e13f2276c0)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:58.519214 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df0e20a-942e-447b-80f1-1bd924e4583c admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:58.635746 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-f881e02e-212e-4ee6-a095-c9da84870f8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8088c6ecb432401d85a762c6a052b2be'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:58.695423 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-3df0e20a-942e-447b-80f1-1bd924e4583c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb1b2e9e8f4040c2a885a7e13f2276c0', 'request_id': 'req-3df0e20a-942e-447b-80f1-1bd924e4583c'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:58.704351 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-3df0e20a-942e-447b-80f1-1bd924e4583c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb1b2e9e8f4040c2a885a7e13f2276c0', 'request_id': 'req-3df0e20a-942e-447b-80f1-1bd924e4583c'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:58.733682 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-f881e02e-212e-4ee6-a095-c9da84870f8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8088c6ecb432401d85a762c6a052b2be'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:58.737286 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-f881e02e-212e-4ee6-a095-c9da84870f8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8088c6ecb432401d85a762c6a052b2be'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:58.763591 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-f881e02e-212e-4ee6-a095-c9da84870f8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8088c6ecb432401d85a762c6a052b2be'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:58.763591 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-f881e02e-212e-4ee6-a095-c9da84870f8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8088c6ecb432401d85a762c6a052b2be'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:58.793182 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 992/1985] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 19:58:58 2022] DELETE /identity/v3/users/8088c6ecb432401d85a762c6a052b2be => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:58.795670 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f881e02e-212e-4ee6-a095-c9da84870f8c admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:58.799770 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-f881e02e-212e-4ee6-a095-c9da84870f8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:58.811214 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-3df0e20a-942e-447b-80f1-1bd924e4583c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb1b2e9e8f4040c2a885a7e13f2276c0', 'request_id': 'req-3df0e20a-942e-447b-80f1-1bd924e4583c'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:58.827627 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-3df0e20a-942e-447b-80f1-1bd924e4583c admin admin] The token cache is being invalidate because project bb1b2e9e8f4040c2a885a7e13f2276c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 19:58:58.827933 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-3df0e20a-942e-447b-80f1-1bd924e4583c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:58.828694 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-3df0e20a-942e-447b-80f1-1bd924e4583c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:58.836807 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 994/1986] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 19:58:58 2022] DELETE /identity/v3/projects/bb1b2e9e8f4040c2a885a7e13f2276c0 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:58.839120 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cbe01e-75ba-428e-b523-5dca96836505 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:58.841423 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cbe01e-75ba-428e-b523-5dca96836505 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:58.841423 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cbe01e-75ba-428e-b523-5dca96836505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:58.870926 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-a7cbe01e-75ba-428e-b523-5dca96836505 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:58.873239 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-a7cbe01e-75ba-428e-b523-5dca96836505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:58.900303 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f881e02e-212e-4ee6-a095-c9da84870f8c admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:58.906314 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a4774-3442-4f81-ac0f-f283565a164d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:58.907165 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a4774-3442-4f81-ac0f-f283565a164d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:58.907892 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a4774-3442-4f81-ac0f-f283565a164d admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:58.907892 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a4774-3442-4f81-ac0f-f283565a164d admin admin] PATH_INFO: `/v3/users/c7aa895b68cd401f91e3953d61a50626` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:58.910009 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424a4774-3442-4f81-ac0f-f283565a164d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7aa895b68cd401f91e3953d61a50626)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:58.912689 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424a4774-3442-4f81-ac0f-f283565a164d admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:58.960467 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 995/1987] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:58.968766 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac57bd4-8e50-486c-a051-805345b3f5b8 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:58.974324 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac57bd4-8e50-486c-a051-805345b3f5b8 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:58.974324 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac57bd4-8e50-486c-a051-805345b3f5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:58.990614 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-1ac57bd4-8e50-486c-a051-805345b3f5b8 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:58.991642 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-1ac57bd4-8e50-486c-a051-805345b3f5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:59.004209 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 996/1988] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:58:59.005560 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac57bd4-8e50-486c-a051-805345b3f5b8 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:59.015373 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac57bd4-8e50-486c-a051-805345b3f5b8 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:59.020043 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaac536-b82d-40e9-8ed7-45d9be62cf73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:59.020652 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaac536-b82d-40e9-8ed7-45d9be62cf73 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:59.020933 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaac536-b82d-40e9-8ed7-45d9be62cf73 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:59.021202 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaac536-b82d-40e9-8ed7-45d9be62cf73 admin admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:59.021912 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaac536-b82d-40e9-8ed7-45d9be62cf73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:58:59.022212 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaac536-b82d-40e9-8ed7-45d9be62cf73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:59.023823 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaac536-b82d-40e9-8ed7-45d9be62cf73 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:59.039507 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 997/1989] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 19:58:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:58:59.041229 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaac536-b82d-40e9-8ed7-45d9be62cf73 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:59.054775 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaac536-b82d-40e9-8ed7-45d9be62cf73 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:59.061160 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d661033f-bd83-4550-b101-17ce36afa17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:59.061822 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661033f-bd83-4550-b101-17ce36afa17a admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:59.062129 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661033f-bd83-4550-b101-17ce36afa17a admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:59.062355 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661033f-bd83-4550-b101-17ce36afa17a admin admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:59.063056 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d661033f-bd83-4550-b101-17ce36afa17a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:59.064967 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d661033f-bd83-4550-b101-17ce36afa17a admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:59.138016 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-424a4774-3442-4f81-ac0f-f283565a164d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7aa895b68cd401f91e3953d61a50626'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:59.148057 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:59.158202 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 998/1990] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 19:58:59 2022] POST /identity/v3/projects => generated 371 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:58:59.160867 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d661033f-bd83-4550-b101-17ce36afa17a admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:59.204579 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-424a4774-3442-4f81-ac0f-f283565a164d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7aa895b68cd401f91e3953d61a50626'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:59.205276 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-424a4774-3442-4f81-ac0f-f283565a164d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7aa895b68cd401f91e3953d61a50626'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:59.222535 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-424a4774-3442-4f81-ac0f-f283565a164d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7aa895b68cd401f91e3953d61a50626'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:59.223321 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-424a4774-3442-4f81-ac0f-f283565a164d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7aa895b68cd401f91e3953d61a50626'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:59.237899 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d661033f-bd83-4550-b101-17ce36afa17a admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:59.238882 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 993/1991] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 19:58:58 2022] DELETE /identity/v3/users/c7aa895b68cd401f91e3953d61a50626 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:59.242707 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a4774-3442-4f81-ac0f-f283565a164d admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:59.244301 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-424a4774-3442-4f81-ac0f-f283565a164d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:59.312780 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ce360-fcf9-4240-92a4-ce60fba3eabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:59.313714 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ce360-fcf9-4240-92a4-ce60fba3eabe admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:59.314151 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ce360-fcf9-4240-92a4-ce60fba3eabe admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:59.314423 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ce360-fcf9-4240-92a4-ce60fba3eabe admin admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:59.315614 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420ce360-fcf9-4240-92a4-ce60fba3eabe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:59.317754 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420ce360-fcf9-4240-92a4-ce60fba3eabe admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:59.326190 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a4774-3442-4f81-ac0f-f283565a164d admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:59.333208 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b58ee-a9e3-42e4-b249-82e4b4fa831b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:59.333910 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b58ee-a9e3-42e4-b249-82e4b4fa831b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:59.334198 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b58ee-a9e3-42e4-b249-82e4b4fa831b admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:59.337737 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b58ee-a9e3-42e4-b249-82e4b4fa831b admin admin] PATH_INFO: `/v3/projects/e22fadef5ce042c4bc394c6488b5e5fb` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:59.337737 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418b58ee-a9e3-42e4-b249-82e4b4fa831b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e22fadef5ce042c4bc394c6488b5e5fb)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:59.338657 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418b58ee-a9e3-42e4-b249-82e4b4fa831b admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:59.469648 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 999/1992] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:58:59 2022] POST /identity/v3/users => generated 286 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:58:59.469648 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22081f-dd4e-4b59-97ba-2ec6c72c5d75 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:59.469648 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22081f-dd4e-4b59-97ba-2ec6c72c5d75 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:59.469648 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22081f-dd4e-4b59-97ba-2ec6c72c5d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:59.494843 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-fa22081f-dd4e-4b59-97ba-2ec6c72c5d75 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:58:59.496215 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-fa22081f-dd4e-4b59-97ba-2ec6c72c5d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:59.502364 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-418b58ee-a9e3-42e4-b249-82e4b4fa831b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e22fadef5ce042c4bc394c6488b5e5fb', 'request_id': 'req-418b58ee-a9e3-42e4-b249-82e4b4fa831b'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:59.566046 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-418b58ee-a9e3-42e4-b249-82e4b4fa831b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e22fadef5ce042c4bc394c6488b5e5fb', 'request_id': 'req-418b58ee-a9e3-42e4-b249-82e4b4fa831b'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:59.576435 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-418b58ee-a9e3-42e4-b249-82e4b4fa831b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e22fadef5ce042c4bc394c6488b5e5fb', 'request_id': 'req-418b58ee-a9e3-42e4-b249-82e4b4fa831b'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:59.591980 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-418b58ee-a9e3-42e4-b249-82e4b4fa831b admin admin] The token cache is being invalidate because project e22fadef5ce042c4bc394c6488b5e5fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 19:58:59.592270 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-418b58ee-a9e3-42e4-b249-82e4b4fa831b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:59.593866 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-418b58ee-a9e3-42e4-b249-82e4b4fa831b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:59.595965 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 994/1993] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 19:58:59 2022] DELETE /identity/v3/projects/e22fadef5ce042c4bc394c6488b5e5fb => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:59.596730 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b58ee-a9e3-42e4-b249-82e4b4fa831b admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:59.603224 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-418b58ee-a9e3-42e4-b249-82e4b4fa831b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:59.611734 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1000/1994] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:58:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:58:59.612801 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa22081f-dd4e-4b59-97ba-2ec6c72c5d75 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:59.615366 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-fa22081f-dd4e-4b59-97ba-2ec6c72c5d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:59.623434 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b58ee-a9e3-42e4-b249-82e4b4fa831b admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:59.628756 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa22081f-dd4e-4b59-97ba-2ec6c72c5d75 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:59.634676 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d9e6a-8b8c-47f5-aaab-b10a7be7a551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:59.635261 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e748b4ea-84ca-42cb-9a9a-703009266fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:59.635384 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d9e6a-8b8c-47f5-aaab-b10a7be7a551 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:59.635586 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d9e6a-8b8c-47f5-aaab-b10a7be7a551 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:59.635814 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d9e6a-8b8c-47f5-aaab-b10a7be7a551 admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:59.636463 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496d9e6a-8b8c-47f5-aaab-b10a7be7a551 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:59.637019 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748b4ea-84ca-42cb-9a9a-703009266fa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:59.637711 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748b4ea-84ca-42cb-9a9a-703009266fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:59.637994 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748b4ea-84ca-42cb-9a9a-703009266fa9 admin admin] PATH_INFO: `/v3/projects/a86a71047272429fa275b787425cc3c2` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:59.638236 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496d9e6a-8b8c-47f5-aaab-b10a7be7a551 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:59.639594 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e748b4ea-84ca-42cb-9a9a-703009266fa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a86a71047272429fa275b787425cc3c2)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:59.641681 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e748b4ea-84ca-42cb-9a9a-703009266fa9 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:59.662291 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1001/1995] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:58:59 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:58:59.662291 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d9e6a-8b8c-47f5-aaab-b10a7be7a551 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:59.662291 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-496d9e6a-8b8c-47f5-aaab-b10a7be7a551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:59.675533 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d9e6a-8b8c-47f5-aaab-b10a7be7a551 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:59.682109 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893677e-bcca-46a7-b1fb-b71e66d05581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:59.693173 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893677e-bcca-46a7-b1fb-b71e66d05581 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:59.693173 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893677e-bcca-46a7-b1fb-b71e66d05581 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:59.693173 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893677e-bcca-46a7-b1fb-b71e66d05581 admin admin] PATH_INFO: `/v3/users/c9679e1ec7f0406e98394c140ab114ba` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:59.693173 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0893677e-bcca-46a7-b1fb-b71e66d05581 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9679e1ec7f0406e98394c140ab114ba)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:58:59.693173 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0893677e-bcca-46a7-b1fb-b71e66d05581 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:58:59.774351 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-e748b4ea-84ca-42cb-9a9a-703009266fa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a86a71047272429fa275b787425cc3c2', 'request_id': 'req-e748b4ea-84ca-42cb-9a9a-703009266fa9'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:59.839423 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-e748b4ea-84ca-42cb-9a9a-703009266fa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a86a71047272429fa275b787425cc3c2', 'request_id': 'req-e748b4ea-84ca-42cb-9a9a-703009266fa9'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:59.845974 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-e748b4ea-84ca-42cb-9a9a-703009266fa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a86a71047272429fa275b787425cc3c2', 'request_id': 'req-e748b4ea-84ca-42cb-9a9a-703009266fa9'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:59.858783 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-e748b4ea-84ca-42cb-9a9a-703009266fa9 admin admin] The token cache is being invalidate because project a86a71047272429fa275b787425cc3c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 19:58:59.859072 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-e748b4ea-84ca-42cb-9a9a-703009266fa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:59.859809 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-e748b4ea-84ca-42cb-9a9a-703009266fa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:58:59.861550 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 995/1996] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 19:58:59 2022] DELETE /identity/v3/projects/a86a71047272429fa275b787425cc3c2 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:58:59.867816 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e748b4ea-84ca-42cb-9a9a-703009266fa9 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:58:59.868004 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-e748b4ea-84ca-42cb-9a9a-703009266fa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:59.927519 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e748b4ea-84ca-42cb-9a9a-703009266fa9 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:58:59.931896 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f3fca-d6d0-4708-8518-0cd1715023b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:58:59.932520 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f3fca-d6d0-4708-8518-0cd1715023b3 service neutron] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:58:59.932792 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f3fca-d6d0-4708-8518-0cd1715023b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:58:59.933064 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f3fca-d6d0-4708-8518-0cd1715023b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:58:59.934982 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-0c8f3fca-d6d0-4708-8518-0cd1715023b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:58:59.940858 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-0893677e-bcca-46a7-b1fb-b71e66d05581 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9679e1ec7f0406e98394c140ab114ba'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:00.003432 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8f3fca-d6d0-4708-8518-0cd1715023b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:00.004992 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8f3fca-d6d0-4708-8518-0cd1715023b3 service neutron] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:00.016149 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-0893677e-bcca-46a7-b1fb-b71e66d05581 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9679e1ec7f0406e98394c140ab114ba'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:00.016656 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 996/1997] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:58:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:59:00.017246 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-0893677e-bcca-46a7-b1fb-b71e66d05581 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9679e1ec7f0406e98394c140ab114ba'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:00.017995 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-0893677e-bcca-46a7-b1fb-b71e66d05581 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9679e1ec7f0406e98394c140ab114ba'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:00.025777 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f3fca-d6d0-4708-8518-0cd1715023b3 service neutron] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:00.025777 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-0c8f3fca-d6d0-4708-8518-0cd1715023b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:00.033118 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-0893677e-bcca-46a7-b1fb-b71e66d05581 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9679e1ec7f0406e98394c140ab114ba'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:00.036574 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f3fca-d6d0-4708-8518-0cd1715023b3 service neutron] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:00.043502 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b27aa-b7bb-4b09-a354-0d4176cba300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:00.044126 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b27aa-b7bb-4b09-a354-0d4176cba300 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:00.044402 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b27aa-b7bb-4b09-a354-0d4176cba300 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:00.044673 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b27aa-b7bb-4b09-a354-0d4176cba300 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:00.045395 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8b27aa-b7bb-4b09-a354-0d4176cba300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:00.048156 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1002/1998] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 19:58:59 2022] DELETE /identity/v3/users/c9679e1ec7f0406e98394c140ab114ba => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:59:00.048991 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8b27aa-b7bb-4b09-a354-0d4176cba300 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:00.049952 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3936b-ee60-4767-994b-7c7423f0119c None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:00.055159 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3936b-ee60-4767-994b-7c7423f0119c None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:00.055159 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3936b-ee60-4767-994b-7c7423f0119c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:00.055159 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:00.060573 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 997/1999] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:59:00.064460 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b27aa-b7bb-4b09-a354-0d4176cba300 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:00.067895 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-8e8b27aa-b7bb-4b09-a354-0d4176cba300 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:00.085363 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-abb3936b-ee60-4767-994b-7c7423f0119c None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:59:00.089903 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-abb3936b-ee60-4767-994b-7c7423f0119c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:00.090736 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b27aa-b7bb-4b09-a354-0d4176cba300 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:00.157782 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1003/2000] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:59:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:59:00.166964 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183d609-3d59-41ec-a625-65af608f6204 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:00.167250 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183d609-3d59-41ec-a625-65af608f6204 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:00.167526 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183d609-3d59-41ec-a625-65af608f6204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:00.170693 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27d2da-ab2e-4b74-b27c-cc115fc4fc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:00.171762 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27d2da-ab2e-4b74-b27c-cc115fc4fc93 admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:00.172397 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27d2da-ab2e-4b74-b27c-cc115fc4fc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:00.172683 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27d2da-ab2e-4b74-b27c-cc115fc4fc93 admin admin] PATH_INFO: `/v3/projects/c9775bfcd4614037938104f1d5e8516b/users/9dee63d35df743278519d7c10644a697/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:00.190664 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a27d2da-ab2e-4b74-b27c-cc115fc4fc93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9775bfcd4614037938104f1d5e8516b, user_id=9dee63d35df743278519d7c10644a697, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:00.193268 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a27d2da-ab2e-4b74-b27c-cc115fc4fc93 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:00.196941 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-b183d609-3d59-41ec-a625-65af608f6204 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:59:00.198557 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-b183d609-3d59-41ec-a625-65af608f6204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:00.207790 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1004/2001] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:59:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:59:00.211588 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b183d609-3d59-41ec-a625-65af608f6204 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:00.221830 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b183d609-3d59-41ec-a625-65af608f6204 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:00.227068 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ff48a-dfe4-48a5-ab06-b7cfd322325b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:00.228278 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ff48a-dfe4-48a5-ab06-b7cfd322325b admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:00.228706 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ff48a-dfe4-48a5-ab06-b7cfd322325b admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:00.228987 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ff48a-dfe4-48a5-ab06-b7cfd322325b admin admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:00.229676 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068ff48a-dfe4-48a5-ab06-b7cfd322325b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:59:00.229981 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068ff48a-dfe4-48a5-ab06-b7cfd322325b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:00.231598 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068ff48a-dfe4-48a5-ab06-b7cfd322325b admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:00.244085 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1005/2002] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 19:59:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:59:00.248518 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ff48a-dfe4-48a5-ab06-b7cfd322325b admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:00.260664 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ff48a-dfe4-48a5-ab06-b7cfd322325b admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:00.267250 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f947d312-5eaf-4d85-b2c5-71b4473018a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:00.267911 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947d312-5eaf-4d85-b2c5-71b4473018a4 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:00.268197 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947d312-5eaf-4d85-b2c5-71b4473018a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:00.268469 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947d312-5eaf-4d85-b2c5-71b4473018a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:00.269186 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f947d312-5eaf-4d85-b2c5-71b4473018a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:00.271434 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f947d312-5eaf-4d85-b2c5-71b4473018a4 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:00.314916 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 998/2003] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:59:00 2022] PUT /identity/v3/projects/c9775bfcd4614037938104f1d5e8516b/users/9dee63d35df743278519d7c10644a697/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:59:00.328748 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3582a0d-afba-4595-9b09-454535712792 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:00.329186 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3582a0d-afba-4595-9b09-454535712792 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:00.329186 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3582a0d-afba-4595-9b09-454535712792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:00.358565 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-c3582a0d-afba-4595-9b09-454535712792 None None] MFA Rules not processed for user `9dee63d35df743278519d7c10644a697`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:59:00.359819 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-c3582a0d-afba-4595-9b09-454535712792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:00.419704 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1006/2004] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 19:59:00 2022] POST /identity/v3/projects => generated 381 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 19:59:00.420707 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f947d312-5eaf-4d85-b2c5-71b4473018a4 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:00.436062 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 999/2005] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:59:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:59:00.454302 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3582a0d-afba-4595-9b09-454535712792 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:00.459547 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-c3582a0d-afba-4595-9b09-454535712792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:00.524058 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f947d312-5eaf-4d85-b2c5-71b4473018a4 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:00.531651 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c029c9-e6e9-4e46-947e-3590d8a89b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:00.532578 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c029c9-e6e9-4e46-947e-3590d8a89b1b admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:00.532899 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c029c9-e6e9-4e46-947e-3590d8a89b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:00.533198 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c029c9-e6e9-4e46-947e-3590d8a89b1b admin admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:00.534460 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c029c9-e6e9-4e46-947e-3590d8a89b1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:00.537373 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c029c9-e6e9-4e46-947e-3590d8a89b1b admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:00.602248 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3582a0d-afba-4595-9b09-454535712792 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:00.696583 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1007/2006] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:59:00 2022] POST /identity/v3/users => generated 291 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 19:59:00.697891 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c029c9-e6e9-4e46-947e-3590d8a89b1b admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:00.714971 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72b1118-1aa2-4af6-8a01-58df0dee459a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaf6ec7f5b4f490aa22a8e3bea91da39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:00.715632 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b1118-1aa2-4af6-8a01-58df0dee459a service glance] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:00.715968 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b1118-1aa2-4af6-8a01-58df0dee459a service glance] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:00.716156 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c029c9-e6e9-4e46-947e-3590d8a89b1b admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:00.716258 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b1118-1aa2-4af6-8a01-58df0dee459a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:00.722813 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac2aec1-4bb4-4339-a046-11b52118a842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:00.723448 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2aec1-4bb4-4339-a046-11b52118a842 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:00.723727 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2aec1-4bb4-4339-a046-11b52118a842 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:00.724002 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2aec1-4bb4-4339-a046-11b52118a842 admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:00.724666 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac2aec1-4bb4-4339-a046-11b52118a842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:00.728956 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac2aec1-4bb4-4339-a046-11b52118a842 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:00.745569 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1008/2007] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:59:00.746586 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac2aec1-4bb4-4339-a046-11b52118a842 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:00.757092 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac2aec1-4bb4-4339-a046-11b52118a842 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:00.763753 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a35cc37-0a96-4e3c-b382-39e69c23387c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:00.764382 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35cc37-0a96-4e3c-b382-39e69c23387c admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:00.764664 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35cc37-0a96-4e3c-b382-39e69c23387c admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:00.764938 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35cc37-0a96-4e3c-b382-39e69c23387c admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:00.766183 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a35cc37-0a96-4e3c-b382-39e69c23387c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:00.767344 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a35cc37-0a96-4e3c-b382-39e69c23387c admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:00.785987 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1009/2008] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:59:00.787224 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a35cc37-0a96-4e3c-b382-39e69c23387c admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:00.800398 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a35cc37-0a96-4e3c-b382-39e69c23387c admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:00.806591 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2077ed4-73fa-4960-a7d4-bbf705b55a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:00.807286 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2077ed4-73fa-4960-a7d4-bbf705b55a12 admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:00.808470 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2077ed4-73fa-4960-a7d4-bbf705b55a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:00.808806 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2077ed4-73fa-4960-a7d4-bbf705b55a12 admin admin] PATH_INFO: `/v3/projects/9328ff4a73a74fbca126dc77db7642cb/users/d989336d4567485c9beb2a823c366653/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:00.809072 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72b1118-1aa2-4af6-8a01-58df0dee459a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:00.811169 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72b1118-1aa2-4af6-8a01-58df0dee459a service glance] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:00.823000 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1000/2009] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:59:00 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:59:00.869770 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72b1118-1aa2-4af6-8a01-58df0dee459a service glance] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:00.871689 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-a72b1118-1aa2-4af6-8a01-58df0dee459a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:00.878062 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2077ed4-73fa-4960-a7d4-bbf705b55a12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9328ff4a73a74fbca126dc77db7642cb, user_id=d989336d4567485c9beb2a823c366653, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:00.884458 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2077ed4-73fa-4960-a7d4-bbf705b55a12 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:00.910444 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72b1118-1aa2-4af6-8a01-58df0dee459a service glance] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:00.924516 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e256a47-64d9-48dd-a54a-13f5422f64fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:00.925431 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e256a47-64d9-48dd-a54a-13f5422f64fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:00.925895 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e256a47-64d9-48dd-a54a-13f5422f64fb admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:00.926279 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e256a47-64d9-48dd-a54a-13f5422f64fb admin admin] PATH_INFO: `/v3/projects/0a85fb10f85c4c42945e328d1f4b6ea5` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:00.927856 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e256a47-64d9-48dd-a54a-13f5422f64fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a85fb10f85c4c42945e328d1f4b6ea5)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:00.930465 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e256a47-64d9-48dd-a54a-13f5422f64fb admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:01.003157 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1010/2010] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:59:00 2022] PUT /identity/v3/projects/9328ff4a73a74fbca126dc77db7642cb/users/d989336d4567485c9beb2a823c366653/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:59:01.005195 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2077ed4-73fa-4960-a7d4-bbf705b55a12 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:01.007712 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-a2077ed4-73fa-4960-a7d4-bbf705b55a12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:01.114444 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-3e256a47-64d9-48dd-a54a-13f5422f64fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a85fb10f85c4c42945e328d1f4b6ea5', 'request_id': 'req-3e256a47-64d9-48dd-a54a-13f5422f64fb'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:01.126744 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2077ed4-73fa-4960-a7d4-bbf705b55a12 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:01.203232 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-3e256a47-64d9-48dd-a54a-13f5422f64fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a85fb10f85c4c42945e328d1f4b6ea5', 'request_id': 'req-3e256a47-64d9-48dd-a54a-13f5422f64fb'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:01.224438 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-3e256a47-64d9-48dd-a54a-13f5422f64fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a85fb10f85c4c42945e328d1f4b6ea5', 'request_id': 'req-3e256a47-64d9-48dd-a54a-13f5422f64fb'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:01.257742 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea4bbb-2367-465f-844b-b77e9e8fa660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:01.259819 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea4bbb-2367-465f-844b-b77e9e8fa660 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:01.260106 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea4bbb-2367-465f-844b-b77e9e8fa660 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:01.260377 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea4bbb-2367-465f-844b-b77e9e8fa660 admin admin] PATH_INFO: `/v3/projects/25ad6cd861064bdb9de552d8a9d88089` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:01.267048 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea4bbb-2367-465f-844b-b77e9e8fa660 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25ad6cd861064bdb9de552d8a9d88089)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:01.268817 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-3e256a47-64d9-48dd-a54a-13f5422f64fb admin admin] The token cache is being invalidate because project 0a85fb10f85c4c42945e328d1f4b6ea5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 19:59:01.269050 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea4bbb-2367-465f-844b-b77e9e8fa660 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:01.269762 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-3e256a47-64d9-48dd-a54a-13f5422f64fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:01.270628 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-3e256a47-64d9-48dd-a54a-13f5422f64fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:01.277319 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1001/2011] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 19:59:00 2022] DELETE /identity/v3/projects/0a85fb10f85c4c42945e328d1f4b6ea5 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:59:01.281883 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52345ef0-ae30-4241-9c9a-0f481148bcce None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:01.282214 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52345ef0-ae30-4241-9c9a-0f481148bcce None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:01.284114 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52345ef0-ae30-4241-9c9a-0f481148bcce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:01.346413 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-52345ef0-ae30-4241-9c9a-0f481148bcce None None] MFA Rules not processed for user `d989336d4567485c9beb2a823c366653`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:59:01.347648 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-52345ef0-ae30-4241-9c9a-0f481148bcce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:01.420697 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-b6ea4bbb-2367-465f-844b-b77e9e8fa660 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25ad6cd861064bdb9de552d8a9d88089', 'request_id': 'req-b6ea4bbb-2367-465f-844b-b77e9e8fa660'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:01.427816 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-b6ea4bbb-2367-465f-844b-b77e9e8fa660 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25ad6cd861064bdb9de552d8a9d88089', 'request_id': 'req-b6ea4bbb-2367-465f-844b-b77e9e8fa660'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:01.441018 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1002/2012] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:59:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:59:01.442767 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781d632-1994-418a-ad25-37e7eaa292ac None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:01.442767 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781d632-1994-418a-ad25-37e7eaa292ac None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:01.442937 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781d632-1994-418a-ad25-37e7eaa292ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:01.463983 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-2781d632-1994-418a-ad25-37e7eaa292ac None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:59:01.465090 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-2781d632-1994-418a-ad25-37e7eaa292ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:01.500808 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-b6ea4bbb-2367-465f-844b-b77e9e8fa660 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25ad6cd861064bdb9de552d8a9d88089', 'request_id': 'req-b6ea4bbb-2367-465f-844b-b77e9e8fa660'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:01.526823 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-b6ea4bbb-2367-465f-844b-b77e9e8fa660 admin admin] The token cache is being invalidate because project 25ad6cd861064bdb9de552d8a9d88089 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 19:59:01.527394 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-b6ea4bbb-2367-465f-844b-b77e9e8fa660 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:01.529414 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:01.530302 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-b6ea4bbb-2367-465f-844b-b77e9e8fa660 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:01.532976 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1011/2013] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 19:59:01 2022] DELETE /identity/v3/projects/25ad6cd861064bdb9de552d8a9d88089 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:59:01.534232 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea4bbb-2367-465f-844b-b77e9e8fa660 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:01.541723 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1003/2014] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:59:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:59:01.541723 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f98e21-385e-4916-aa6f-48fe71f996b7 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:01.541723 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f98e21-385e-4916-aa6f-48fe71f996b7 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:01.541723 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f98e21-385e-4916-aa6f-48fe71f996b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:01.542445 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-b6ea4bbb-2367-465f-844b-b77e9e8fa660 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:01.555379 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea4bbb-2367-465f-844b-b77e9e8fa660 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:01.558987 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-79f98e21-385e-4916-aa6f-48fe71f996b7 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:59:01.560198 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-79f98e21-385e-4916-aa6f-48fe71f996b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:01.561335 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edbd204-4318-4480-93e4-5222a257a394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:01.562045 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbd204-4318-4480-93e4-5222a257a394 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:01.562329 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbd204-4318-4480-93e4-5222a257a394 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:01.562611 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbd204-4318-4480-93e4-5222a257a394 admin admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:01.563437 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edbd204-4318-4480-93e4-5222a257a394 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:01.565433 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edbd204-4318-4480-93e4-5222a257a394 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:01.573897 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1004/2015] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:59:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:59:01.575297 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c87d6d-b10f-4cae-98ab-e58064818ca1 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:01.575581 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c87d6d-b10f-4cae-98ab-e58064818ca1 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:01.575855 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c87d6d-b10f-4cae-98ab-e58064818ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:01.597288 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-d9c87d6d-b10f-4cae-98ab-e58064818ca1 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:59:01.597430 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-d9c87d6d-b10f-4cae-98ab-e58064818ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:01.612009 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:01.612290 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1005/2016] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:59:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:59:01.614107 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa644131-3536-4779-8b5a-9796341ddf7e None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:01.614687 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa644131-3536-4779-8b5a-9796341ddf7e None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:01.614965 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa644131-3536-4779-8b5a-9796341ddf7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:01.640446 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-fa644131-3536-4779-8b5a-9796341ddf7e None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:59:01.641865 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-fa644131-3536-4779-8b5a-9796341ddf7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:01.652708 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1006/2017] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:59:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:59:01.653796 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa644131-3536-4779-8b5a-9796341ddf7e None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:01.664083 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa644131-3536-4779-8b5a-9796341ddf7e None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:01.669573 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00433707-1914-48d1-b40b-67db8f64dd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:01.670185 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00433707-1914-48d1-b40b-67db8f64dd1d admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:01.670477 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00433707-1914-48d1-b40b-67db8f64dd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:01.670744 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00433707-1914-48d1-b40b-67db8f64dd1d admin admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:01.671405 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00433707-1914-48d1-b40b-67db8f64dd1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:59:01.671711 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00433707-1914-48d1-b40b-67db8f64dd1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:01.678969 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00433707-1914-48d1-b40b-67db8f64dd1d admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:01.691651 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1012/2018] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 19:59:01 2022] POST /identity/v3/projects => generated 379 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:59:01.696031 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edbd204-4318-4480-93e4-5222a257a394 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:01.709868 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1007/2019] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 19:59:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:59:01.709868 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00433707-1914-48d1-b40b-67db8f64dd1d admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:01.721548 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00433707-1914-48d1-b40b-67db8f64dd1d admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:01.784176 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edbd204-4318-4480-93e4-5222a257a394 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:01.788170 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3a5189-8708-4522-ada9-872195ee8089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:01.788865 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a5189-8708-4522-ada9-872195ee8089 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:01.789147 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a5189-8708-4522-ada9-872195ee8089 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:01.789419 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a5189-8708-4522-ada9-872195ee8089 admin admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:01.790124 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3a5189-8708-4522-ada9-872195ee8089 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:59:01.790433 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3a5189-8708-4522-ada9-872195ee8089 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:01.792366 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3a5189-8708-4522-ada9-872195ee8089 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:01.802706 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fdd03a-f0a2-4fc6-8f2c-24c0803332cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:01.803390 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fdd03a-f0a2-4fc6-8f2c-24c0803332cc admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:01.803659 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fdd03a-f0a2-4fc6-8f2c-24c0803332cc admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:01.803927 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fdd03a-f0a2-4fc6-8f2c-24c0803332cc admin admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:01.804703 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1013/2020] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 19:59:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:59:01.804812 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fdd03a-f0a2-4fc6-8f2c-24c0803332cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:01.805418 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3a5189-8708-4522-ada9-872195ee8089 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:01.807458 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fdd03a-f0a2-4fc6-8f2c-24c0803332cc admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:01.817622 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3a5189-8708-4522-ada9-872195ee8089 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:01.824422 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56446ceb-c2fb-4507-9def-c8d64354ac25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:01.825034 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56446ceb-c2fb-4507-9def-c8d64354ac25 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:01.825312 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56446ceb-c2fb-4507-9def-c8d64354ac25 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:01.825639 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56446ceb-c2fb-4507-9def-c8d64354ac25 admin admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:01.826279 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56446ceb-c2fb-4507-9def-c8d64354ac25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:01.828176 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56446ceb-c2fb-4507-9def-c8d64354ac25 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:01.921665 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1014/2021] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 19:59:01 2022] POST /identity/v3/projects => generated 369 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:59:01.921665 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56446ceb-c2fb-4507-9def-c8d64354ac25 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:01.924112 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1008/2022] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:59:01 2022] POST /identity/v3/users => generated 296 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:59:01.924953 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fdd03a-f0a2-4fc6-8f2c-24c0803332cc admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:01.947068 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fdd03a-f0a2-4fc6-8f2c-24c0803332cc admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:02.004691 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56446ceb-c2fb-4507-9def-c8d64354ac25 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:02.010203 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527c44d2-601c-4fab-bb09-16ccaaecd066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:02.010819 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c44d2-601c-4fab-bb09-16ccaaecd066 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:02.011099 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c44d2-601c-4fab-bb09-16ccaaecd066 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:02.011370 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c44d2-601c-4fab-bb09-16ccaaecd066 admin admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:02.012100 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527c44d2-601c-4fab-bb09-16ccaaecd066 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:02.014212 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527c44d2-601c-4fab-bb09-16ccaaecd066 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:02.028591 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da842c83-a89b-46a7-8b2e-9cda69167038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:02.029222 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da842c83-a89b-46a7-8b2e-9cda69167038 admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:02.037528 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da842c83-a89b-46a7-8b2e-9cda69167038 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:02.037528 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da842c83-a89b-46a7-8b2e-9cda69167038 admin admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:02.037528 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da842c83-a89b-46a7-8b2e-9cda69167038 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:02.037528 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da842c83-a89b-46a7-8b2e-9cda69167038 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:02.149837 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1009/2023] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:59:01 2022] POST /identity/v3/users => generated 285 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:59:02.151598 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1015/2024] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 19:59:01 2022] POST /identity/v3/projects => generated 399 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:59:02.152487 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da842c83-a89b-46a7-8b2e-9cda69167038 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:02.155980 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527c44d2-601c-4fab-bb09-16ccaaecd066 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:02.165554 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da842c83-a89b-46a7-8b2e-9cda69167038 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:02.248816 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527c44d2-601c-4fab-bb09-16ccaaecd066 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:02.257640 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83050bc7-9807-41af-ad0c-89aab9a430b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:02.258420 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30525311-c99f-41dc-a395-e34553b080be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:02.259601 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30525311-c99f-41dc-a395-e34553b080be admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:02.259858 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30525311-c99f-41dc-a395-e34553b080be admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:02.260127 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30525311-c99f-41dc-a395-e34553b080be admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:02.260772 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30525311-c99f-41dc-a395-e34553b080be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:02.261842 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83050bc7-9807-41af-ad0c-89aab9a430b5 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:02.262168 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83050bc7-9807-41af-ad0c-89aab9a430b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:02.262467 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83050bc7-9807-41af-ad0c-89aab9a430b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:02.263097 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83050bc7-9807-41af-ad0c-89aab9a430b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:02.265521 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83050bc7-9807-41af-ad0c-89aab9a430b5 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:02.267536 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30525311-c99f-41dc-a395-e34553b080be admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:02.289240 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1016/2025] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:59:02 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:59:02.290471 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30525311-c99f-41dc-a395-e34553b080be admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:02.293772 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1010/2026] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:59:02 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:59:02.294704 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83050bc7-9807-41af-ad0c-89aab9a430b5 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:02.305711 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83050bc7-9807-41af-ad0c-89aab9a430b5 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:02.306345 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30525311-c99f-41dc-a395-e34553b080be admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:02.314183 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7686e7fc-2d8c-4e2b-bcb1-47e67fe62e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:02.315436 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7686e7fc-2d8c-4e2b-bcb1-47e67fe62e65 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:02.315585 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39fc04b-7752-4f20-9f7b-73d2933dfbc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:02.316075 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39fc04b-7752-4f20-9f7b-73d2933dfbc4 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:02.316365 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39fc04b-7752-4f20-9f7b-73d2933dfbc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:02.316633 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39fc04b-7752-4f20-9f7b-73d2933dfbc4 admin admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:02.316963 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7686e7fc-2d8c-4e2b-bcb1-47e67fe62e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:02.317279 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39fc04b-7752-4f20-9f7b-73d2933dfbc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:02.317621 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7686e7fc-2d8c-4e2b-bcb1-47e67fe62e65 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:02.318480 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7686e7fc-2d8c-4e2b-bcb1-47e67fe62e65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:02.319565 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39fc04b-7752-4f20-9f7b-73d2933dfbc4 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:02.320079 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7686e7fc-2d8c-4e2b-bcb1-47e67fe62e65 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:02.336216 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1011/2027] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:59:02 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:59:02.339518 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7686e7fc-2d8c-4e2b-bcb1-47e67fe62e65 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:02.350511 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7686e7fc-2d8c-4e2b-bcb1-47e67fe62e65 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:02.356284 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aba1af7-9c24-4851-b04e-352f0aa06f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:02.357244 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba1af7-9c24-4851-b04e-352f0aa06f28 admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:02.362591 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba1af7-9c24-4851-b04e-352f0aa06f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:02.362591 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba1af7-9c24-4851-b04e-352f0aa06f28 admin admin] PATH_INFO: `/v3/projects/e18fadae56f94c97a043a2c1eb302e35/users/1e7dbef02c4642289da7d9ed0edef077/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:02.378055 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aba1af7-9c24-4851-b04e-352f0aa06f28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e18fadae56f94c97a043a2c1eb302e35, user_id=1e7dbef02c4642289da7d9ed0edef077, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:02.383206 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aba1af7-9c24-4851-b04e-352f0aa06f28 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:02.450677 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1017/2028] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:59:02 2022] POST /identity/v3/users => generated 300 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:59:02.451807 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39fc04b-7752-4f20-9f7b-73d2933dfbc4 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:02.462904 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39fc04b-7752-4f20-9f7b-73d2933dfbc4 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:02.468113 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7efa24f-0d04-4397-8f06-2faa41e5d81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:02.468894 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7efa24f-0d04-4397-8f06-2faa41e5d81d admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:02.469248 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7efa24f-0d04-4397-8f06-2faa41e5d81d admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:02.469712 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7efa24f-0d04-4397-8f06-2faa41e5d81d admin admin] PATH_INFO: `/v3/projects/d7b117f71833404a99f19a89e6efa163/users/87be7aafd99b48c3be2b837a66c7a89f/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:02.485708 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7efa24f-0d04-4397-8f06-2faa41e5d81d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7b117f71833404a99f19a89e6efa163, user_id=87be7aafd99b48c3be2b837a66c7a89f, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:02.488539 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7efa24f-0d04-4397-8f06-2faa41e5d81d admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:02.502159 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1012/2029] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:59:02 2022] PUT /identity/v3/projects/e18fadae56f94c97a043a2c1eb302e35/users/1e7dbef02c4642289da7d9ed0edef077/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:59:02.502986 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aba1af7-9c24-4851-b04e-352f0aa06f28 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:02.572488 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aba1af7-9c24-4851-b04e-352f0aa06f28 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:02.577339 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0702a9d-fa85-4f8e-b335-99b63880f275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:02.577975 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0702a9d-fa85-4f8e-b335-99b63880f275 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:02.578246 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0702a9d-fa85-4f8e-b335-99b63880f275 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:02.578517 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0702a9d-fa85-4f8e-b335-99b63880f275 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:02.579158 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0702a9d-fa85-4f8e-b335-99b63880f275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:02.581674 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0702a9d-fa85-4f8e-b335-99b63880f275 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:02.592093 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1018/2030] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:59:02 2022] PUT /identity/v3/projects/d7b117f71833404a99f19a89e6efa163/users/87be7aafd99b48c3be2b837a66c7a89f/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:59:02.601117 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1013/2031] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:59:02 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:59:02.601258 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7efa24f-0d04-4397-8f06-2faa41e5d81d admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:02.601351 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0702a9d-fa85-4f8e-b335-99b63880f275 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:02.621994 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0702a9d-fa85-4f8e-b335-99b63880f275 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:02.751941 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca661173-0da3-4b30-9bdc-fcec9ce57bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:02.752585 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca661173-0da3-4b30-9bdc-fcec9ce57bff admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:02.752868 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca661173-0da3-4b30-9bdc-fcec9ce57bff admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:02.755016 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca661173-0da3-4b30-9bdc-fcec9ce57bff admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:02.755694 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca661173-0da3-4b30-9bdc-fcec9ce57bff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:02.760829 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca661173-0da3-4b30-9bdc-fcec9ce57bff admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:02.769847 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7efa24f-0d04-4397-8f06-2faa41e5d81d admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:02.775566 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1014/2032] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:59:02 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:59:02.777018 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7114a9-42a9-41bb-af59-ecc0e3d25078 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:02.777341 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7114a9-42a9-41bb-af59-ecc0e3d25078 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:02.777708 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7114a9-42a9-41bb-af59-ecc0e3d25078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:02.786872 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd27a15d-b20d-48b1-8664-695d29f1fedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:02.787730 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd27a15d-b20d-48b1-8664-695d29f1fedb admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:02.788005 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd27a15d-b20d-48b1-8664-695d29f1fedb admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:02.788271 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd27a15d-b20d-48b1-8664-695d29f1fedb admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:02.788930 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd27a15d-b20d-48b1-8664-695d29f1fedb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:02.791506 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd27a15d-b20d-48b1-8664-695d29f1fedb admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:02.805531 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1019/2033] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:59:02 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:59:02.807168 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd27a15d-b20d-48b1-8664-695d29f1fedb admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:02.826783 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-6f7114a9-42a9-41bb-af59-ecc0e3d25078 None None] MFA Rules not processed for user `87be7aafd99b48c3be2b837a66c7a89f`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:59:02.826783 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-6f7114a9-42a9-41bb-af59-ecc0e3d25078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:02.831893 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd27a15d-b20d-48b1-8664-695d29f1fedb admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:02.842508 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb9fbe-04b0-4e61-beb7-923bca8c0b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:02.843184 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb9fbe-04b0-4e61-beb7-923bca8c0b3f admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:02.843468 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb9fbe-04b0-4e61-beb7-923bca8c0b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:02.843744 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb9fbe-04b0-4e61-beb7-923bca8c0b3f admin admin] PATH_INFO: `/v3/projects/3d395527355245e39624ae09250f8130/users/1a4367f3a94c4d3b8e95a97248e7a4ec/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:02.864325 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:02.872804 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efb9fbe-04b0-4e61-beb7-923bca8c0b3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d395527355245e39624ae09250f8130, user_id=1a4367f3a94c4d3b8e95a97248e7a4ec, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:02.875803 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efb9fbe-04b0-4e61-beb7-923bca8c0b3f admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:02.918836 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1015/2034] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:59:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:59:02.919983 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7114a9-42a9-41bb-af59-ecc0e3d25078 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:02.937294 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7114a9-42a9-41bb-af59-ecc0e3d25078 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:02.944388 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec754f55-3770-4c5e-a892-2634408453a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:02.945027 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec754f55-3770-4c5e-a892-2634408453a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:02.945422 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec754f55-3770-4c5e-a892-2634408453a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:02.945706 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec754f55-3770-4c5e-a892-2634408453a3 admin admin] PATH_INFO: `/v3/projects/e18fadae56f94c97a043a2c1eb302e35/users/1e7dbef02c4642289da7d9ed0edef077/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:02.948532 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec754f55-3770-4c5e-a892-2634408453a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e18fadae56f94c97a043a2c1eb302e35, user_id=1e7dbef02c4642289da7d9ed0edef077, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:02.951283 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec754f55-3770-4c5e-a892-2634408453a3 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:02.966251 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1016/2035] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:59:02 2022] PUT /identity/v3/projects/e18fadae56f94c97a043a2c1eb302e35/users/1e7dbef02c4642289da7d9ed0edef077/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:59:02.985690 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec754f55-3770-4c5e-a892-2634408453a3 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:02.985690 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-ec754f55-3770-4c5e-a892-2634408453a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:03.021234 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1020/2036] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:59:02 2022] PUT /identity/v3/projects/3d395527355245e39624ae09250f8130/users/1a4367f3a94c4d3b8e95a97248e7a4ec/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:59:03.022993 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8860148-0cf8-45f3-b5f8-6953e3cbab9d None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:03.024128 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8860148-0cf8-45f3-b5f8-6953e3cbab9d None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:03.025283 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8860148-0cf8-45f3-b5f8-6953e3cbab9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:03.109930 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec754f55-3770-4c5e-a892-2634408453a3 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:03.111447 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-b8860148-0cf8-45f3-b5f8-6953e3cbab9d None None] MFA Rules not processed for user `1e7dbef02c4642289da7d9ed0edef077`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:59:03.112950 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-b8860148-0cf8-45f3-b5f8-6953e3cbab9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:03.183923 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7406c6be-1d18-4f95-b86c-a4054f48756e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaf6ec7f5b4f490aa22a8e3bea91da39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:03.184560 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406c6be-1d18-4f95-b86c-a4054f48756e service glance] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:03.184819 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406c6be-1d18-4f95-b86c-a4054f48756e service glance] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:03.185086 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406c6be-1d18-4f95-b86c-a4054f48756e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:03.207283 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1021/2037] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:59:03 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:59:03.210472 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856ac27-465d-49ef-9840-5c3f353e6063 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:03.210991 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856ac27-465d-49ef-9840-5c3f353e6063 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:03.211510 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856ac27-465d-49ef-9840-5c3f353e6063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:03.248902 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-c856ac27-465d-49ef-9840-5c3f353e6063 None None] MFA Rules not processed for user `1a4367f3a94c4d3b8e95a97248e7a4ec`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:59:03.250161 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-c856ac27-465d-49ef-9840-5c3f353e6063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:03.266057 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7406c6be-1d18-4f95-b86c-a4054f48756e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:03.273102 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7406c6be-1d18-4f95-b86c-a4054f48756e service glance] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:03.284474 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1017/2038] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:59:02 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:59:03.285711 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7406c6be-1d18-4f95-b86c-a4054f48756e service glance] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:03.287181 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-7406c6be-1d18-4f95-b86c-a4054f48756e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:03.355764 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1022/2039] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:59:03 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:59:03.392726 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7406c6be-1d18-4f95-b86c-a4054f48756e service glance] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:03.396585 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7178e95-9a64-494e-ab93-92ba3495c54d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:03.397204 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7178e95-9a64-494e-ab93-92ba3495c54d service cinder] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:03.397513 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7178e95-9a64-494e-ab93-92ba3495c54d service cinder] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:03.397799 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7178e95-9a64-494e-ab93-92ba3495c54d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:03.408467 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7178e95-9a64-494e-ab93-92ba3495c54d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:03.410075 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7178e95-9a64-494e-ab93-92ba3495c54d service cinder] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:03.421628 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1018/2040] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:59:03 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:59:03.439428 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:03.536426 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856ac27-465d-49ef-9840-5c3f353e6063 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:03.549143 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856ac27-465d-49ef-9840-5c3f353e6063 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:03.552875 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb72ad-3b9b-4668-9d6b-7470cfbe00f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:03.553487 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb72ad-3b9b-4668-9d6b-7470cfbe00f7 service cinder] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:03.553809 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb72ad-3b9b-4668-9d6b-7470cfbe00f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:03.554080 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb72ad-3b9b-4668-9d6b-7470cfbe00f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:03.564332 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb72ad-3b9b-4668-9d6b-7470cfbe00f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:03.565731 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb72ad-3b9b-4668-9d6b-7470cfbe00f7 service cinder] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:03.577831 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1023/2041] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:59:03 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:59:03.747333 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:04.460518 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:04.810313 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:05.382639 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:05.616069 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:05.718611 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7178e95-9a64-494e-ab93-92ba3495c54d service cinder] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:05.786176 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7178e95-9a64-494e-ab93-92ba3495c54d service cinder] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:05.791923 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e33fc8-f62b-4d85-bc2b-d197f5e614a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:05.792670 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e33fc8-f62b-4d85-bc2b-d197f5e614a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:05.792953 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e33fc8-f62b-4d85-bc2b-d197f5e614a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:05.793362 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e33fc8-f62b-4d85-bc2b-d197f5e614a3 admin admin] PATH_INFO: `/v3/users/d989336d4567485c9beb2a823c366653` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:05.794735 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e33fc8-f62b-4d85-bc2b-d197f5e614a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d989336d4567485c9beb2a823c366653)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:05.796948 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e33fc8-f62b-4d85-bc2b-d197f5e614a3 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:05.913197 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:05.965381 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-a2e33fc8-f62b-4d85-bc2b-d197f5e614a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd989336d4567485c9beb2a823c366653'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:06.078958 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-a2e33fc8-f62b-4d85-bc2b-d197f5e614a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd989336d4567485c9beb2a823c366653'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:06.079708 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-a2e33fc8-f62b-4d85-bc2b-d197f5e614a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd989336d4567485c9beb2a823c366653'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:06.093281 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-a2e33fc8-f62b-4d85-bc2b-d197f5e614a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd989336d4567485c9beb2a823c366653'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:06.093991 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-a2e33fc8-f62b-4d85-bc2b-d197f5e614a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd989336d4567485c9beb2a823c366653'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:06.108989 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1019/2042] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 19:59:05 2022] DELETE /identity/v3/users/d989336d4567485c9beb2a823c366653 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:59:06.113534 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724457b-e49b-4670-8c52-65bbcbe33cf3 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:06.113994 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724457b-e49b-4670-8c52-65bbcbe33cf3 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:06.114118 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724457b-e49b-4670-8c52-65bbcbe33cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:06.135206 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-2724457b-e49b-4670-8c52-65bbcbe33cf3 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:59:06.137881 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:06.138763 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-2724457b-e49b-4670-8c52-65bbcbe33cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:06.199811 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1024/2043] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:59:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:59:06.210034 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e33fc8-f62b-4d85-bc2b-d197f5e614a3 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:06.211447 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-a2e33fc8-f62b-4d85-bc2b-d197f5e614a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:06.272575 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e33fc8-f62b-4d85-bc2b-d197f5e614a3 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:06.276675 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf4f792-5906-4ce6-82e7-8411c3324e0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:06.277286 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4f792-5906-4ce6-82e7-8411c3324e0e service neutron] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:06.277656 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4f792-5906-4ce6-82e7-8411c3324e0e service neutron] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:06.277934 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4f792-5906-4ce6-82e7-8411c3324e0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:06.287279 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf4f792-5906-4ce6-82e7-8411c3324e0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:06.288661 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf4f792-5906-4ce6-82e7-8411c3324e0e service neutron] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:06.298984 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1020/2044] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:59:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:59:06.479528 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:06.648302 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:06.803827 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2724457b-e49b-4670-8c52-65bbcbe33cf3 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:06.803827 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-2724457b-e49b-4670-8c52-65bbcbe33cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:06.825653 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2724457b-e49b-4670-8c52-65bbcbe33cf3 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:06.831664 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def0a61a-509b-4aa2-ba2a-374abda18e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:06.832639 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0a61a-509b-4aa2-ba2a-374abda18e80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:06.832816 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0a61a-509b-4aa2-ba2a-374abda18e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:06.833097 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0a61a-509b-4aa2-ba2a-374abda18e80 admin admin] PATH_INFO: `/v3/projects/9328ff4a73a74fbca126dc77db7642cb` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:06.834235 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def0a61a-509b-4aa2-ba2a-374abda18e80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9328ff4a73a74fbca126dc77db7642cb)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:06.836194 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def0a61a-509b-4aa2-ba2a-374abda18e80 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:06.932578 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-def0a61a-509b-4aa2-ba2a-374abda18e80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9328ff4a73a74fbca126dc77db7642cb', 'request_id': 'req-def0a61a-509b-4aa2-ba2a-374abda18e80'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:06.938926 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-def0a61a-509b-4aa2-ba2a-374abda18e80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9328ff4a73a74fbca126dc77db7642cb', 'request_id': 'req-def0a61a-509b-4aa2-ba2a-374abda18e80'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:07.027597 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-def0a61a-509b-4aa2-ba2a-374abda18e80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9328ff4a73a74fbca126dc77db7642cb', 'request_id': 'req-def0a61a-509b-4aa2-ba2a-374abda18e80'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:07.041038 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-def0a61a-509b-4aa2-ba2a-374abda18e80 admin admin] The token cache is being invalidate because project 9328ff4a73a74fbca126dc77db7642cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 19:59:07.041326 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-def0a61a-509b-4aa2-ba2a-374abda18e80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:07.042028 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-def0a61a-509b-4aa2-ba2a-374abda18e80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:07.043556 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1025/2045] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 19:59:06 2022] DELETE /identity/v3/projects/9328ff4a73a74fbca126dc77db7642cb => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:59:07.047513 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf4f792-5906-4ce6-82e7-8411c3324e0e service neutron] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:07.058959 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf4f792-5906-4ce6-82e7-8411c3324e0e service neutron] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:07.121838 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f1dc3-6cb1-4769-b2ca-626fe51bd111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:07.123718 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f1dc3-6cb1-4769-b2ca-626fe51bd111 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:07.124341 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f1dc3-6cb1-4769-b2ca-626fe51bd111 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:07.124632 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f1dc3-6cb1-4769-b2ca-626fe51bd111 admin admin] PATH_INFO: `/v3/users/1e7dbef02c4642289da7d9ed0edef077` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:07.126117 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9f1dc3-6cb1-4769-b2ca-626fe51bd111 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e7dbef02c4642289da7d9ed0edef077)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:07.129984 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9f1dc3-6cb1-4769-b2ca-626fe51bd111 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:07.395387 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-9c9f1dc3-6cb1-4769-b2ca-626fe51bd111 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e7dbef02c4642289da7d9ed0edef077'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:07.419431 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:07.521897 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-9c9f1dc3-6cb1-4769-b2ca-626fe51bd111 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e7dbef02c4642289da7d9ed0edef077'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:07.522433 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-9c9f1dc3-6cb1-4769-b2ca-626fe51bd111 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e7dbef02c4642289da7d9ed0edef077'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:07.536330 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-9c9f1dc3-6cb1-4769-b2ca-626fe51bd111 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e7dbef02c4642289da7d9ed0edef077'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:07.537264 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-9c9f1dc3-6cb1-4769-b2ca-626fe51bd111 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e7dbef02c4642289da7d9ed0edef077'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:07.551613 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1021/2046] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 19:59:07 2022] DELETE /identity/v3/users/1e7dbef02c4642289da7d9ed0edef077 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:59:07.650191 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:07.982587 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def0a61a-509b-4aa2-ba2a-374abda18e80 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:07.984461 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-def0a61a-509b-4aa2-ba2a-374abda18e80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:07.997953 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def0a61a-509b-4aa2-ba2a-374abda18e80 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:08.061105 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e685925f-ce84-4b72-a173-a2205bdf2947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:08.061782 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685925f-ce84-4b72-a173-a2205bdf2947 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:08.062130 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685925f-ce84-4b72-a173-a2205bdf2947 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:08.062404 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685925f-ce84-4b72-a173-a2205bdf2947 admin admin] PATH_INFO: `/v3/projects/e18fadae56f94c97a043a2c1eb302e35` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:08.063520 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e685925f-ce84-4b72-a173-a2205bdf2947 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e18fadae56f94c97a043a2c1eb302e35)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:08.065419 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e685925f-ce84-4b72-a173-a2205bdf2947 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:08.918882 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-e685925f-ce84-4b72-a173-a2205bdf2947 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e18fadae56f94c97a043a2c1eb302e35', 'request_id': 'req-e685925f-ce84-4b72-a173-a2205bdf2947'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:08.938114 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-e685925f-ce84-4b72-a173-a2205bdf2947 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e18fadae56f94c97a043a2c1eb302e35', 'request_id': 'req-e685925f-ce84-4b72-a173-a2205bdf2947'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:09.113169 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-e685925f-ce84-4b72-a173-a2205bdf2947 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e18fadae56f94c97a043a2c1eb302e35', 'request_id': 'req-e685925f-ce84-4b72-a173-a2205bdf2947'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:09.113430 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:09.125175 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-e685925f-ce84-4b72-a173-a2205bdf2947 admin admin] The token cache is being invalidate because project e18fadae56f94c97a043a2c1eb302e35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 19:59:09.125461 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-e685925f-ce84-4b72-a173-a2205bdf2947 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:09.126101 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-e685925f-ce84-4b72-a173-a2205bdf2947 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:09.127633 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1026/2047] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 19:59:07 2022] DELETE /identity/v3/projects/e18fadae56f94c97a043a2c1eb302e35 => generated 0 bytes in 1146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 19:59:09.133206 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaadf32c-c2eb-4a36-b262-a071d63ed69a None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:09.133419 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaadf32c-c2eb-4a36-b262-a071d63ed69a None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:09.133867 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaadf32c-c2eb-4a36-b262-a071d63ed69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:09.154556 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-eaadf32c-c2eb-4a36-b262-a071d63ed69a None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:59:09.155758 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-eaadf32c-c2eb-4a36-b262-a071d63ed69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:09.215361 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1022/2048] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:59:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:59:09.223098 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1185d4-df25-47c2-b6d9-87fbdb509f33 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:09.223384 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1185d4-df25-47c2-b6d9-87fbdb509f33 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:09.223660 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1185d4-df25-47c2-b6d9-87fbdb509f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:09.243433 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-ff1185d4-df25-47c2-b6d9-87fbdb509f33 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:59:09.245310 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-ff1185d4-df25-47c2-b6d9-87fbdb509f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:09.253356 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1027/2049] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:59:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:59:09.257513 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaadf32c-c2eb-4a36-b262-a071d63ed69a None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:09.268062 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaadf32c-c2eb-4a36-b262-a071d63ed69a None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:09.272667 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f1b25-7965-4be0-bedb-dc18d1a2d5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:09.273278 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f1b25-7965-4be0-bedb-dc18d1a2d5dd admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:09.273571 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f1b25-7965-4be0-bedb-dc18d1a2d5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:09.273851 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f1b25-7965-4be0-bedb-dc18d1a2d5dd admin admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:09.274528 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0f1b25-7965-4be0-bedb-dc18d1a2d5dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:59:09.274835 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0f1b25-7965-4be0-bedb-dc18d1a2d5dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:09.276418 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0f1b25-7965-4be0-bedb-dc18d1a2d5dd admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:09.289184 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1023/2050] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 19:59:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:59:09.293835 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1185d4-df25-47c2-b6d9-87fbdb509f33 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:09.303079 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1185d4-df25-47c2-b6d9-87fbdb509f33 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:09.308468 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b96bc-f082-4095-b32c-bb03f5acb150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:09.309066 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b96bc-f082-4095-b32c-bb03f5acb150 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:09.309342 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b96bc-f082-4095-b32c-bb03f5acb150 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:09.309646 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b96bc-f082-4095-b32c-bb03f5acb150 admin admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:09.310270 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b96bc-f082-4095-b32c-bb03f5acb150 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:09.312149 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b96bc-f082-4095-b32c-bb03f5acb150 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:09.452881 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1028/2051] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 19:59:09 2022] POST /identity/v3/projects => generated 377 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:59:09.456189 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f1b25-7965-4be0-bedb-dc18d1a2d5dd admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:09.466480 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f1b25-7965-4be0-bedb-dc18d1a2d5dd admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:09.517022 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:09.536251 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d768e-fac8-4f7e-b90d-9132b68007b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:09.537042 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d768e-fac8-4f7e-b90d-9132b68007b7 admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:09.538163 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d768e-fac8-4f7e-b90d-9132b68007b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:09.538163 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d768e-fac8-4f7e-b90d-9132b68007b7 admin admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:09.538382 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d768e-fac8-4f7e-b90d-9132b68007b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:09.540644 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d768e-fac8-4f7e-b90d-9132b68007b7 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:09.632367 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1024/2052] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:59:09 2022] POST /identity/v3/users => generated 289 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:59:09.634736 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b96bc-f082-4095-b32c-bb03f5acb150 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:09.645445 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b96bc-f082-4095-b32c-bb03f5acb150 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:09.650708 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d8754e-0528-4334-9b75-4dbec5bcba3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:09.651794 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8754e-0528-4334-9b75-4dbec5bcba3f admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:09.651895 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8754e-0528-4334-9b75-4dbec5bcba3f admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:09.652365 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8754e-0528-4334-9b75-4dbec5bcba3f admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:09.652927 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d8754e-0528-4334-9b75-4dbec5bcba3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:09.654768 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d8754e-0528-4334-9b75-4dbec5bcba3f admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:09.685541 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1029/2053] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:59:09 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:59:09.695372 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d768e-fac8-4f7e-b90d-9132b68007b7 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:09.706063 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d768e-fac8-4f7e-b90d-9132b68007b7 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:09.711626 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d1983-4195-4892-b88a-021c0acc4923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:09.712241 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d1983-4195-4892-b88a-021c0acc4923 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:09.712529 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d1983-4195-4892-b88a-021c0acc4923 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:09.712804 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d1983-4195-4892-b88a-021c0acc4923 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:09.713583 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d1983-4195-4892-b88a-021c0acc4923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:09.715112 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d1983-4195-4892-b88a-021c0acc4923 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:09.726225 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1025/2054] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:59:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:59:09.731217 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d8754e-0528-4334-9b75-4dbec5bcba3f admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:09.741261 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d8754e-0528-4334-9b75-4dbec5bcba3f admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:09.747070 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9decdd61-1c2d-4843-924e-3086d6daf68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:09.747875 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9decdd61-1c2d-4843-924e-3086d6daf68b admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:09.748206 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9decdd61-1c2d-4843-924e-3086d6daf68b admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:09.748612 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9decdd61-1c2d-4843-924e-3086d6daf68b admin admin] PATH_INFO: `/v3/projects/e485fe65c2264d16bbd33645d29d2ee2/users/90af379636bb46c6ac6ab84de9d623ff/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:09.766801 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9decdd61-1c2d-4843-924e-3086d6daf68b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e485fe65c2264d16bbd33645d29d2ee2, user_id=90af379636bb46c6ac6ab84de9d623ff, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:09.769432 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9decdd61-1c2d-4843-924e-3086d6daf68b admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:09.790681 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:09.871997 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1030/2055] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:59:09 2022] PUT /identity/v3/projects/e485fe65c2264d16bbd33645d29d2ee2/users/90af379636bb46c6ac6ab84de9d623ff/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:59:09.883865 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf048fb-38a8-4ff8-820b-11aa5e2bfee9 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:09.884147 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf048fb-38a8-4ff8-820b-11aa5e2bfee9 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:09.884419 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf048fb-38a8-4ff8-820b-11aa5e2bfee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:09.912171 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-bdf048fb-38a8-4ff8-820b-11aa5e2bfee9 None None] MFA Rules not processed for user `90af379636bb46c6ac6ab84de9d623ff`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:59:09.913358 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-bdf048fb-38a8-4ff8-820b-11aa5e2bfee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:09.990732 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1026/2056] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:59:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:59:09.999474 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9decdd61-1c2d-4843-924e-3086d6daf68b admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:10.072364 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9decdd61-1c2d-4843-924e-3086d6daf68b admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:10.076191 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:10.083235 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f52b6e-e014-4ea8-b70c-fdec47e6c9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:10.084460 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f52b6e-e014-4ea8-b70c-fdec47e6c9b4 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:10.084460 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f52b6e-e014-4ea8-b70c-fdec47e6c9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:10.084693 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f52b6e-e014-4ea8-b70c-fdec47e6c9b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:10.085341 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f52b6e-e014-4ea8-b70c-fdec47e6c9b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:10.087710 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f52b6e-e014-4ea8-b70c-fdec47e6c9b4 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:10.207795 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1031/2057] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 19:59:09 2022] POST /identity/v3/projects => generated 377 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:59:10.212089 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf048fb-38a8-4ff8-820b-11aa5e2bfee9 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:10.214980 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:10.225737 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf048fb-38a8-4ff8-820b-11aa5e2bfee9 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:10.284581 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886c4738-9d85-41cc-9c42-9552d00bdece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:10.285192 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c4738-9d85-41cc-9c42-9552d00bdece admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:10.285469 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c4738-9d85-41cc-9c42-9552d00bdece admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:10.285772 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c4738-9d85-41cc-9c42-9552d00bdece admin admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:10.286410 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886c4738-9d85-41cc-9c42-9552d00bdece admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:10.288330 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886c4738-9d85-41cc-9c42-9552d00bdece admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:10.405945 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1027/2058] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:59:10 2022] POST /identity/v3/users => generated 289 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:59:10.411830 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f52b6e-e014-4ea8-b70c-fdec47e6c9b4 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:10.431073 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f52b6e-e014-4ea8-b70c-fdec47e6c9b4 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:10.436639 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15fc57-741a-4e9a-ae37-c9be79930f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:10.437350 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15fc57-741a-4e9a-ae37-c9be79930f72 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:10.437796 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15fc57-741a-4e9a-ae37-c9be79930f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:10.438168 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15fc57-741a-4e9a-ae37-c9be79930f72 admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:10.438886 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa15fc57-741a-4e9a-ae37-c9be79930f72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:10.440575 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa15fc57-741a-4e9a-ae37-c9be79930f72 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:10.453294 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1032/2059] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:59:10 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:59:10.457455 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886c4738-9d85-41cc-9c42-9552d00bdece admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:10.468375 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886c4738-9d85-41cc-9c42-9552d00bdece admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:10.473879 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcdbb61-aa1b-442c-9895-be706e76c739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:10.477951 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcdbb61-aa1b-442c-9895-be706e76c739 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:10.477951 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcdbb61-aa1b-442c-9895-be706e76c739 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:10.477951 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcdbb61-aa1b-442c-9895-be706e76c739 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:10.477951 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcdbb61-aa1b-442c-9895-be706e76c739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:10.477951 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcdbb61-aa1b-442c-9895-be706e76c739 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:10.490349 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1028/2060] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:59:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:59:10.490531 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:10.491589 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15fc57-741a-4e9a-ae37-c9be79930f72 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:10.502024 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15fc57-741a-4e9a-ae37-c9be79930f72 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:10.506802 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c6354-65ea-413e-a8ce-4b838edf9b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:10.507487 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c6354-65ea-413e-a8ce-4b838edf9b03 admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:10.507765 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c6354-65ea-413e-a8ce-4b838edf9b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:10.508037 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c6354-65ea-413e-a8ce-4b838edf9b03 admin admin] PATH_INFO: `/v3/projects/031d85ea9327472380849ae3efc2de4e/users/3070570d5c9844d89fd64b0a0c633fd4/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:10.523602 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190c6354-65ea-413e-a8ce-4b838edf9b03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=031d85ea9327472380849ae3efc2de4e, user_id=3070570d5c9844d89fd64b0a0c633fd4, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:10.527181 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190c6354-65ea-413e-a8ce-4b838edf9b03 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:10.605235 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1033/2061] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:59:10 2022] PUT /identity/v3/projects/031d85ea9327472380849ae3efc2de4e/users/3070570d5c9844d89fd64b0a0c633fd4/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:59:10.616241 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f977bb2-279b-487c-ae66-32d33a16cfa6 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:10.616527 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f977bb2-279b-487c-ae66-32d33a16cfa6 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:10.616809 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f977bb2-279b-487c-ae66-32d33a16cfa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:10.627299 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:10.647019 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-9f977bb2-279b-487c-ae66-32d33a16cfa6 None None] MFA Rules not processed for user `3070570d5c9844d89fd64b0a0c633fd4`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:59:10.648280 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-9f977bb2-279b-487c-ae66-32d33a16cfa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:10.741274 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1029/2062] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:59:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:59:10.746154 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c6354-65ea-413e-a8ce-4b838edf9b03 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:10.852700 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c6354-65ea-413e-a8ce-4b838edf9b03 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:10.861048 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b6bc1-68b1-40f1-85ff-ef20b9d52c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:10.862112 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b6bc1-68b1-40f1-85ff-ef20b9d52c57 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:10.862477 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b6bc1-68b1-40f1-85ff-ef20b9d52c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:10.862837 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b6bc1-68b1-40f1-85ff-ef20b9d52c57 admin admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:10.863614 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160b6bc1-68b1-40f1-85ff-ef20b9d52c57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:10.865854 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160b6bc1-68b1-40f1-85ff-ef20b9d52c57 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:10.959919 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1034/2063] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 19:59:10 2022] POST /identity/v3/projects => generated 373 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:59:10.964062 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f977bb2-279b-487c-ae66-32d33a16cfa6 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:10.974954 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f977bb2-279b-487c-ae66-32d33a16cfa6 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:11.038122 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f2787-5327-4cea-b693-7975b05c6139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:11.038733 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f2787-5327-4cea-b693-7975b05c6139 admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:11.039011 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f2787-5327-4cea-b693-7975b05c6139 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:11.039280 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f2787-5327-4cea-b693-7975b05c6139 admin admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:11.039923 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488f2787-5327-4cea-b693-7975b05c6139 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:11.044597 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488f2787-5327-4cea-b693-7975b05c6139 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:11.151166 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1030/2064] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:59:10 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:59:11.157096 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b6bc1-68b1-40f1-85ff-ef20b9d52c57 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:11.168700 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b6bc1-68b1-40f1-85ff-ef20b9d52c57 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:11.173669 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad445307-45fd-4635-a388-a27dd0c55f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:11.174277 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad445307-45fd-4635-a388-a27dd0c55f03 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:11.174555 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad445307-45fd-4635-a388-a27dd0c55f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:11.174824 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad445307-45fd-4635-a388-a27dd0c55f03 admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:11.175470 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad445307-45fd-4635-a388-a27dd0c55f03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:11.177053 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad445307-45fd-4635-a388-a27dd0c55f03 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:11.188716 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1035/2065] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:59:11.192774 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f2787-5327-4cea-b693-7975b05c6139 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:11.203051 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f2787-5327-4cea-b693-7975b05c6139 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:11.215520 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2080fe-e905-4430-b078-98c7406a2921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:11.215520 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2080fe-e905-4430-b078-98c7406a2921 admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:11.215520 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2080fe-e905-4430-b078-98c7406a2921 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:11.215520 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2080fe-e905-4430-b078-98c7406a2921 admin admin] PATH_INFO: `/v3/projects/a24a1aed102f496fb39de05c983ad862/users/96e903fb8e0b4c6baa92bbbae407a1bc/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:11.224707 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2080fe-e905-4430-b078-98c7406a2921 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a24a1aed102f496fb39de05c983ad862, user_id=96e903fb8e0b4c6baa92bbbae407a1bc, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:11.227423 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2080fe-e905-4430-b078-98c7406a2921 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:11.347545 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:11.353488 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1031/2066] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:59:11 2022] PUT /identity/v3/projects/a24a1aed102f496fb39de05c983ad862/users/96e903fb8e0b4c6baa92bbbae407a1bc/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:59:11.358235 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad445307-45fd-4635-a388-a27dd0c55f03 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:11.368573 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad445307-45fd-4635-a388-a27dd0c55f03 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:11.473584 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39912df5-8b58-498e-997b-a45625757c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:11.474283 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39912df5-8b58-498e-997b-a45625757c95 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:11.475327 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39912df5-8b58-498e-997b-a45625757c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:11.475613 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39912df5-8b58-498e-997b-a45625757c95 admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:11.476400 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39912df5-8b58-498e-997b-a45625757c95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:11.481574 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39912df5-8b58-498e-997b-a45625757c95 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:11.499241 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1036/2067] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:59:11.501982 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:11.503242 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2080fe-e905-4430-b078-98c7406a2921 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:11.519587 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2080fe-e905-4430-b078-98c7406a2921 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:11.521771 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8ad10f-fbe6-44d4-bf99-4fed0d31ee9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:11.522657 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ad10f-fbe6-44d4-bf99-4fed0d31ee9e admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:11.522880 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ad10f-fbe6-44d4-bf99-4fed0d31ee9e admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:11.523212 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ad10f-fbe6-44d4-bf99-4fed0d31ee9e admin admin] PATH_INFO: `/v3/projects/a24a1aed102f496fb39de05c983ad862/users/96e903fb8e0b4c6baa92bbbae407a1bc/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:11.531770 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8ad10f-fbe6-44d4-bf99-4fed0d31ee9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a24a1aed102f496fb39de05c983ad862, user_id=96e903fb8e0b4c6baa92bbbae407a1bc, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:11.536141 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8ad10f-fbe6-44d4-bf99-4fed0d31ee9e admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:11.556337 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1032/2068] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:59:11 2022] PUT /identity/v3/projects/a24a1aed102f496fb39de05c983ad862/users/96e903fb8e0b4c6baa92bbbae407a1bc/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:59:11.577162 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277b55b-6231-46d3-9bab-e2069db33ea7 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:11.577444 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277b55b-6231-46d3-9bab-e2069db33ea7 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:11.580717 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277b55b-6231-46d3-9bab-e2069db33ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:11.616469 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-d277b55b-6231-46d3-9bab-e2069db33ea7 None None] MFA Rules not processed for user `96e903fb8e0b4c6baa92bbbae407a1bc`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:59:11.617732 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-d277b55b-6231-46d3-9bab-e2069db33ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:11.716031 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1037/2069] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:59:11 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:59:11.729940 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8ad10f-fbe6-44d4-bf99-4fed0d31ee9e admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:11.731832 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-7e8ad10f-fbe6-44d4-bf99-4fed0d31ee9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:11.801669 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8ad10f-fbe6-44d4-bf99-4fed0d31ee9e admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:11.805410 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58022ebc-701d-4885-a44e-6768896d6230 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:11.806103 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58022ebc-701d-4885-a44e-6768896d6230 service cinder] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:11.806384 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58022ebc-701d-4885-a44e-6768896d6230 service cinder] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:11.806673 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58022ebc-701d-4885-a44e-6768896d6230 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:11.881464 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58022ebc-701d-4885-a44e-6768896d6230 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:11.882929 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58022ebc-701d-4885-a44e-6768896d6230 service cinder] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:11.893112 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1033/2070] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:59:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:59:12.029289 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:12.181331 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:12.859175 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d277b55b-6231-46d3-9bab-e2069db33ea7 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:12.862611 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-d277b55b-6231-46d3-9bab-e2069db33ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:12.951546 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d277b55b-6231-46d3-9bab-e2069db33ea7 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:12.956203 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e6b46-fa96-4c6d-aa7d-5701de60a0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:12.957135 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e6b46-fa96-4c6d-aa7d-5701de60a0fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:12.957402 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e6b46-fa96-4c6d-aa7d-5701de60a0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:12.957707 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e6b46-fa96-4c6d-aa7d-5701de60a0fa admin admin] PATH_INFO: `/v3/users/1a4367f3a94c4d3b8e95a97248e7a4ec` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:12.958840 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8e6b46-fa96-4c6d-aa7d-5701de60a0fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a4367f3a94c4d3b8e95a97248e7a4ec)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:12.960774 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8e6b46-fa96-4c6d-aa7d-5701de60a0fa admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:13.013235 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:13.087132 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:13.145112 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-4d8e6b46-fa96-4c6d-aa7d-5701de60a0fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a4367f3a94c4d3b8e95a97248e7a4ec'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:13.220723 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-4d8e6b46-fa96-4c6d-aa7d-5701de60a0fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a4367f3a94c4d3b8e95a97248e7a4ec'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:13.225061 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-4d8e6b46-fa96-4c6d-aa7d-5701de60a0fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a4367f3a94c4d3b8e95a97248e7a4ec'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:13.225061 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-4d8e6b46-fa96-4c6d-aa7d-5701de60a0fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a4367f3a94c4d3b8e95a97248e7a4ec'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:13.236950 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-4d8e6b46-fa96-4c6d-aa7d-5701de60a0fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a4367f3a94c4d3b8e95a97248e7a4ec'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:13.249803 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1038/2071] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 19:59:12 2022] DELETE /identity/v3/users/1a4367f3a94c4d3b8e95a97248e7a4ec => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:59:13.254132 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc263c7-16c1-4089-8fe9-b79d17110725 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:13.254422 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc263c7-16c1-4089-8fe9-b79d17110725 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:13.254702 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc263c7-16c1-4089-8fe9-b79d17110725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:13.276890 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-1fc263c7-16c1-4089-8fe9-b79d17110725 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:59:13.278214 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-1fc263c7-16c1-4089-8fe9-b79d17110725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:13.338981 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1034/2072] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:59:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:59:13.348949 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e6b46-fa96-4c6d-aa7d-5701de60a0fa admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:13.350411 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-4d8e6b46-fa96-4c6d-aa7d-5701de60a0fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:13.411309 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e6b46-fa96-4c6d-aa7d-5701de60a0fa admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:13.415258 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9bdec-1c85-4dee-96fe-a3283a902c8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:13.415864 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9bdec-1c85-4dee-96fe-a3283a902c8c service neutron] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:13.416240 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9bdec-1c85-4dee-96fe-a3283a902c8c service neutron] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:13.416518 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9bdec-1c85-4dee-96fe-a3283a902c8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:13.425589 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad9bdec-1c85-4dee-96fe-a3283a902c8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:13.427039 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad9bdec-1c85-4dee-96fe-a3283a902c8c service neutron] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:13.436835 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1039/2073] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:59:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:59:13.868908 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc263c7-16c1-4089-8fe9-b79d17110725 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:13.871283 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-1fc263c7-16c1-4089-8fe9-b79d17110725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:13.883393 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc263c7-16c1-4089-8fe9-b79d17110725 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:13.900040 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9082b8fe-1e13-4d85-844d-2397b51f8c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:13.900904 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082b8fe-1e13-4d85-844d-2397b51f8c8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:13.901194 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082b8fe-1e13-4d85-844d-2397b51f8c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:13.901412 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082b8fe-1e13-4d85-844d-2397b51f8c8e admin admin] PATH_INFO: `/v3/projects/3d395527355245e39624ae09250f8130` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:13.903144 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9082b8fe-1e13-4d85-844d-2397b51f8c8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d395527355245e39624ae09250f8130)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:13.905033 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9082b8fe-1e13-4d85-844d-2397b51f8c8e admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:14.064609 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-9082b8fe-1e13-4d85-844d-2397b51f8c8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d395527355245e39624ae09250f8130', 'request_id': 'req-9082b8fe-1e13-4d85-844d-2397b51f8c8e'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:14.172796 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-9082b8fe-1e13-4d85-844d-2397b51f8c8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d395527355245e39624ae09250f8130', 'request_id': 'req-9082b8fe-1e13-4d85-844d-2397b51f8c8e'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:14.176411 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:14.182920 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-9082b8fe-1e13-4d85-844d-2397b51f8c8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d395527355245e39624ae09250f8130', 'request_id': 'req-9082b8fe-1e13-4d85-844d-2397b51f8c8e'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:14.195227 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-9082b8fe-1e13-4d85-844d-2397b51f8c8e admin admin] The token cache is being invalidate because project 3d395527355245e39624ae09250f8130 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 19:59:14.195514 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-9082b8fe-1e13-4d85-844d-2397b51f8c8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:14.196179 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-9082b8fe-1e13-4d85-844d-2397b51f8c8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:14.198161 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1035/2074] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 19:59:13 2022] DELETE /identity/v3/projects/3d395527355245e39624ae09250f8130 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:59:14.204378 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec8021-2e2d-4b48-9dc9-5ebdae730a40 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:14.204689 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec8021-2e2d-4b48-9dc9-5ebdae730a40 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:14.204958 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec8021-2e2d-4b48-9dc9-5ebdae730a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:14.227008 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-47ec8021-2e2d-4b48-9dc9-5ebdae730a40 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:59:14.228328 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-47ec8021-2e2d-4b48-9dc9-5ebdae730a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:14.295063 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1040/2075] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:59:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:59:14.302978 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4dc84d-fabd-433c-aba2-301618a405c2 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:14.303262 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4dc84d-fabd-433c-aba2-301618a405c2 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:14.303551 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4dc84d-fabd-433c-aba2-301618a405c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:14.324144 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-fe4dc84d-fabd-433c-aba2-301618a405c2 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:59:14.325348 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-fe4dc84d-fabd-433c-aba2-301618a405c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:14.333712 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1036/2076] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:59:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:59:14.338869 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec8021-2e2d-4b48-9dc9-5ebdae730a40 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:14.350832 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec8021-2e2d-4b48-9dc9-5ebdae730a40 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:14.355818 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3238ebe-d3f7-4843-ae91-c401bfba3a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:14.356426 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3238ebe-d3f7-4843-ae91-c401bfba3a6a admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:14.356706 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3238ebe-d3f7-4843-ae91-c401bfba3a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:14.356977 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3238ebe-d3f7-4843-ae91-c401bfba3a6a admin admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:14.357662 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3238ebe-d3f7-4843-ae91-c401bfba3a6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:59:14.357963 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3238ebe-d3f7-4843-ae91-c401bfba3a6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:14.359547 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3238ebe-d3f7-4843-ae91-c401bfba3a6a admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:14.377557 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1041/2077] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 19:59:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:59:14.379761 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4dc84d-fabd-433c-aba2-301618a405c2 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:14.390588 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4dc84d-fabd-433c-aba2-301618a405c2 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:14.395408 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae51f4e-f452-4cab-8cbc-c3e612b1e5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:14.396049 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae51f4e-f452-4cab-8cbc-c3e612b1e5ed admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:14.396324 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae51f4e-f452-4cab-8cbc-c3e612b1e5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:14.396594 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae51f4e-f452-4cab-8cbc-c3e612b1e5ed admin admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:14.397230 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae51f4e-f452-4cab-8cbc-c3e612b1e5ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:14.398671 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:14.400829 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae51f4e-f452-4cab-8cbc-c3e612b1e5ed admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:14.494942 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1037/2078] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 19:59:14 2022] POST /identity/v3/projects => generated 369 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:59:14.499113 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3238ebe-d3f7-4843-ae91-c401bfba3a6a admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:14.508969 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3238ebe-d3f7-4843-ae91-c401bfba3a6a admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:14.571546 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ced37-5544-4a8f-a757-f3c5b965acd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:14.571546 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ced37-5544-4a8f-a757-f3c5b965acd7 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:14.571546 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ced37-5544-4a8f-a757-f3c5b965acd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:14.571546 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ced37-5544-4a8f-a757-f3c5b965acd7 admin admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:14.571850 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ced37-5544-4a8f-a757-f3c5b965acd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:14.573326 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ced37-5544-4a8f-a757-f3c5b965acd7 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:14.654416 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1042/2079] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:59:14 2022] POST /identity/v3/users => generated 285 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:59:14.658313 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae51f4e-f452-4cab-8cbc-c3e612b1e5ed admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:14.670246 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae51f4e-f452-4cab-8cbc-c3e612b1e5ed admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:14.679188 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb8e804-0c1b-47bb-9b2e-db78415a8350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:14.679860 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8e804-0c1b-47bb-9b2e-db78415a8350 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:14.680131 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8e804-0c1b-47bb-9b2e-db78415a8350 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:14.680402 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8e804-0c1b-47bb-9b2e-db78415a8350 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:14.681297 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb8e804-0c1b-47bb-9b2e-db78415a8350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:14.686179 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb8e804-0c1b-47bb-9b2e-db78415a8350 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:14.697000 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1038/2080] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:59:14 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:59:14.701215 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ced37-5544-4a8f-a757-f3c5b965acd7 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:14.712699 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ced37-5544-4a8f-a757-f3c5b965acd7 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:14.719627 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:14.726259 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be649463-1d36-4022-8f31-8bc3631e4d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:14.726259 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be649463-1d36-4022-8f31-8bc3631e4d0c admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:14.726259 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be649463-1d36-4022-8f31-8bc3631e4d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:14.726259 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be649463-1d36-4022-8f31-8bc3631e4d0c admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:14.726728 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be649463-1d36-4022-8f31-8bc3631e4d0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:14.726728 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be649463-1d36-4022-8f31-8bc3631e4d0c admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:14.738509 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1043/2081] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:59:14 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:59:14.742802 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb8e804-0c1b-47bb-9b2e-db78415a8350 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:14.754525 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb8e804-0c1b-47bb-9b2e-db78415a8350 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:14.761368 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d388f8-1de7-4cae-9c30-e2e50763db61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:14.762359 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d388f8-1de7-4cae-9c30-e2e50763db61 admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:14.762791 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d388f8-1de7-4cae-9c30-e2e50763db61 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:14.763242 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d388f8-1de7-4cae-9c30-e2e50763db61 admin admin] PATH_INFO: `/v3/projects/bf05261a41ac4e2389d3c3708022674b/users/3e4db966541843189704c7217036067c/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:14.780307 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d388f8-1de7-4cae-9c30-e2e50763db61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf05261a41ac4e2389d3c3708022674b, user_id=3e4db966541843189704c7217036067c, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:14.783573 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d388f8-1de7-4cae-9c30-e2e50763db61 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:14.952333 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1039/2082] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:59:14 2022] PUT /identity/v3/projects/bf05261a41ac4e2389d3c3708022674b/users/3e4db966541843189704c7217036067c/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:59:14.959121 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d151e-7b45-464b-b29c-9ae3f74d4da0 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:14.959506 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d151e-7b45-464b-b29c-9ae3f74d4da0 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:14.959877 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d151e-7b45-464b-b29c-9ae3f74d4da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:14.984195 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-479d151e-7b45-464b-b29c-9ae3f74d4da0 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:59:14.985519 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-479d151e-7b45-464b-b29c-9ae3f74d4da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:15.086791 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d388f8-1de7-4cae-9c30-e2e50763db61 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:15.090507 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-b6d388f8-1de7-4cae-9c30-e2e50763db61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:15.110569 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1044/2083] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:59:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:59:15.121055 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d151e-7b45-464b-b29c-9ae3f74d4da0 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:15.122767 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-479d151e-7b45-464b-b29c-9ae3f74d4da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:15.218878 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d388f8-1de7-4cae-9c30-e2e50763db61 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:15.227261 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d151e-7b45-464b-b29c-9ae3f74d4da0 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:15.230021 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9833bec2-1e55-4573-b556-646cebd873ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:15.231123 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833bec2-1e55-4573-b556-646cebd873ec service cinder] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:15.236990 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833bec2-1e55-4573-b556-646cebd873ec service cinder] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:15.236990 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833bec2-1e55-4573-b556-646cebd873ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:15.237211 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388beb95-7409-4259-bc01-89ed6644d8d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:15.237326 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-9833bec2-1e55-4573-b556-646cebd873ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:15.237402 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388beb95-7409-4259-bc01-89ed6644d8d9 service neutron] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:15.237402 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388beb95-7409-4259-bc01-89ed6644d8d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:15.237402 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388beb95-7409-4259-bc01-89ed6644d8d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:15.246576 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388beb95-7409-4259-bc01-89ed6644d8d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:15.248197 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388beb95-7409-4259-bc01-89ed6644d8d9 service neutron] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:15.260236 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1045/2084] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:59:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:59:15.458708 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9833bec2-1e55-4573-b556-646cebd873ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:15.460080 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9833bec2-1e55-4573-b556-646cebd873ec service cinder] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:15.469754 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1040/2085] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:59:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:59:15.648586 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=94,keystone:DELETE=1,keystone:INSERT=5 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:16.550648 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:17.372051 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388beb95-7409-4259-bc01-89ed6644d8d9 service neutron] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:17.374035 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-388beb95-7409-4259-bc01-89ed6644d8d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:17.396477 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388beb95-7409-4259-bc01-89ed6644d8d9 service neutron] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:17.408072 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ab3b8-ae4f-4bd8-a3fb-2d1bb0e5eb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:17.408821 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ab3b8-ae4f-4bd8-a3fb-2d1bb0e5eb17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:17.409330 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ab3b8-ae4f-4bd8-a3fb-2d1bb0e5eb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:17.409829 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ab3b8-ae4f-4bd8-a3fb-2d1bb0e5eb17 admin admin] PATH_INFO: `/v3/users/9a3e03bc7c7640b0a07a47430eb3a408` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:17.411748 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ab3b8-ae4f-4bd8-a3fb-2d1bb0e5eb17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a3e03bc7c7640b0a07a47430eb3a408)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:17.414050 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ab3b8-ae4f-4bd8-a3fb-2d1bb0e5eb17 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:17.427824 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:17.467598 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9833bec2-1e55-4573-b556-646cebd873ec service cinder] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:17.476834 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9833bec2-1e55-4573-b556-646cebd873ec service cinder] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:17.482343 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5744ca7d-cb9b-4c5b-a2b2-7a0677ae494c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:17.483209 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5744ca7d-cb9b-4c5b-a2b2-7a0677ae494c service cinder] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:17.484121 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5744ca7d-cb9b-4c5b-a2b2-7a0677ae494c service cinder] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:17.484623 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5744ca7d-cb9b-4c5b-a2b2-7a0677ae494c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:17.488767 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-5744ca7d-cb9b-4c5b-a2b2-7a0677ae494c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:17.591163 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5744ca7d-cb9b-4c5b-a2b2-7a0677ae494c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:17.594234 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5744ca7d-cb9b-4c5b-a2b2-7a0677ae494c service cinder] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:17.617664 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1041/2086] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:59:17 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 19:59:17.703561 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-625ab3b8-ae4f-4bd8-a3fb-2d1bb0e5eb17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a3e03bc7c7640b0a07a47430eb3a408'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:17.813075 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-625ab3b8-ae4f-4bd8-a3fb-2d1bb0e5eb17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a3e03bc7c7640b0a07a47430eb3a408'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:17.814287 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-625ab3b8-ae4f-4bd8-a3fb-2d1bb0e5eb17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a3e03bc7c7640b0a07a47430eb3a408'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:17.816890 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-625ab3b8-ae4f-4bd8-a3fb-2d1bb0e5eb17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a3e03bc7c7640b0a07a47430eb3a408'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:17.839437 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-625ab3b8-ae4f-4bd8-a3fb-2d1bb0e5eb17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a3e03bc7c7640b0a07a47430eb3a408'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:17.873402 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1046/2087] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 19:59:17 2022] DELETE /identity/v3/users/9a3e03bc7c7640b0a07a47430eb3a408 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:59:17.877081 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da5896-d724-43ab-8c37-088198a0d4c7 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:17.877367 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da5896-d724-43ab-8c37-088198a0d4c7 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:17.877773 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da5896-d724-43ab-8c37-088198a0d4c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:17.919908 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-04da5896-d724-43ab-8c37-088198a0d4c7 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:59:17.921330 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-04da5896-d724-43ab-8c37-088198a0d4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:18.015211 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1042/2088] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:59:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:59:18.031663 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ab3b8-ae4f-4bd8-a3fb-2d1bb0e5eb17 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:18.034333 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-625ab3b8-ae4f-4bd8-a3fb-2d1bb0e5eb17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:18.133622 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ab3b8-ae4f-4bd8-a3fb-2d1bb0e5eb17 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:18.139307 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d035c6-82b8-4e1c-8d2a-40c829c69f4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:18.140165 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d035c6-82b8-4e1c-8d2a-40c829c69f4d service neutron] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:18.143071 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d035c6-82b8-4e1c-8d2a-40c829c69f4d service neutron] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:18.143071 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d035c6-82b8-4e1c-8d2a-40c829c69f4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:18.157183 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d035c6-82b8-4e1c-8d2a-40c829c69f4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:18.158690 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d035c6-82b8-4e1c-8d2a-40c829c69f4d service neutron] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:18.179521 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1047/2089] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:59:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 19:59:18.262106 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:18.583698 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=90,keystone:DELETE=4,keystone:INSERT=6 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:19.298202 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da5896-d724-43ab-8c37-088198a0d4c7 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:19.299907 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-04da5896-d724-43ab-8c37-088198a0d4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:19.345027 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da5896-d724-43ab-8c37-088198a0d4c7 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:19.373768 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c810bf6-24ff-4d14-8d08-646efaaef1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:19.374342 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c810bf6-24ff-4d14-8d08-646efaaef1ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:19.374729 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c810bf6-24ff-4d14-8d08-646efaaef1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:19.374890 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c810bf6-24ff-4d14-8d08-646efaaef1ee admin admin] PATH_INFO: `/v3/projects/7f94c1cbe3b54179980be6c36f9cef70` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:19.376179 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c810bf6-24ff-4d14-8d08-646efaaef1ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f94c1cbe3b54179980be6c36f9cef70)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:19.378109 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c810bf6-24ff-4d14-8d08-646efaaef1ee admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:19.618326 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-1c810bf6-24ff-4d14-8d08-646efaaef1ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f94c1cbe3b54179980be6c36f9cef70', 'request_id': 'req-1c810bf6-24ff-4d14-8d08-646efaaef1ee'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:19.704172 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-1c810bf6-24ff-4d14-8d08-646efaaef1ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f94c1cbe3b54179980be6c36f9cef70', 'request_id': 'req-1c810bf6-24ff-4d14-8d08-646efaaef1ee'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:19.738869 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-1c810bf6-24ff-4d14-8d08-646efaaef1ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f94c1cbe3b54179980be6c36f9cef70', 'request_id': 'req-1c810bf6-24ff-4d14-8d08-646efaaef1ee'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:19.768022 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-1c810bf6-24ff-4d14-8d08-646efaaef1ee admin admin] The token cache is being invalidate because project 7f94c1cbe3b54179980be6c36f9cef70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 19:59:19.768993 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-1c810bf6-24ff-4d14-8d08-646efaaef1ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:19.770163 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-1c810bf6-24ff-4d14-8d08-646efaaef1ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:19.772495 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1043/2090] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 19:59:19 2022] DELETE /identity/v3/projects/7f94c1cbe3b54179980be6c36f9cef70 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:59:19.777575 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d035c6-82b8-4e1c-8d2a-40c829c69f4d service neutron] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:19.793654 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d035c6-82b8-4e1c-8d2a-40c829c69f4d service neutron] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:19.881548 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb153e4-4e75-41bc-826f-fb0fc3ed0e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:19.882216 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb153e4-4e75-41bc-826f-fb0fc3ed0e25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:19.882697 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb153e4-4e75-41bc-826f-fb0fc3ed0e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:19.883841 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb153e4-4e75-41bc-826f-fb0fc3ed0e25 admin admin] PATH_INFO: `/v3/users/4f4eedbddefc46d79b9553ba1b5765ab` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:19.885707 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb153e4-4e75-41bc-826f-fb0fc3ed0e25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f4eedbddefc46d79b9553ba1b5765ab)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:19.888240 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb153e4-4e75-41bc-826f-fb0fc3ed0e25 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:20.227816 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:20.261816 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-5eb153e4-4e75-41bc-826f-fb0fc3ed0e25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f4eedbddefc46d79b9553ba1b5765ab'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:20.370510 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-5eb153e4-4e75-41bc-826f-fb0fc3ed0e25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f4eedbddefc46d79b9553ba1b5765ab'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:20.370510 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-5eb153e4-4e75-41bc-826f-fb0fc3ed0e25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f4eedbddefc46d79b9553ba1b5765ab'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:20.370510 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-5eb153e4-4e75-41bc-826f-fb0fc3ed0e25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f4eedbddefc46d79b9553ba1b5765ab'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:20.382701 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c810bf6-24ff-4d14-8d08-646efaaef1ee admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:20.383881 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-5eb153e4-4e75-41bc-826f-fb0fc3ed0e25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f4eedbddefc46d79b9553ba1b5765ab'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:20.385246 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-1c810bf6-24ff-4d14-8d08-646efaaef1ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:20.403478 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c810bf6-24ff-4d14-8d08-646efaaef1ee admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:20.404295 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1048/2091] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 19:59:19 2022] DELETE /identity/v3/users/4f4eedbddefc46d79b9553ba1b5765ab => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:59:20.524357 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb3e5c-f0fe-4444-9fef-1fdb1e209646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:20.525005 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb3e5c-f0fe-4444-9fef-1fdb1e209646 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:20.525939 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb3e5c-f0fe-4444-9fef-1fdb1e209646 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:20.526086 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb3e5c-f0fe-4444-9fef-1fdb1e209646 admin admin] PATH_INFO: `/v3/users/014e32daafa540af92a906b9c2028db4` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:20.530253 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cb3e5c-f0fe-4444-9fef-1fdb1e209646 admin admin] RBAC: Authorizing `identity:delete_user(user_id=014e32daafa540af92a906b9c2028db4)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:20.532215 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cb3e5c-f0fe-4444-9fef-1fdb1e209646 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:20.564254 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:20.790596 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-47cb3e5c-f0fe-4444-9fef-1fdb1e209646 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '014e32daafa540af92a906b9c2028db4'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:20.841822 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:20.889966 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-47cb3e5c-f0fe-4444-9fef-1fdb1e209646 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '014e32daafa540af92a906b9c2028db4'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:20.890861 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-47cb3e5c-f0fe-4444-9fef-1fdb1e209646 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '014e32daafa540af92a906b9c2028db4'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:20.913633 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-47cb3e5c-f0fe-4444-9fef-1fdb1e209646 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '014e32daafa540af92a906b9c2028db4'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:20.953062 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-47cb3e5c-f0fe-4444-9fef-1fdb1e209646 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '014e32daafa540af92a906b9c2028db4'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:20.968769 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1044/2092] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 19:59:20 2022] DELETE /identity/v3/users/014e32daafa540af92a906b9c2028db4 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 19:59:20.970638 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb153e4-4e75-41bc-826f-fb0fc3ed0e25 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:20.973084 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-5eb153e4-4e75-41bc-826f-fb0fc3ed0e25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:20.991286 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb153e4-4e75-41bc-826f-fb0fc3ed0e25 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:21.087391 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05000ab-e1eb-44ad-90b6-5b7d5a29747b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:21.089314 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05000ab-e1eb-44ad-90b6-5b7d5a29747b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:21.089868 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05000ab-e1eb-44ad-90b6-5b7d5a29747b admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:21.090450 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05000ab-e1eb-44ad-90b6-5b7d5a29747b admin admin] PATH_INFO: `/v3/projects/a4c2f67efef144f6a5028946bb3fd1d2` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:21.091910 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05000ab-e1eb-44ad-90b6-5b7d5a29747b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4c2f67efef144f6a5028946bb3fd1d2)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:21.094090 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05000ab-e1eb-44ad-90b6-5b7d5a29747b admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:21.229064 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-e05000ab-e1eb-44ad-90b6-5b7d5a29747b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4c2f67efef144f6a5028946bb3fd1d2', 'request_id': 'req-e05000ab-e1eb-44ad-90b6-5b7d5a29747b'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:21.241546 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-e05000ab-e1eb-44ad-90b6-5b7d5a29747b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4c2f67efef144f6a5028946bb3fd1d2', 'request_id': 'req-e05000ab-e1eb-44ad-90b6-5b7d5a29747b'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:21.300649 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb3e5c-f0fe-4444-9fef-1fdb1e209646 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:21.302094 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-47cb3e5c-f0fe-4444-9fef-1fdb1e209646 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:21.320599 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb3e5c-f0fe-4444-9fef-1fdb1e209646 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:21.385204 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-e05000ab-e1eb-44ad-90b6-5b7d5a29747b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4c2f67efef144f6a5028946bb3fd1d2', 'request_id': 'req-e05000ab-e1eb-44ad-90b6-5b7d5a29747b'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:21.391665 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a027a6ed-299d-4117-9f80-9f034c779e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:21.393592 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027a6ed-299d-4117-9f80-9f034c779e88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:21.394224 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027a6ed-299d-4117-9f80-9f034c779e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:21.394496 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027a6ed-299d-4117-9f80-9f034c779e88 admin admin] PATH_INFO: `/v3/projects/346c1395acc542a2b7dffcd15c12be45` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:21.396378 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a027a6ed-299d-4117-9f80-9f034c779e88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=346c1395acc542a2b7dffcd15c12be45)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:21.398628 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a027a6ed-299d-4117-9f80-9f034c779e88 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:21.406080 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-e05000ab-e1eb-44ad-90b6-5b7d5a29747b admin admin] The token cache is being invalidate because project a4c2f67efef144f6a5028946bb3fd1d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 19:59:21.408943 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-e05000ab-e1eb-44ad-90b6-5b7d5a29747b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:21.409948 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-e05000ab-e1eb-44ad-90b6-5b7d5a29747b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:21.418705 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1049/2093] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 19:59:20 2022] DELETE /identity/v3/projects/a4c2f67efef144f6a5028946bb3fd1d2 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:59:21.420189 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f466f8-c654-4d75-b7d1-4cf02138a884 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:21.420477 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f466f8-c654-4d75-b7d1-4cf02138a884 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:21.420751 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f466f8-c654-4d75-b7d1-4cf02138a884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:21.443722 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-22f466f8-c654-4d75-b7d1-4cf02138a884 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:59:21.445050 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-22f466f8-c654-4d75-b7d1-4cf02138a884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:21.457562 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1050/2094] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:59:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:59:21.465606 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317fc4b-7dcd-480a-b872-223c473b3390 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:21.465891 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317fc4b-7dcd-480a-b872-223c473b3390 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:21.466162 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317fc4b-7dcd-480a-b872-223c473b3390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:21.486688 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-9317fc4b-7dcd-480a-b872-223c473b3390 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:59:21.487822 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-9317fc4b-7dcd-480a-b872-223c473b3390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:21.496036 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1051/2095] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:59:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:59:21.500395 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317fc4b-7dcd-480a-b872-223c473b3390 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:21.527225 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317fc4b-7dcd-480a-b872-223c473b3390 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:21.537202 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-a027a6ed-299d-4117-9f80-9f034c779e88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '346c1395acc542a2b7dffcd15c12be45', 'request_id': 'req-a027a6ed-299d-4117-9f80-9f034c779e88'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:21.618223 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-a027a6ed-299d-4117-9f80-9f034c779e88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '346c1395acc542a2b7dffcd15c12be45', 'request_id': 'req-a027a6ed-299d-4117-9f80-9f034c779e88'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:21.618839 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f8c4c4-c5f1-4a7b-892d-b5e45b6ede50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:21.619690 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8c4c4-c5f1-4a7b-892d-b5e45b6ede50 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:21.620038 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8c4c4-c5f1-4a7b-892d-b5e45b6ede50 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:21.620463 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8c4c4-c5f1-4a7b-892d-b5e45b6ede50 admin admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:21.621211 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f8c4c4-c5f1-4a7b-892d-b5e45b6ede50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:59:21.621614 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f8c4c4-c5f1-4a7b-892d-b5e45b6ede50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:21.624892 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f8c4c4-c5f1-4a7b-892d-b5e45b6ede50 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:21.626053 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-a027a6ed-299d-4117-9f80-9f034c779e88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '346c1395acc542a2b7dffcd15c12be45', 'request_id': 'req-a027a6ed-299d-4117-9f80-9f034c779e88'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:21.657810 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-a027a6ed-299d-4117-9f80-9f034c779e88 admin admin] The token cache is being invalidate because project 346c1395acc542a2b7dffcd15c12be45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 19:59:21.666595 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-a027a6ed-299d-4117-9f80-9f034c779e88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:21.666595 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-a027a6ed-299d-4117-9f80-9f034c779e88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:21.666595 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1045/2096] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 19:59:21 2022] DELETE /identity/v3/projects/346c1395acc542a2b7dffcd15c12be45 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:59:21.666983 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1052/2097] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 19:59:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:59:21.672647 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f8c4c4-c5f1-4a7b-892d-b5e45b6ede50 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:21.676521 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-91f8c4c4-c5f1-4a7b-892d-b5e45b6ede50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:21.684110 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725f457-e14d-4e6e-8a25-15910dc1faa7 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:21.684490 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725f457-e14d-4e6e-8a25-15910dc1faa7 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:21.685717 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725f457-e14d-4e6e-8a25-15910dc1faa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:21.698173 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f8c4c4-c5f1-4a7b-892d-b5e45b6ede50 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:21.705345 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf8596d-15bc-46b4-be05-c080a0e43174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:21.706276 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf8596d-15bc-46b4-be05-c080a0e43174 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:21.706976 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf8596d-15bc-46b4-be05-c080a0e43174 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:21.707449 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf8596d-15bc-46b4-be05-c080a0e43174 admin admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:21.708617 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf8596d-15bc-46b4-be05-c080a0e43174 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:21.711391 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf8596d-15bc-46b4-be05-c080a0e43174 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:21.751721 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-a725f457-e14d-4e6e-8a25-15910dc1faa7 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:59:21.753576 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-a725f457-e14d-4e6e-8a25-15910dc1faa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:21.763576 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1046/2098] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:59:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:59:21.771472 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a76de-323a-4818-9b78-1ebe487aaf26 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:21.771761 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a76de-323a-4818-9b78-1ebe487aaf26 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:21.772038 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a76de-323a-4818-9b78-1ebe487aaf26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:21.797400 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-8f7a76de-323a-4818-9b78-1ebe487aaf26 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:59:21.798850 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-8f7a76de-323a-4818-9b78-1ebe487aaf26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:21.809250 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1047/2099] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:59:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:59:21.830472 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a76de-323a-4818-9b78-1ebe487aaf26 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:21.841998 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a76de-323a-4818-9b78-1ebe487aaf26 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:21.849134 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901512d-f106-4781-bb54-f292d0a57017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:21.849134 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901512d-f106-4781-bb54-f292d0a57017 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:21.849134 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901512d-f106-4781-bb54-f292d0a57017 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:21.849134 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901512d-f106-4781-bb54-f292d0a57017 admin admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:21.849705 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9901512d-f106-4781-bb54-f292d0a57017 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:59:21.850008 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9901512d-f106-4781-bb54-f292d0a57017 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:21.851757 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9901512d-f106-4781-bb54-f292d0a57017 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:21.853401 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1053/2100] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 19:59:21 2022] POST /identity/v3/projects => generated 353 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:59:21.857372 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf8596d-15bc-46b4-be05-c080a0e43174 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:21.866898 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1048/2101] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 19:59:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:59:21.872158 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901512d-f106-4781-bb54-f292d0a57017 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:21.883253 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901512d-f106-4781-bb54-f292d0a57017 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:21.948295 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:21.984965 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d04be-8d15-4d1d-bdeb-3d3d73e51173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:21.986151 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d04be-8d15-4d1d-bdeb-3d3d73e51173 admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:21.989796 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d04be-8d15-4d1d-bdeb-3d3d73e51173 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:21.989796 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d04be-8d15-4d1d-bdeb-3d3d73e51173 admin admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:21.990216 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431d04be-8d15-4d1d-bdeb-3d3d73e51173 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:21.992965 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431d04be-8d15-4d1d-bdeb-3d3d73e51173 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:22.015923 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf8596d-15bc-46b4-be05-c080a0e43174 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:22.021159 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f8c17-659a-4b37-9eda-10e9b191d775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:22.021807 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f8c17-659a-4b37-9eda-10e9b191d775 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:22.022090 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f8c17-659a-4b37-9eda-10e9b191d775 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:22.022360 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f8c17-659a-4b37-9eda-10e9b191d775 admin admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:22.023002 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139f8c17-659a-4b37-9eda-10e9b191d775 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:22.025011 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139f8c17-659a-4b37-9eda-10e9b191d775 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:22.132856 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1049/2102] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 19:59:21 2022] POST /identity/v3/projects => generated 389 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 19:59:22.137751 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d04be-8d15-4d1d-bdeb-3d3d73e51173 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:22.216545 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1054/2103] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:59:21 2022] POST /identity/v3/users => generated 277 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 19:59:22.220588 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f8c17-659a-4b37-9eda-10e9b191d775 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:22.237929 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f8c17-659a-4b37-9eda-10e9b191d775 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:22.268405 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d04be-8d15-4d1d-bdeb-3d3d73e51173 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:22.277909 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae26245f-ae44-449b-a5a3-151d76884c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:22.279838 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae26245f-ae44-449b-a5a3-151d76884c66 admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:22.281196 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae26245f-ae44-449b-a5a3-151d76884c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:22.281196 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae26245f-ae44-449b-a5a3-151d76884c66 admin admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:22.282599 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae26245f-ae44-449b-a5a3-151d76884c66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:22.287185 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae26245f-ae44-449b-a5a3-151d76884c66 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:22.392746 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb6bd7-87bd-4227-9564-e60e64509c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:22.394413 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb6bd7-87bd-4227-9564-e60e64509c35 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:22.394697 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb6bd7-87bd-4227-9564-e60e64509c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:22.395008 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb6bd7-87bd-4227-9564-e60e64509c35 admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:22.398356 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb6bd7-87bd-4227-9564-e60e64509c35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:22.404823 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb6bd7-87bd-4227-9564-e60e64509c35 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:22.416475 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1050/2104] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:59:22 2022] POST /identity/v3/users => generated 295 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:59:22.420640 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae26245f-ae44-449b-a5a3-151d76884c66 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:22.423349 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1055/2105] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:59:22 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 19:59:22.428818 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb6bd7-87bd-4227-9564-e60e64509c35 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:22.432716 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae26245f-ae44-449b-a5a3-151d76884c66 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:22.439569 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a58878b-7a61-4f32-a6bb-8e3957777d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:22.440408 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58878b-7a61-4f32-a6bb-8e3957777d19 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:22.440836 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58878b-7a61-4f32-a6bb-8e3957777d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:22.441264 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58878b-7a61-4f32-a6bb-8e3957777d19 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:22.442218 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a58878b-7a61-4f32-a6bb-8e3957777d19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:22.443971 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a58878b-7a61-4f32-a6bb-8e3957777d19 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:22.448167 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb6bd7-87bd-4227-9564-e60e64509c35 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:22.455045 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d497d2-5195-4429-8cde-08ce188a0f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:22.455609 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d497d2-5195-4429-8cde-08ce188a0f7c admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:22.456386 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d497d2-5195-4429-8cde-08ce188a0f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:22.456960 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d497d2-5195-4429-8cde-08ce188a0f7c admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:22.457670 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d497d2-5195-4429-8cde-08ce188a0f7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:22.457837 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1051/2106] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:59:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:59:22.460454 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d497d2-5195-4429-8cde-08ce188a0f7c admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:22.466445 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a58878b-7a61-4f32-a6bb-8e3957777d19 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:22.482483 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1056/2107] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:59:22 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:59:22.484211 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d497d2-5195-4429-8cde-08ce188a0f7c admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:22.484887 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a58878b-7a61-4f32-a6bb-8e3957777d19 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:22.490456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01822aa4-4dfc-42fb-a157-59d3a3658c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:22.491592 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01822aa4-4dfc-42fb-a157-59d3a3658c55 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:22.491978 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01822aa4-4dfc-42fb-a157-59d3a3658c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:22.492351 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01822aa4-4dfc-42fb-a157-59d3a3658c55 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:22.493127 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01822aa4-4dfc-42fb-a157-59d3a3658c55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:22.495652 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01822aa4-4dfc-42fb-a157-59d3a3658c55 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:22.497850 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d497d2-5195-4429-8cde-08ce188a0f7c admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:22.503143 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1bc364-884d-42b5-b002-53a9845ef863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:22.504193 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1bc364-884d-42b5-b002-53a9845ef863 admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:22.504631 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1bc364-884d-42b5-b002-53a9845ef863 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:22.505078 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1bc364-884d-42b5-b002-53a9845ef863 admin admin] PATH_INFO: `/v3/projects/76b5669a906847ca8f22361e16c20001/users/79bfc7e01803430da014c4fa7d2c9ca2/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:22.513268 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1052/2108] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:59:22 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:59:22.529672 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01822aa4-4dfc-42fb-a157-59d3a3658c55 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:22.530783 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1bc364-884d-42b5-b002-53a9845ef863 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76b5669a906847ca8f22361e16c20001, user_id=79bfc7e01803430da014c4fa7d2c9ca2, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:22.534832 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1bc364-884d-42b5-b002-53a9845ef863 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:22.555617 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01822aa4-4dfc-42fb-a157-59d3a3658c55 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:22.600855 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c27801c-76ab-47ad-90c5-c13f4b762a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:22.602681 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27801c-76ab-47ad-90c5-c13f4b762a5d admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:22.602966 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27801c-76ab-47ad-90c5-c13f4b762a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:22.605694 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27801c-76ab-47ad-90c5-c13f4b762a5d admin admin] PATH_INFO: `/v3/projects/29e7e96d7d564d5ab2efdb93f5360951/users/f8bf9edbcb314286a4fc23f151062854/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:22.633315 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1057/2109] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:59:22 2022] PUT /identity/v3/projects/76b5669a906847ca8f22361e16c20001/users/79bfc7e01803430da014c4fa7d2c9ca2/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 19:59:22.643644 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c27801c-76ab-47ad-90c5-c13f4b762a5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=29e7e96d7d564d5ab2efdb93f5360951, user_id=f8bf9edbcb314286a4fc23f151062854, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:22.644544 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99db1c1-4a71-4bd5-894d-c406b8d70112 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:22.645014 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99db1c1-4a71-4bd5-894d-c406b8d70112 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:22.645441 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99db1c1-4a71-4bd5-894d-c406b8d70112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:22.650812 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c27801c-76ab-47ad-90c5-c13f4b762a5d admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:22.707010 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-c99db1c1-4a71-4bd5-894d-c406b8d70112 None None] MFA Rules not processed for user `79bfc7e01803430da014c4fa7d2c9ca2`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:59:22.708644 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-c99db1c1-4a71-4bd5-894d-c406b8d70112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:22.751784 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1053/2110] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:59:22 2022] PUT /identity/v3/projects/29e7e96d7d564d5ab2efdb93f5360951/users/f8bf9edbcb314286a4fc23f151062854/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:59:22.766883 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14b069-4401-425c-8ee7-574368d2b514 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:22.767210 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14b069-4401-425c-8ee7-574368d2b514 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:22.767438 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14b069-4401-425c-8ee7-574368d2b514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:22.823231 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-4d14b069-4401-425c-8ee7-574368d2b514 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:59:22.826733 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-4d14b069-4401-425c-8ee7-574368d2b514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:22.856399 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1058/2111] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:59:22 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:59:22.861345 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99db1c1-4a71-4bd5-894d-c406b8d70112 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:22.980001 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1054/2112] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:59:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:59:22.990485 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99db1c1-4a71-4bd5-894d-c406b8d70112 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:22.994869 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d14b069-4401-425c-8ee7-574368d2b514 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:22.996678 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-4d14b069-4401-425c-8ee7-574368d2b514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:22.999599 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df929b10-c469-4111-91ff-1d4aeaf2dd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:23.000280 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df929b10-c469-4111-91ff-1d4aeaf2dd45 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:23.002268 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df929b10-c469-4111-91ff-1d4aeaf2dd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:23.002491 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df929b10-c469-4111-91ff-1d4aeaf2dd45 admin admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:23.004980 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df929b10-c469-4111-91ff-1d4aeaf2dd45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:23.007069 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df929b10-c469-4111-91ff-1d4aeaf2dd45 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:23.060537 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:23.083698 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d14b069-4401-425c-8ee7-574368d2b514 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:23.095737 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8799171-7b97-44e7-b28f-8a3367d4b9fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:23.099022 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8799171-7b97-44e7-b28f-8a3367d4b9fb service neutron] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:23.099022 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8799171-7b97-44e7-b28f-8a3367d4b9fb service neutron] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:23.099022 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8799171-7b97-44e7-b28f-8a3367d4b9fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:23.107248 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8799171-7b97-44e7-b28f-8a3367d4b9fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:23.108804 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8799171-7b97-44e7-b28f-8a3367d4b9fb service neutron] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:23.118817 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1055/2113] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:59:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 19:59:23.120534 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8938b-5a64-41eb-a63f-9999fa9249e4 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:23.120829 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8938b-5a64-41eb-a63f-9999fa9249e4 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:23.121095 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8938b-5a64-41eb-a63f-9999fa9249e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:23.152168 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-5aa8938b-5a64-41eb-a63f-9999fa9249e4 None None] MFA Rules not processed for user `3e4db966541843189704c7217036067c`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:59:23.153402 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-5aa8938b-5a64-41eb-a63f-9999fa9249e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:23.165659 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1059/2114] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 19:59:22 2022] POST /identity/v3/projects => generated 357 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:59:23.183803 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df929b10-c469-4111-91ff-1d4aeaf2dd45 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:23.263456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1056/2115] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:59:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:59:23.269292 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8938b-5a64-41eb-a63f-9999fa9249e4 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:23.270176 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-5aa8938b-5a64-41eb-a63f-9999fa9249e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:23.284080 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df929b10-c469-4111-91ff-1d4aeaf2dd45 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:23.289784 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f612d3-c156-4f27-90bc-f2326a28ade1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:23.290921 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f612d3-c156-4f27-90bc-f2326a28ade1 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:23.291675 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f612d3-c156-4f27-90bc-f2326a28ade1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:23.291787 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8938b-5a64-41eb-a63f-9999fa9249e4 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:23.291870 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f612d3-c156-4f27-90bc-f2326a28ade1 admin admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:23.292429 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f612d3-c156-4f27-90bc-f2326a28ade1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:23.294327 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f612d3-c156-4f27-90bc-f2326a28ade1 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:23.297891 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c55212-e094-4808-ab27-90e4c330a410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:23.298802 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c55212-e094-4808-ab27-90e4c330a410 admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:23.299176 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c55212-e094-4808-ab27-90e4c330a410 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:23.299668 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c55212-e094-4808-ab27-90e4c330a410 admin admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:23.300407 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c55212-e094-4808-ab27-90e4c330a410 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:23.303290 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c55212-e094-4808-ab27-90e4c330a410 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:23.424950 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1060/2116] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:59:23 2022] POST /identity/v3/users => generated 285 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:59:23.428784 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f612d3-c156-4f27-90bc-f2326a28ade1 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:23.429370 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1057/2117] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 19:59:23 2022] POST /identity/v3/projects => generated 373 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:59:23.430307 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c55212-e094-4808-ab27-90e4c330a410 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:23.441173 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f612d3-c156-4f27-90bc-f2326a28ade1 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:23.564248 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec1096-4e6e-4f39-8ac1-547a774ecc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:23.565377 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec1096-4e6e-4f39-8ac1-547a774ecc80 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:23.565930 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec1096-4e6e-4f39-8ac1-547a774ecc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:23.566778 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec1096-4e6e-4f39-8ac1-547a774ecc80 admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:23.567930 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ec1096-4e6e-4f39-8ac1-547a774ecc80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:23.570375 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ec1096-4e6e-4f39-8ac1-547a774ecc80 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:23.580259 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c55212-e094-4808-ab27-90e4c330a410 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:23.585656 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1061/2118] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:59:23 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:59:23.586637 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b8e953-050c-4bf0-b006-710fba3ea0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:23.587276 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8e953-050c-4bf0-b006-710fba3ea0b4 admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:23.587586 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8e953-050c-4bf0-b006-710fba3ea0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:23.587880 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8e953-050c-4bf0-b006-710fba3ea0b4 admin admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:23.588080 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec1096-4e6e-4f39-8ac1-547a774ecc80 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:23.589625 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b8e953-050c-4bf0-b006-710fba3ea0b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:23.592028 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b8e953-050c-4bf0-b006-710fba3ea0b4 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:23.601649 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec1096-4e6e-4f39-8ac1-547a774ecc80 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:23.606993 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b26307-6f68-4480-87fd-b99334622dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:23.607922 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b26307-6f68-4480-87fd-b99334622dc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:23.608259 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b26307-6f68-4480-87fd-b99334622dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:23.608594 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b26307-6f68-4480-87fd-b99334622dc7 admin admin] PATH_INFO: `/v3/projects/bc9aef5fec374903bd53be8192fd1df7/users/ac03fe362952470783f38384919c2a02/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:23.627189 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b26307-6f68-4480-87fd-b99334622dc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc9aef5fec374903bd53be8192fd1df7, user_id=ac03fe362952470783f38384919c2a02, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:23.630022 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b26307-6f68-4480-87fd-b99334622dc7 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:23.714630 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1058/2119] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:59:23 2022] POST /identity/v3/users => generated 293 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:59:23.715559 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1062/2120] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:59:23 2022] PUT /identity/v3/projects/bc9aef5fec374903bd53be8192fd1df7/users/ac03fe362952470783f38384919c2a02/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:59:23.715685 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b8e953-050c-4bf0-b006-710fba3ea0b4 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:23.720898 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b26307-6f68-4480-87fd-b99334622dc7 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:23.751873 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b8e953-050c-4bf0-b006-710fba3ea0b4 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:23.858373 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886973e-f440-4507-a389-e0960cd3886e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:23.859147 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886973e-f440-4507-a389-e0960cd3886e admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:23.859517 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886973e-f440-4507-a389-e0960cd3886e admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:23.859915 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886973e-f440-4507-a389-e0960cd3886e admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:23.860664 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e886973e-f440-4507-a389-e0960cd3886e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:23.863050 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e886973e-f440-4507-a389-e0960cd3886e admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:23.868079 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b26307-6f68-4480-87fd-b99334622dc7 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:23.874501 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d50be8-dd12-40a5-9d39-a7ea1d6da0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:23.875467 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d50be8-dd12-40a5-9d39-a7ea1d6da0be admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:23.875645 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1059/2121] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:59:23 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:59:23.876074 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d50be8-dd12-40a5-9d39-a7ea1d6da0be admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:23.876395 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d50be8-dd12-40a5-9d39-a7ea1d6da0be admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:23.877159 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d50be8-dd12-40a5-9d39-a7ea1d6da0be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:23.880855 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886973e-f440-4507-a389-e0960cd3886e admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:23.885383 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d50be8-dd12-40a5-9d39-a7ea1d6da0be admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:23.905559 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1063/2122] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:59:23 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:59:23.913743 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d50be8-dd12-40a5-9d39-a7ea1d6da0be admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:23.920082 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886973e-f440-4507-a389-e0960cd3886e admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:23.931427 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a757d389-2f76-414b-8a24-98bf099e7146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:23.932113 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a757d389-2f76-414b-8a24-98bf099e7146 admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:23.932568 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d50be8-dd12-40a5-9d39-a7ea1d6da0be admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:23.938212 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a757d389-2f76-414b-8a24-98bf099e7146 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:23.938495 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a757d389-2f76-414b-8a24-98bf099e7146 admin admin] PATH_INFO: `/v3/projects/f918f780d4ee4049a26de8f2af019872/users/a406b3f1785441b894ed53eb9ac3981a/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:23.955560 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537b438-425e-49c5-b68e-3134ed3d8ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:23.956252 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537b438-425e-49c5-b68e-3134ed3d8ade admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:23.956790 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537b438-425e-49c5-b68e-3134ed3d8ade admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:23.957092 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537b438-425e-49c5-b68e-3134ed3d8ade admin admin] PATH_INFO: `/v3/projects/bc9aef5fec374903bd53be8192fd1df7/users/ac03fe362952470783f38384919c2a02/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:23.959384 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0537b438-425e-49c5-b68e-3134ed3d8ade admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc9aef5fec374903bd53be8192fd1df7, user_id=ac03fe362952470783f38384919c2a02, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:23.960434 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a757d389-2f76-414b-8a24-98bf099e7146 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f918f780d4ee4049a26de8f2af019872, user_id=a406b3f1785441b894ed53eb9ac3981a, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:23.962201 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0537b438-425e-49c5-b68e-3134ed3d8ade admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:23.964284 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a757d389-2f76-414b-8a24-98bf099e7146 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:23.977334 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1064/2123] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:59:23 2022] PUT /identity/v3/projects/bc9aef5fec374903bd53be8192fd1df7/users/ac03fe362952470783f38384919c2a02/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:59:23.989049 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de385354-c6f6-492c-9d3d-7c723fa0d18b None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:23.989370 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de385354-c6f6-492c-9d3d-7c723fa0d18b None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:23.989689 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de385354-c6f6-492c-9d3d-7c723fa0d18b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:24.021244 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-de385354-c6f6-492c-9d3d-7c723fa0d18b None None] MFA Rules not processed for user `ac03fe362952470783f38384919c2a02`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:59:24.022529 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-de385354-c6f6-492c-9d3d-7c723fa0d18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:24.093630 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1060/2124] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:59:23 2022] PUT /identity/v3/projects/f918f780d4ee4049a26de8f2af019872/users/a406b3f1785441b894ed53eb9ac3981a/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:59:24.104224 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a757d389-2f76-414b-8a24-98bf099e7146 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:24.113436 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1065/2125] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:59:23 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:59:24.118343 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:24.127600 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de385354-c6f6-492c-9d3d-7c723fa0d18b None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:24.131875 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-de385354-c6f6-492c-9d3d-7c723fa0d18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:24.263434 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de385354-c6f6-492c-9d3d-7c723fa0d18b None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:24.296636 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a757d389-2f76-414b-8a24-98bf099e7146 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:24.310464 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f4de0-de9e-479a-8f30-9717dfbd66e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:24.311228 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f4de0-de9e-479a-8f30-9717dfbd66e2 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:24.311595 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f4de0-de9e-479a-8f30-9717dfbd66e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:24.311949 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f4de0-de9e-479a-8f30-9717dfbd66e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:24.312955 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689f4de0-de9e-479a-8f30-9717dfbd66e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:24.315970 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689f4de0-de9e-479a-8f30-9717dfbd66e2 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:24.332911 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1061/2126] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:59:24 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 19:59:24.334522 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f4de0-de9e-479a-8f30-9717dfbd66e2 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:24.337655 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-689f4de0-de9e-479a-8f30-9717dfbd66e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:24.356074 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b0c37-d236-4a30-b14a-1c730b726d63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:24.356866 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b0c37-d236-4a30-b14a-1c730b726d63 service cinder] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:24.357154 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b0c37-d236-4a30-b14a-1c730b726d63 service cinder] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:24.357433 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b0c37-d236-4a30-b14a-1c730b726d63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:24.359023 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f4de0-de9e-479a-8f30-9717dfbd66e2 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:24.371621 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6e84ad-4e48-4e7b-8fd0-71385a0fc44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:24.371946 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e84ad-4e48-4e7b-8fd0-71385a0fc44f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:24.372429 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e84ad-4e48-4e7b-8fd0-71385a0fc44f admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:24.372751 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e84ad-4e48-4e7b-8fd0-71385a0fc44f admin admin] PATH_INFO: `/v3/users/90af379636bb46c6ac6ab84de9d623ff` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:24.374185 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6e84ad-4e48-4e7b-8fd0-71385a0fc44f admin admin] RBAC: Authorizing `identity:delete_user(user_id=90af379636bb46c6ac6ab84de9d623ff)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:24.377515 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6e84ad-4e48-4e7b-8fd0-71385a0fc44f admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:24.441866 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b0c37-d236-4a30-b14a-1c730b726d63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:24.443445 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b0c37-d236-4a30-b14a-1c730b726d63 service cinder] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:24.456587 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1066/2127] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:59:24 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:59:24.457573 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b0c37-d236-4a30-b14a-1c730b726d63 service cinder] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:24.469596 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b0c37-d236-4a30-b14a-1c730b726d63 service cinder] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:24.477774 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a3ce36-5f4a-41f1-af10-b1db0abf9998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:24.478527 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3ce36-5f4a-41f1-af10-b1db0abf9998 admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:24.478809 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3ce36-5f4a-41f1-af10-b1db0abf9998 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:24.479084 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3ce36-5f4a-41f1-af10-b1db0abf9998 admin admin] PATH_INFO: `/v3/projects/f918f780d4ee4049a26de8f2af019872/users/a406b3f1785441b894ed53eb9ac3981a/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:24.482602 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a3ce36-5f4a-41f1-af10-b1db0abf9998 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f918f780d4ee4049a26de8f2af019872, user_id=a406b3f1785441b894ed53eb9ac3981a, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:24.485542 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a3ce36-5f4a-41f1-af10-b1db0abf9998 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:24.500792 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1067/2128] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:59:24 2022] PUT /identity/v3/projects/f918f780d4ee4049a26de8f2af019872/users/a406b3f1785441b894ed53eb9ac3981a/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:59:24.577213 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-ab6e84ad-4e48-4e7b-8fd0-71385a0fc44f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90af379636bb46c6ac6ab84de9d623ff'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:24.684078 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-ab6e84ad-4e48-4e7b-8fd0-71385a0fc44f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90af379636bb46c6ac6ab84de9d623ff'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:24.688417 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-ab6e84ad-4e48-4e7b-8fd0-71385a0fc44f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90af379636bb46c6ac6ab84de9d623ff'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:24.715611 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-ab6e84ad-4e48-4e7b-8fd0-71385a0fc44f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90af379636bb46c6ac6ab84de9d623ff'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:24.716498 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-ab6e84ad-4e48-4e7b-8fd0-71385a0fc44f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90af379636bb46c6ac6ab84de9d623ff'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:24.740407 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1062/2129] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 19:59:24 2022] DELETE /identity/v3/users/90af379636bb46c6ac6ab84de9d623ff => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:59:24.745560 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe8552-ece4-46a4-89e4-78d32e452355 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:24.745910 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe8552-ece4-46a4-89e4-78d32e452355 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:24.746149 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe8552-ece4-46a4-89e4-78d32e452355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:24.750045 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6e84ad-4e48-4e7b-8fd0-71385a0fc44f admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:24.754071 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-ab6e84ad-4e48-4e7b-8fd0-71385a0fc44f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:24.793569 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-b0fe8552-ece4-46a4-89e4-78d32e452355 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:59:24.794810 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-b0fe8552-ece4-46a4-89e4-78d32e452355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:24.818649 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:24.873719 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6e84ad-4e48-4e7b-8fd0-71385a0fc44f admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:24.877765 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3facb42-4d81-4a3c-9465-c4a9f46ba8d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:24.878388 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3facb42-4d81-4a3c-9465-c4a9f46ba8d1 service cinder] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:24.878667 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3facb42-4d81-4a3c-9465-c4a9f46ba8d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:24.878944 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3facb42-4d81-4a3c-9465-c4a9f46ba8d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:24.880984 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-e3facb42-4d81-4a3c-9465-c4a9f46ba8d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:24.927792 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1068/2130] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:59:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:59:24.940757 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fe8552-ece4-46a4-89e4-78d32e452355 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:24.942604 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-b0fe8552-ece4-46a4-89e4-78d32e452355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:24.982124 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3facb42-4d81-4a3c-9465-c4a9f46ba8d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:24.984078 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3facb42-4d81-4a3c-9465-c4a9f46ba8d1 service cinder] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:25.011684 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1063/2131] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:59:24 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:59:25.023087 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fe8552-ece4-46a4-89e4-78d32e452355 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:25.027956 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c64248-bb68-4a38-9645-5aa244dfa45b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:25.028613 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c64248-bb68-4a38-9645-5aa244dfa45b service neutron] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:25.033526 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c64248-bb68-4a38-9645-5aa244dfa45b service neutron] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:25.033526 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c64248-bb68-4a38-9645-5aa244dfa45b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:25.060304 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c64248-bb68-4a38-9645-5aa244dfa45b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:25.061955 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c64248-bb68-4a38-9645-5aa244dfa45b service neutron] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:25.075629 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1069/2132] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:59:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 19:59:25.673532 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:25.947857 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3facb42-4d81-4a3c-9465-c4a9f46ba8d1 service cinder] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:25.949571 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-e3facb42-4d81-4a3c-9465-c4a9f46ba8d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:25.985588 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3facb42-4d81-4a3c-9465-c4a9f46ba8d1 service cinder] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:26.004646 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27695afa-93e6-4e6b-98e0-7e8b696c6fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:26.010229 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27695afa-93e6-4e6b-98e0-7e8b696c6fe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:26.010634 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27695afa-93e6-4e6b-98e0-7e8b696c6fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:26.010936 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27695afa-93e6-4e6b-98e0-7e8b696c6fe4 admin admin] PATH_INFO: `/v3/projects/e485fe65c2264d16bbd33645d29d2ee2` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:26.013685 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27695afa-93e6-4e6b-98e0-7e8b696c6fe4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e485fe65c2264d16bbd33645d29d2ee2)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:26.016457 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27695afa-93e6-4e6b-98e0-7e8b696c6fe4 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:26.198107 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-27695afa-93e6-4e6b-98e0-7e8b696c6fe4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e485fe65c2264d16bbd33645d29d2ee2', 'request_id': 'req-27695afa-93e6-4e6b-98e0-7e8b696c6fe4'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:26.286746 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-27695afa-93e6-4e6b-98e0-7e8b696c6fe4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e485fe65c2264d16bbd33645d29d2ee2', 'request_id': 'req-27695afa-93e6-4e6b-98e0-7e8b696c6fe4'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:26.298510 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-27695afa-93e6-4e6b-98e0-7e8b696c6fe4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e485fe65c2264d16bbd33645d29d2ee2', 'request_id': 'req-27695afa-93e6-4e6b-98e0-7e8b696c6fe4'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:26.337020 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-27695afa-93e6-4e6b-98e0-7e8b696c6fe4 admin admin] The token cache is being invalidate because project e485fe65c2264d16bbd33645d29d2ee2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 19:59:26.341008 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-27695afa-93e6-4e6b-98e0-7e8b696c6fe4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:26.347740 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-27695afa-93e6-4e6b-98e0-7e8b696c6fe4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:26.360466 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1064/2133] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 19:59:25 2022] DELETE /identity/v3/projects/e485fe65c2264d16bbd33645d29d2ee2 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:59:26.361935 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c64248-bb68-4a38-9645-5aa244dfa45b service neutron] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:26.376619 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c64248-bb68-4a38-9645-5aa244dfa45b service neutron] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:26.485029 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25006030-ae4c-4305-8278-5fc94fb25e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:26.486283 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25006030-ae4c-4305-8278-5fc94fb25e87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:26.486836 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25006030-ae4c-4305-8278-5fc94fb25e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:26.487260 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25006030-ae4c-4305-8278-5fc94fb25e87 admin admin] PATH_INFO: `/v3/users/3070570d5c9844d89fd64b0a0c633fd4` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:26.490333 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25006030-ae4c-4305-8278-5fc94fb25e87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3070570d5c9844d89fd64b0a0c633fd4)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:26.492628 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25006030-ae4c-4305-8278-5fc94fb25e87 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:26.607139 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:26.825601 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-25006030-ae4c-4305-8278-5fc94fb25e87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3070570d5c9844d89fd64b0a0c633fd4'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:26.911390 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-25006030-ae4c-4305-8278-5fc94fb25e87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3070570d5c9844d89fd64b0a0c633fd4'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:26.912372 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-25006030-ae4c-4305-8278-5fc94fb25e87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3070570d5c9844d89fd64b0a0c633fd4'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:26.913513 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-25006030-ae4c-4305-8278-5fc94fb25e87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3070570d5c9844d89fd64b0a0c633fd4'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:26.941421 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-25006030-ae4c-4305-8278-5fc94fb25e87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3070570d5c9844d89fd64b0a0c633fd4'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:26.988916 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1070/2134] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 19:59:26 2022] DELETE /identity/v3/users/3070570d5c9844d89fd64b0a0c633fd4 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:59:28.003316 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27695afa-93e6-4e6b-98e0-7e8b696c6fe4 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:28.006651 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-27695afa-93e6-4e6b-98e0-7e8b696c6fe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:28.043390 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27695afa-93e6-4e6b-98e0-7e8b696c6fe4 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:28.052819 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:28.215252 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c3001a-f28f-4a44-bf64-21cd6e7d9796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:28.216196 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3001a-f28f-4a44-bf64-21cd6e7d9796 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:28.216769 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3001a-f28f-4a44-bf64-21cd6e7d9796 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:28.217262 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3001a-f28f-4a44-bf64-21cd6e7d9796 admin admin] PATH_INFO: `/v3/projects/031d85ea9327472380849ae3efc2de4e` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:28.219896 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c3001a-f28f-4a44-bf64-21cd6e7d9796 admin admin] RBAC: Authorizing `identity:delete_project(project_id=031d85ea9327472380849ae3efc2de4e)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:28.223467 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c3001a-f28f-4a44-bf64-21cd6e7d9796 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:28.418139 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-e8c3001a-f28f-4a44-bf64-21cd6e7d9796 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '031d85ea9327472380849ae3efc2de4e', 'request_id': 'req-e8c3001a-f28f-4a44-bf64-21cd6e7d9796'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:28.526762 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-e8c3001a-f28f-4a44-bf64-21cd6e7d9796 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '031d85ea9327472380849ae3efc2de4e', 'request_id': 'req-e8c3001a-f28f-4a44-bf64-21cd6e7d9796'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:28.534024 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-e8c3001a-f28f-4a44-bf64-21cd6e7d9796 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '031d85ea9327472380849ae3efc2de4e', 'request_id': 'req-e8c3001a-f28f-4a44-bf64-21cd6e7d9796'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:28.550579 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:28.567869 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-e8c3001a-f28f-4a44-bf64-21cd6e7d9796 admin admin] The token cache is being invalidate because project 031d85ea9327472380849ae3efc2de4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 19:59:28.568328 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-e8c3001a-f28f-4a44-bf64-21cd6e7d9796 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:28.569114 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-e8c3001a-f28f-4a44-bf64-21cd6e7d9796 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:28.570814 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1065/2135] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 19:59:28 2022] DELETE /identity/v3/projects/031d85ea9327472380849ae3efc2de4e => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:59:28.575567 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25006030-ae4c-4305-8278-5fc94fb25e87 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:28.577164 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-25006030-ae4c-4305-8278-5fc94fb25e87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:28.602399 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25006030-ae4c-4305-8278-5fc94fb25e87 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:28.711285 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610fc911-4b13-4b40-97e4-14a391b5433c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:28.712759 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610fc911-4b13-4b40-97e4-14a391b5433c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:28.713189 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610fc911-4b13-4b40-97e4-14a391b5433c admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:28.713707 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610fc911-4b13-4b40-97e4-14a391b5433c admin admin] PATH_INFO: `/v3/users/96e903fb8e0b4c6baa92bbbae407a1bc` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:28.721868 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610fc911-4b13-4b40-97e4-14a391b5433c admin admin] RBAC: Authorizing `identity:delete_user(user_id=96e903fb8e0b4c6baa92bbbae407a1bc)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:28.726597 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610fc911-4b13-4b40-97e4-14a391b5433c admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:28.968565 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-610fc911-4b13-4b40-97e4-14a391b5433c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96e903fb8e0b4c6baa92bbbae407a1bc'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:29.075669 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-610fc911-4b13-4b40-97e4-14a391b5433c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96e903fb8e0b4c6baa92bbbae407a1bc'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:29.077745 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-610fc911-4b13-4b40-97e4-14a391b5433c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96e903fb8e0b4c6baa92bbbae407a1bc'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:29.078405 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-610fc911-4b13-4b40-97e4-14a391b5433c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96e903fb8e0b4c6baa92bbbae407a1bc'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:29.101787 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-610fc911-4b13-4b40-97e4-14a391b5433c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96e903fb8e0b4c6baa92bbbae407a1bc'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:29.128990 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1071/2136] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 19:59:28 2022] DELETE /identity/v3/users/96e903fb8e0b4c6baa92bbbae407a1bc => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:59:29.444291 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:30.205461 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:30.410666 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c3001a-f28f-4a44-bf64-21cd6e7d9796 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:30.412122 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-e8c3001a-f28f-4a44-bf64-21cd6e7d9796 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:30.441486 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c3001a-f28f-4a44-bf64-21cd6e7d9796 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:30.525644 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:30.601328 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc217d40-2226-4b27-a4f4-3e8ecb5267df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:30.603347 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc217d40-2226-4b27-a4f4-3e8ecb5267df admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:30.603932 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc217d40-2226-4b27-a4f4-3e8ecb5267df admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:30.604216 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc217d40-2226-4b27-a4f4-3e8ecb5267df admin admin] PATH_INFO: `/v3/projects/a24a1aed102f496fb39de05c983ad862` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:30.605422 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc217d40-2226-4b27-a4f4-3e8ecb5267df admin admin] RBAC: Authorizing `identity:delete_project(project_id=a24a1aed102f496fb39de05c983ad862)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:30.607391 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc217d40-2226-4b27-a4f4-3e8ecb5267df admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:30.838914 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-fc217d40-2226-4b27-a4f4-3e8ecb5267df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a24a1aed102f496fb39de05c983ad862', 'request_id': 'req-fc217d40-2226-4b27-a4f4-3e8ecb5267df'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:30.943239 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-fc217d40-2226-4b27-a4f4-3e8ecb5267df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a24a1aed102f496fb39de05c983ad862', 'request_id': 'req-fc217d40-2226-4b27-a4f4-3e8ecb5267df'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:30.947757 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d92e2-5416-4573-84f1-83a0103f7e01 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:30.948270 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d92e2-5416-4573-84f1-83a0103f7e01 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:30.948706 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d92e2-5416-4573-84f1-83a0103f7e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:30.954383 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-fc217d40-2226-4b27-a4f4-3e8ecb5267df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a24a1aed102f496fb39de05c983ad862', 'request_id': 'req-fc217d40-2226-4b27-a4f4-3e8ecb5267df'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:30.981920 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-cf7d92e2-5416-4573-84f1-83a0103f7e01 None None] MFA Rules not processed for user `f8bf9edbcb314286a4fc23f151062854`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:59:30.983406 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-cf7d92e2-5416-4573-84f1-83a0103f7e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:30.983841 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-fc217d40-2226-4b27-a4f4-3e8ecb5267df admin admin] The token cache is being invalidate because project a24a1aed102f496fb39de05c983ad862 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 19:59:30.984369 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-fc217d40-2226-4b27-a4f4-3e8ecb5267df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:30.985321 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-fc217d40-2226-4b27-a4f4-3e8ecb5267df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:30.993920 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1066/2137] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 19:59:30 2022] DELETE /identity/v3/projects/a24a1aed102f496fb39de05c983ad862 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:59:30.996330 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3cc8e5-cf77-4896-8b5b-0c903f9459ef None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:30.997664 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3cc8e5-cf77-4896-8b5b-0c903f9459ef None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:30.998128 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3cc8e5-cf77-4896-8b5b-0c903f9459ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:31.069141 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-2e3cc8e5-cf77-4896-8b5b-0c903f9459ef None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:59:31.071087 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-2e3cc8e5-cf77-4896-8b5b-0c903f9459ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:31.095172 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1072/2138] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:59:30 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:59:31.103412 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d92e2-5416-4573-84f1-83a0103f7e01 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:31.108463 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-cf7d92e2-5416-4573-84f1-83a0103f7e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:31.182762 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1067/2139] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:59:31.191957 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936fea6a-f0ac-4ead-8990-fe15b5fd4646 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:31.192354 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936fea6a-f0ac-4ead-8990-fe15b5fd4646 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:31.192691 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936fea6a-f0ac-4ead-8990-fe15b5fd4646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:31.234115 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-936fea6a-f0ac-4ead-8990-fe15b5fd4646 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:59:31.235445 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-936fea6a-f0ac-4ead-8990-fe15b5fd4646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:31.243995 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d92e2-5416-4573-84f1-83a0103f7e01 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:31.248585 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1068/2140] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:59:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:59:31.252641 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936fea6a-f0ac-4ead-8990-fe15b5fd4646 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:31.263840 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e2038-6f4a-4e5b-ac51-c7949b0ad8d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5047a59bc4547be643ffa78808a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:31.264615 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e2038-6f4a-4e5b-ac51-c7949b0ad8d8 service nova] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:31.264908 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e2038-6f4a-4e5b-ac51-c7949b0ad8d8 service nova] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:31.265175 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e2038-6f4a-4e5b-ac51-c7949b0ad8d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:31.267960 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936fea6a-f0ac-4ead-8990-fe15b5fd4646 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:31.280027 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448298a8-8d51-4564-92f0-959ec3368730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:31.280649 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448298a8-8d51-4564-92f0-959ec3368730 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:31.280920 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448298a8-8d51-4564-92f0-959ec3368730 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:31.282128 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448298a8-8d51-4564-92f0-959ec3368730 admin admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:31.282128 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448298a8-8d51-4564-92f0-959ec3368730 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:59:31.282338 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448298a8-8d51-4564-92f0-959ec3368730 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:31.283971 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448298a8-8d51-4564-92f0-959ec3368730 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:31.286561 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446e2038-6f4a-4e5b-ac51-c7949b0ad8d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:31.288177 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446e2038-6f4a-4e5b-ac51-c7949b0ad8d8 service nova] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:31.307694 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1069/2142] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 19:59:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:59:31.307906 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1073/2142] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:59:31 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:59:31.324993 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:31.326454 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448298a8-8d51-4564-92f0-959ec3368730 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:31.347505 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448298a8-8d51-4564-92f0-959ec3368730 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:31.358360 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c215e40d-39bf-4fc2-9f66-adc74e4ab6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:31.359159 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215e40d-39bf-4fc2-9f66-adc74e4ab6b6 admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:31.359531 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215e40d-39bf-4fc2-9f66-adc74e4ab6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:31.359894 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215e40d-39bf-4fc2-9f66-adc74e4ab6b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:31.361413 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c215e40d-39bf-4fc2-9f66-adc74e4ab6b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:31.363746 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c215e40d-39bf-4fc2-9f66-adc74e4ab6b6 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:31.562563 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1070/2143] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 19:59:31 2022] POST /identity/v3/projects => generated 385 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:59:31.566777 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e2038-6f4a-4e5b-ac51-c7949b0ad8d8 service nova] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:31.591208 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e2038-6f4a-4e5b-ac51-c7949b0ad8d8 service nova] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:31.805234 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0de7e4-409e-4bcd-bb64-fd14c91aa53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:31.807250 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0de7e4-409e-4bcd-bb64-fd14c91aa53b admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:31.808616 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0de7e4-409e-4bcd-bb64-fd14c91aa53b admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:31.809091 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0de7e4-409e-4bcd-bb64-fd14c91aa53b admin admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:31.810161 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0de7e4-409e-4bcd-bb64-fd14c91aa53b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:31.812591 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0de7e4-409e-4bcd-bb64-fd14c91aa53b admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:32.025168 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1074/2144] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:59:31 2022] POST /identity/v3/users => generated 293 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:59:32.028135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c215e40d-39bf-4fc2-9f66-adc74e4ab6b6 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:32.049788 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c215e40d-39bf-4fc2-9f66-adc74e4ab6b6 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:32.059635 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f976ccc9-1a84-4b3e-9c5b-8554a518457c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:32.060317 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976ccc9-1a84-4b3e-9c5b-8554a518457c admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:32.060602 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976ccc9-1a84-4b3e-9c5b-8554a518457c admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:32.060866 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976ccc9-1a84-4b3e-9c5b-8554a518457c admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:32.061740 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f976ccc9-1a84-4b3e-9c5b-8554a518457c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:32.064719 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f976ccc9-1a84-4b3e-9c5b-8554a518457c admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:32.078416 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1071/2145] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:59:32.088866 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0de7e4-409e-4bcd-bb64-fd14c91aa53b admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:32.101951 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0de7e4-409e-4bcd-bb64-fd14c91aa53b admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:32.109753 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c933f7b-66cf-4b8a-9229-d134858a819a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:32.110621 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c933f7b-66cf-4b8a-9229-d134858a819a admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:32.113379 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c933f7b-66cf-4b8a-9229-d134858a819a admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:32.113379 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c933f7b-66cf-4b8a-9229-d134858a819a admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:32.113379 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c933f7b-66cf-4b8a-9229-d134858a819a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:32.119936 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c933f7b-66cf-4b8a-9229-d134858a819a admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:32.136427 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1075/2146] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:59:32.140695 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f976ccc9-1a84-4b3e-9c5b-8554a518457c admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:32.161375 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f976ccc9-1a84-4b3e-9c5b-8554a518457c admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:32.169522 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae951c6d-e2bf-4276-b41e-e62a92493d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:32.183721 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae951c6d-e2bf-4276-b41e-e62a92493d42 admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:32.184554 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae951c6d-e2bf-4276-b41e-e62a92493d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:32.184974 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae951c6d-e2bf-4276-b41e-e62a92493d42 admin admin] PATH_INFO: `/v3/projects/c269cb1efff14d59b80f605de1cd0332/users/13067a6bbb78494996a768cbfe89ec2f/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:32.235438 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae951c6d-e2bf-4276-b41e-e62a92493d42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c269cb1efff14d59b80f605de1cd0332, user_id=13067a6bbb78494996a768cbfe89ec2f, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:32.239483 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae951c6d-e2bf-4276-b41e-e62a92493d42 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:32.346714 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1072/2147] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:59:32 2022] PUT /identity/v3/projects/c269cb1efff14d59b80f605de1cd0332/users/13067a6bbb78494996a768cbfe89ec2f/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:59:32.359618 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc17685-32c5-4925-8d47-34e275f1982e None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:32.360288 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc17685-32c5-4925-8d47-34e275f1982e None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:32.360698 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc17685-32c5-4925-8d47-34e275f1982e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:32.424083 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-0cc17685-32c5-4925-8d47-34e275f1982e None None] MFA Rules not processed for user `13067a6bbb78494996a768cbfe89ec2f`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:59:32.425687 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-0cc17685-32c5-4925-8d47-34e275f1982e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:32.518179 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1076/2148] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:59:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:59:32.518736 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae951c6d-e2bf-4276-b41e-e62a92493d42 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:32.726987 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae951c6d-e2bf-4276-b41e-e62a92493d42 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:32.733944 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c514ac3-9512-4515-8771-6783ee99135f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:32.734837 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c514ac3-9512-4515-8771-6783ee99135f admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:32.735264 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c514ac3-9512-4515-8771-6783ee99135f admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:32.735676 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c514ac3-9512-4515-8771-6783ee99135f admin admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:32.736472 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c514ac3-9512-4515-8771-6783ee99135f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:32.739058 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c514ac3-9512-4515-8771-6783ee99135f admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:32.871723 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc17685-32c5-4925-8d47-34e275f1982e None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:32.873231 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1073/2149] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 19:59:32 2022] POST /identity/v3/projects => generated 385 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 19:59:32.895245 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc17685-32c5-4925-8d47-34e275f1982e None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:33.019983 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4120b485-c52e-4e27-bec2-6d39633e6eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:33.020705 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4120b485-c52e-4e27-bec2-6d39633e6eb6 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:33.021056 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4120b485-c52e-4e27-bec2-6d39633e6eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:33.021400 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4120b485-c52e-4e27-bec2-6d39633e6eb6 admin admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:33.022344 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4120b485-c52e-4e27-bec2-6d39633e6eb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:33.024387 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4120b485-c52e-4e27-bec2-6d39633e6eb6 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:33.129554 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1077/2150] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:59:32 2022] POST /identity/v3/users => generated 293 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:59:33.131737 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c514ac3-9512-4515-8771-6783ee99135f admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:33.145416 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c514ac3-9512-4515-8771-6783ee99135f admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:33.149924 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:33.151985 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aec7c63-a97d-412a-8d76-8c9f1c4fe086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:33.153080 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec7c63-a97d-412a-8d76-8c9f1c4fe086 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:33.153626 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec7c63-a97d-412a-8d76-8c9f1c4fe086 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:33.154207 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec7c63-a97d-412a-8d76-8c9f1c4fe086 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:33.155390 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aec7c63-a97d-412a-8d76-8c9f1c4fe086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:33.157760 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aec7c63-a97d-412a-8d76-8c9f1c4fe086 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:33.175888 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1074/2151] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:59:33.184435 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4120b485-c52e-4e27-bec2-6d39633e6eb6 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:33.195615 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4120b485-c52e-4e27-bec2-6d39633e6eb6 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:33.204705 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254faf3-ef65-448f-a41b-c9a6b802cfdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:33.205330 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254faf3-ef65-448f-a41b-c9a6b802cfdb admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:33.206488 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254faf3-ef65-448f-a41b-c9a6b802cfdb admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:33.206810 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254faf3-ef65-448f-a41b-c9a6b802cfdb admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:33.207641 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e254faf3-ef65-448f-a41b-c9a6b802cfdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:33.210615 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e254faf3-ef65-448f-a41b-c9a6b802cfdb admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:33.229054 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1078/2152] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:59:33.230427 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aec7c63-a97d-412a-8d76-8c9f1c4fe086 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:33.246002 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aec7c63-a97d-412a-8d76-8c9f1c4fe086 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:33.274544 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec92b68-e96a-4fa7-b0d8-dcf95e19e357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:33.275520 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec92b68-e96a-4fa7-b0d8-dcf95e19e357 admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:33.275808 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec92b68-e96a-4fa7-b0d8-dcf95e19e357 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:33.276102 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec92b68-e96a-4fa7-b0d8-dcf95e19e357 admin admin] PATH_INFO: `/v3/projects/8c3f907c451f4ce3bffb91ce4924239f/users/4d2599f5ff834d6a8e27dfde70fcf6ab/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:33.303152 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec92b68-e96a-4fa7-b0d8-dcf95e19e357 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c3f907c451f4ce3bffb91ce4924239f, user_id=4d2599f5ff834d6a8e27dfde70fcf6ab, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:33.309261 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec92b68-e96a-4fa7-b0d8-dcf95e19e357 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:33.393972 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1075/2153] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:59:33 2022] PUT /identity/v3/projects/8c3f907c451f4ce3bffb91ce4924239f/users/4d2599f5ff834d6a8e27dfde70fcf6ab/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:59:33.406201 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810cebca-da3e-481e-b4a0-d37333cf06e6 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:33.406528 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810cebca-da3e-481e-b4a0-d37333cf06e6 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:33.406809 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810cebca-da3e-481e-b4a0-d37333cf06e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:33.443292 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-810cebca-da3e-481e-b4a0-d37333cf06e6 None None] MFA Rules not processed for user `4d2599f5ff834d6a8e27dfde70fcf6ab`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:59:33.444529 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-810cebca-da3e-481e-b4a0-d37333cf06e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:33.655057 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1079/2154] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:59:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:59:33.659529 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec92b68-e96a-4fa7-b0d8-dcf95e19e357 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:33.814946 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec92b68-e96a-4fa7-b0d8-dcf95e19e357 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:33.822644 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec50b2-004d-4bee-bc35-9a786725fa9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:33.823704 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec50b2-004d-4bee-bc35-9a786725fa9a admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:33.824230 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec50b2-004d-4bee-bc35-9a786725fa9a admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:33.824886 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec50b2-004d-4bee-bc35-9a786725fa9a admin admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:33.826175 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ec50b2-004d-4bee-bc35-9a786725fa9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:33.838353 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ec50b2-004d-4bee-bc35-9a786725fa9a admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:34.015609 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1076/2155] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 19:59:33 2022] POST /identity/v3/projects => generated 385 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:59:34.019383 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810cebca-da3e-481e-b4a0-d37333cf06e6 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:34.030958 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810cebca-da3e-481e-b4a0-d37333cf06e6 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:34.107595 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be8f42-4bb3-40c7-9f15-73995c3d6572 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:34.108618 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be8f42-4bb3-40c7-9f15-73995c3d6572 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:34.108901 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be8f42-4bb3-40c7-9f15-73995c3d6572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:34.117007 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab999bb-18ca-4d63-8840-249a67528047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:34.119038 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab999bb-18ca-4d63-8840-249a67528047 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:34.119413 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab999bb-18ca-4d63-8840-249a67528047 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:34.119781 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab999bb-18ca-4d63-8840-249a67528047 admin admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:34.120538 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab999bb-18ca-4d63-8840-249a67528047 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:34.122789 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab999bb-18ca-4d63-8840-249a67528047 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:34.161847 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-b6be8f42-4bb3-40c7-9f15-73995c3d6572 None None] MFA Rules not processed for user `a406b3f1785441b894ed53eb9ac3981a`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:59:34.163251 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-b6be8f42-4bb3-40c7-9f15-73995c3d6572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:34.247917 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1080/2156] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:59:34 2022] POST /identity/v3/users => generated 299 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:59:34.252235 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab999bb-18ca-4d63-8840-249a67528047 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:34.295528 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab999bb-18ca-4d63-8840-249a67528047 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:34.325116 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc9ea5-9094-46d8-a699-cfc07b4188f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:34.325116 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc9ea5-9094-46d8-a699-cfc07b4188f8 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:34.325116 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc9ea5-9094-46d8-a699-cfc07b4188f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:34.325116 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc9ea5-9094-46d8-a699-cfc07b4188f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:34.325409 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bc9ea5-9094-46d8-a699-cfc07b4188f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:34.328307 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bc9ea5-9094-46d8-a699-cfc07b4188f8 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:34.347732 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1081/2157] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:59:34 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:59:34.352360 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc9ea5-9094-46d8-a699-cfc07b4188f8 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:34.365355 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc9ea5-9094-46d8-a699-cfc07b4188f8 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:34.370543 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1077/2158] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:59:34 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:59:34.375903 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2cd9e9-8a04-45e5-92fd-987c5fb5a088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:34.377395 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2cd9e9-8a04-45e5-92fd-987c5fb5a088 admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:34.377794 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2cd9e9-8a04-45e5-92fd-987c5fb5a088 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:34.378067 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2cd9e9-8a04-45e5-92fd-987c5fb5a088 admin admin] PATH_INFO: `/v3/projects/a0e4d126a4e24da38d9025d009941f11/users/7e10fc40de6f413bb40add1de14ac2b9/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:34.383957 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be8f42-4bb3-40c7-9f15-73995c3d6572 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:34.390359 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-b6be8f42-4bb3-40c7-9f15-73995c3d6572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:34.398394 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2cd9e9-8a04-45e5-92fd-987c5fb5a088 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0e4d126a4e24da38d9025d009941f11, user_id=7e10fc40de6f413bb40add1de14ac2b9, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:34.401371 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2cd9e9-8a04-45e5-92fd-987c5fb5a088 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:34.438503 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:34.500382 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be8f42-4bb3-40c7-9f15-73995c3d6572 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:34.500514 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1082/2159] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:59:34 2022] PUT /identity/v3/projects/a0e4d126a4e24da38d9025d009941f11/users/7e10fc40de6f413bb40add1de14ac2b9/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:59:34.504873 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2cd9e9-8a04-45e5-92fd-987c5fb5a088 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:34.645829 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682883b3-25b8-4537-a05c-9eddb1ad92ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5047a59bc4547be643ffa78808a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:34.646664 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682883b3-25b8-4537-a05c-9eddb1ad92ee service nova] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:34.646951 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682883b3-25b8-4537-a05c-9eddb1ad92ee service nova] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:34.647427 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682883b3-25b8-4537-a05c-9eddb1ad92ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:34.649398 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-682883b3-25b8-4537-a05c-9eddb1ad92ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:34.652854 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2cd9e9-8a04-45e5-92fd-987c5fb5a088 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:34.684656 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5accd09a-8594-41de-8a71-703c0b1e31c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:34.685527 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5accd09a-8594-41de-8a71-703c0b1e31c7 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:34.685873 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5accd09a-8594-41de-8a71-703c0b1e31c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:34.686198 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5accd09a-8594-41de-8a71-703c0b1e31c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:34.686871 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5accd09a-8594-41de-8a71-703c0b1e31c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:34.692133 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5accd09a-8594-41de-8a71-703c0b1e31c7 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:34.723484 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1083/2160] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:59:34 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:59:34.727524 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5accd09a-8594-41de-8a71-703c0b1e31c7 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:34.748750 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5accd09a-8594-41de-8a71-703c0b1e31c7 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:34.764988 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e72e1-11bd-4451-baa8-839188d9115b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:34.765957 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e72e1-11bd-4451-baa8-839188d9115b admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:34.766387 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e72e1-11bd-4451-baa8-839188d9115b admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:34.766792 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e72e1-11bd-4451-baa8-839188d9115b admin admin] PATH_INFO: `/v3/projects/a0e4d126a4e24da38d9025d009941f11/users/7e10fc40de6f413bb40add1de14ac2b9/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:34.773042 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e72e1-11bd-4451-baa8-839188d9115b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0e4d126a4e24da38d9025d009941f11, user_id=7e10fc40de6f413bb40add1de14ac2b9, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:34.779448 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e72e1-11bd-4451-baa8-839188d9115b admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:34.810075 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682883b3-25b8-4537-a05c-9eddb1ad92ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:34.811903 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1084/2161] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:59:34 2022] PUT /identity/v3/projects/a0e4d126a4e24da38d9025d009941f11/users/7e10fc40de6f413bb40add1de14ac2b9/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:59:34.813097 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682883b3-25b8-4537-a05c-9eddb1ad92ee service nova] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:34.825652 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d127e-a49f-4015-b885-5cf104c0a273 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:34.825937 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d127e-a49f-4015-b885-5cf104c0a273 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:34.830399 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d127e-a49f-4015-b885-5cf104c0a273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:34.837348 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1078/2162] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:59:34 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 19:59:34.883916 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-9f5d127e-a49f-4015-b885-5cf104c0a273 None None] MFA Rules not processed for user `7e10fc40de6f413bb40add1de14ac2b9`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:59:34.885182 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-9f5d127e-a49f-4015-b885-5cf104c0a273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:34.988573 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1085/2163] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:59:34 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:59:35.000002 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682883b3-25b8-4537-a05c-9eddb1ad92ee service nova] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:35.001596 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-682883b3-25b8-4537-a05c-9eddb1ad92ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:35.092242 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682883b3-25b8-4537-a05c-9eddb1ad92ee service nova] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:35.172703 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930c9eb-4a47-4815-bfdf-291019eaa8cc None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:35.173176 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930c9eb-4a47-4815-bfdf-291019eaa8cc None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:35.173257 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930c9eb-4a47-4815-bfdf-291019eaa8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:35.184128 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd597c12-c303-4cd8-bda9-1a381bf5e7c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:35.184901 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd597c12-c303-4cd8-bda9-1a381bf5e7c8 service cinder] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:35.185282 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd597c12-c303-4cd8-bda9-1a381bf5e7c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:35.185714 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd597c12-c303-4cd8-bda9-1a381bf5e7c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:35.200840 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-0930c9eb-4a47-4815-bfdf-291019eaa8cc None None] MFA Rules not processed for user `f8bf9edbcb314286a4fc23f151062854`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:59:35.201971 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-0930c9eb-4a47-4815-bfdf-291019eaa8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:35.272917 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:35.276632 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd597c12-c303-4cd8-bda9-1a381bf5e7c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:35.278413 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd597c12-c303-4cd8-bda9-1a381bf5e7c8 service cinder] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:35.298577 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1079/2164] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:59:34 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 19:59:35.349308 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1086/2165] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:59:35 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:59:36.655442 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:38.681934 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:38.696020 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5afe15-03f0-4906-936c-21e141444c46 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:38.696988 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5afe15-03f0-4906-936c-21e141444c46 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:38.701121 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5afe15-03f0-4906-936c-21e141444c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:38.713439 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930c9eb-4a47-4815-bfdf-291019eaa8cc None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:38.722650 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-cd5afe15-03f0-4906-936c-21e141444c46 None None] MFA Rules not processed for user `3e4db966541843189704c7217036067c`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:59:38.724206 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-cd5afe15-03f0-4906-936c-21e141444c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:38.739252 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930c9eb-4a47-4815-bfdf-291019eaa8cc None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:38.753343 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf42aa-8621-4e38-abcc-41a8febafd44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:38.754670 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf42aa-8621-4e38-abcc-41a8febafd44 service cinder] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:38.757901 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf42aa-8621-4e38-abcc-41a8febafd44 service cinder] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:38.764367 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf42aa-8621-4e38-abcc-41a8febafd44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:38.840233 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1080/2166] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:59:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:59:38.870259 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:38.882259 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daf42aa-8621-4e38-abcc-41a8febafd44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:38.884239 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daf42aa-8621-4e38-abcc-41a8febafd44 service cinder] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:38.898417 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1087/2167] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:59:38 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 19:59:41.218791 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5afe15-03f0-4906-936c-21e141444c46 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:41.232423 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5afe15-03f0-4906-936c-21e141444c46 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:41.237985 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868c787-9a87-425d-9d95-50145b6c9361 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:41.238553 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868c787-9a87-425d-9d95-50145b6c9361 service cinder] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:41.238898 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868c787-9a87-425d-9d95-50145b6c9361 service cinder] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:41.239217 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868c787-9a87-425d-9d95-50145b6c9361 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:41.253094 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0868c787-9a87-425d-9d95-50145b6c9361 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:41.256675 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0868c787-9a87-425d-9d95-50145b6c9361 service cinder] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:41.271052 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1081/2168] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:59:41 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:59:41.395200 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:41.530467 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:42.460581 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:44.830159 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:45.560536 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:47.206654 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf42aa-8621-4e38-abcc-41a8febafd44 service cinder] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:47.208099 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-0daf42aa-8621-4e38-abcc-41a8febafd44 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:47.249816 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:47.283036 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf42aa-8621-4e38-abcc-41a8febafd44 service cinder] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:47.287914 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fad09a-d711-45ee-8df8-e4f3915e26df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:47.288760 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fad09a-d711-45ee-8df8-e4f3915e26df admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:47.289092 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fad09a-d711-45ee-8df8-e4f3915e26df admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:47.289421 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fad09a-d711-45ee-8df8-e4f3915e26df admin admin] PATH_INFO: `/v3/users/9dee63d35df743278519d7c10644a697` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:47.291736 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fad09a-d711-45ee-8df8-e4f3915e26df admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dee63d35df743278519d7c10644a697)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:47.293226 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fad09a-d711-45ee-8df8-e4f3915e26df admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:47.325179 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868c787-9a87-425d-9d95-50145b6c9361 service cinder] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:47.335697 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868c787-9a87-425d-9d95-50145b6c9361 service cinder] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:47.341095 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f762b94b-25ce-4f8a-8a85-79c2b99e2d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:47.341745 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762b94b-25ce-4f8a-8a85-79c2b99e2d49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:47.342087 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762b94b-25ce-4f8a-8a85-79c2b99e2d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:47.342369 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762b94b-25ce-4f8a-8a85-79c2b99e2d49 admin admin] PATH_INFO: `/v3/users/13067a6bbb78494996a768cbfe89ec2f` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:47.344972 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f762b94b-25ce-4f8a-8a85-79c2b99e2d49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13067a6bbb78494996a768cbfe89ec2f)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:47.347483 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f762b94b-25ce-4f8a-8a85-79c2b99e2d49 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:47.486273 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:47.500691 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-01fad09a-d711-45ee-8df8-e4f3915e26df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dee63d35df743278519d7c10644a697'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:47.569194 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-f762b94b-25ce-4f8a-8a85-79c2b99e2d49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13067a6bbb78494996a768cbfe89ec2f'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:47.600614 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-01fad09a-d711-45ee-8df8-e4f3915e26df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dee63d35df743278519d7c10644a697'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:47.604889 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-01fad09a-d711-45ee-8df8-e4f3915e26df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dee63d35df743278519d7c10644a697'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:47.606605 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-01fad09a-d711-45ee-8df8-e4f3915e26df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dee63d35df743278519d7c10644a697'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:47.621668 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-01fad09a-d711-45ee-8df8-e4f3915e26df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dee63d35df743278519d7c10644a697'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:47.655921 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1088/2169] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 19:59:47 2022] DELETE /identity/v3/users/9dee63d35df743278519d7c10644a697 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:59:47.661056 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0befd254-f9a4-4713-8053-5fde74cf7cd3 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:47.661532 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0befd254-f9a4-4713-8053-5fde74cf7cd3 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:47.665006 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0befd254-f9a4-4713-8053-5fde74cf7cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:47.707744 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-0befd254-f9a4-4713-8053-5fde74cf7cd3 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:59:47.709182 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-0befd254-f9a4-4713-8053-5fde74cf7cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:47.718406 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-f762b94b-25ce-4f8a-8a85-79c2b99e2d49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13067a6bbb78494996a768cbfe89ec2f'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:47.720455 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-f762b94b-25ce-4f8a-8a85-79c2b99e2d49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13067a6bbb78494996a768cbfe89ec2f'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:47.760873 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-f762b94b-25ce-4f8a-8a85-79c2b99e2d49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13067a6bbb78494996a768cbfe89ec2f'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:47.761969 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-f762b94b-25ce-4f8a-8a85-79c2b99e2d49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13067a6bbb78494996a768cbfe89ec2f'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:47.809111 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1082/2170] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 19:59:47 2022] DELETE /identity/v3/users/13067a6bbb78494996a768cbfe89ec2f => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 19:59:47.814353 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db81e1-7bc6-4c19-8d8f-2b0449180f07 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:47.815073 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db81e1-7bc6-4c19-8d8f-2b0449180f07 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:47.815835 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db81e1-7bc6-4c19-8d8f-2b0449180f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:47.847222 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1089/2171] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:59:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:59:47.857263 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-14db81e1-7bc6-4c19-8d8f-2b0449180f07 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:59:47.857610 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0befd254-f9a4-4713-8053-5fde74cf7cd3 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:47.858967 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-14db81e1-7bc6-4c19-8d8f-2b0449180f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:47.859247 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-0befd254-f9a4-4713-8053-5fde74cf7cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:47.954202 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1083/2172] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:59:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:59:47.955082 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0befd254-f9a4-4713-8053-5fde74cf7cd3 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:47.960773 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db81e1-7bc6-4c19-8d8f-2b0449180f07 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:48.031313 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd383ed7-9a65-449a-8f70-7d857f78c21e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:48.032215 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd383ed7-9a65-449a-8f70-7d857f78c21e service neutron] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:48.032657 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd383ed7-9a65-449a-8f70-7d857f78c21e service neutron] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:48.033106 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd383ed7-9a65-449a-8f70-7d857f78c21e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:48.033237 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db81e1-7bc6-4c19-8d8f-2b0449180f07 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:48.052589 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386e91a4-a7f3-4aae-a046-8094c20a2e93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:48.053251 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e91a4-a7f3-4aae-a046-8094c20a2e93 service neutron] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:48.053566 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e91a4-a7f3-4aae-a046-8094c20a2e93 service neutron] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:48.053843 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e91a4-a7f3-4aae-a046-8094c20a2e93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:48.057812 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd383ed7-9a65-449a-8f70-7d857f78c21e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:48.059645 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd383ed7-9a65-449a-8f70-7d857f78c21e service neutron] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:48.065199 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386e91a4-a7f3-4aae-a046-8094c20a2e93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:48.066675 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386e91a4-a7f3-4aae-a046-8094c20a2e93 service neutron] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:48.079667 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1084/2173] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:59:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 19:59:48.081711 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1090/2174] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:59:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:59:48.652833 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:48.660309 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386e91a4-a7f3-4aae-a046-8094c20a2e93 service neutron] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:48.662896 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd383ed7-9a65-449a-8f70-7d857f78c21e service neutron] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:48.663037 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-386e91a4-a7f3-4aae-a046-8094c20a2e93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:48.663116 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-fd383ed7-9a65-449a-8f70-7d857f78c21e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:48.684024 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386e91a4-a7f3-4aae-a046-8094c20a2e93 service neutron] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:48.684497 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd383ed7-9a65-449a-8f70-7d857f78c21e service neutron] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:48.687750 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b1726-26b2-496e-9f15-a34b33616d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:48.688647 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b1726-26b2-496e-9f15-a34b33616d44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:48.689024 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b1726-26b2-496e-9f15-a34b33616d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:48.689392 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f37601-8815-40a9-9247-21ca070529dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:48.689668 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b1726-26b2-496e-9f15-a34b33616d44 admin admin] PATH_INFO: `/v3/projects/c269cb1efff14d59b80f605de1cd0332` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:48.690054 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f37601-8815-40a9-9247-21ca070529dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:48.690387 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f37601-8815-40a9-9247-21ca070529dc admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:48.690665 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f37601-8815-40a9-9247-21ca070529dc admin admin] PATH_INFO: `/v3/projects/c9775bfcd4614037938104f1d5e8516b` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:48.691863 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f37601-8815-40a9-9247-21ca070529dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9775bfcd4614037938104f1d5e8516b)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:48.692110 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859b1726-26b2-496e-9f15-a34b33616d44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c269cb1efff14d59b80f605de1cd0332)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:48.694231 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f37601-8815-40a9-9247-21ca070529dc admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:48.694466 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859b1726-26b2-496e-9f15-a34b33616d44 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:48.766425 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:48.878682 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-a8f37601-8815-40a9-9247-21ca070529dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9775bfcd4614037938104f1d5e8516b', 'request_id': 'req-a8f37601-8815-40a9-9247-21ca070529dc'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:48.889148 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-859b1726-26b2-496e-9f15-a34b33616d44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c269cb1efff14d59b80f605de1cd0332', 'request_id': 'req-859b1726-26b2-496e-9f15-a34b33616d44'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:48.889343 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-a8f37601-8815-40a9-9247-21ca070529dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9775bfcd4614037938104f1d5e8516b', 'request_id': 'req-a8f37601-8815-40a9-9247-21ca070529dc'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:49.055852 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-a8f37601-8815-40a9-9247-21ca070529dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9775bfcd4614037938104f1d5e8516b', 'request_id': 'req-a8f37601-8815-40a9-9247-21ca070529dc'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:49.081124 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-a8f37601-8815-40a9-9247-21ca070529dc admin admin] The token cache is being invalidate because project c9775bfcd4614037938104f1d5e8516b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 19:59:49.081418 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-a8f37601-8815-40a9-9247-21ca070529dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:49.082114 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-a8f37601-8815-40a9-9247-21ca070529dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:49.084041 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1091/2175] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 19:59:48 2022] DELETE /identity/v3/projects/c9775bfcd4614037938104f1d5e8516b => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 19:59:49.089020 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263a581-da34-46c4-8db5-3a6f0e85c087 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:49.089296 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263a581-da34-46c4-8db5-3a6f0e85c087 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:49.089877 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263a581-da34-46c4-8db5-3a6f0e85c087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:49.114391 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-5263a581-da34-46c4-8db5-3a6f0e85c087 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:59:49.115608 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-5263a581-da34-46c4-8db5-3a6f0e85c087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:49.146676 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-859b1726-26b2-496e-9f15-a34b33616d44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c269cb1efff14d59b80f605de1cd0332', 'request_id': 'req-859b1726-26b2-496e-9f15-a34b33616d44'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:49.154748 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-859b1726-26b2-496e-9f15-a34b33616d44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c269cb1efff14d59b80f605de1cd0332', 'request_id': 'req-859b1726-26b2-496e-9f15-a34b33616d44'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:49.166596 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-859b1726-26b2-496e-9f15-a34b33616d44 admin admin] The token cache is being invalidate because project c269cb1efff14d59b80f605de1cd0332 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 19:59:49.167229 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-859b1726-26b2-496e-9f15-a34b33616d44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:49.167914 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-859b1726-26b2-496e-9f15-a34b33616d44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:49.169571 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1085/2176] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 19:59:48 2022] DELETE /identity/v3/projects/c269cb1efff14d59b80f605de1cd0332 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:59:49.173673 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b1726-26b2-496e-9f15-a34b33616d44 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:49.175061 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-859b1726-26b2-496e-9f15-a34b33616d44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:49.190452 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1092/2177] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:59:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:59:49.198939 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252a654-5f2e-4b78-95ea-34d03f047467 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:49.199219 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252a654-5f2e-4b78-95ea-34d03f047467 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:49.201298 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252a654-5f2e-4b78-95ea-34d03f047467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:49.221371 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-1252a654-5f2e-4b78-95ea-34d03f047467 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:59:49.222611 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-1252a654-5f2e-4b78-95ea-34d03f047467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:49.230797 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1093/2178] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:59:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:59:49.235074 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1252a654-5f2e-4b78-95ea-34d03f047467 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:49.245037 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1252a654-5f2e-4b78-95ea-34d03f047467 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:49.245404 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b1726-26b2-496e-9f15-a34b33616d44 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:49.249836 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d7dd27-dde5-46ab-bddc-46e0bc140d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:49.250307 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a56a976-00f3-4767-9ad0-ac2eaf96e676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:49.250460 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7dd27-dde5-46ab-bddc-46e0bc140d0e admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:49.250752 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7dd27-dde5-46ab-bddc-46e0bc140d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:49.251070 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7dd27-dde5-46ab-bddc-46e0bc140d0e admin admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:49.251170 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56a976-00f3-4767-9ad0-ac2eaf96e676 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:49.251386 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56a976-00f3-4767-9ad0-ac2eaf96e676 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:49.251656 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56a976-00f3-4767-9ad0-ac2eaf96e676 admin admin] PATH_INFO: `/v3/users/4d2599f5ff834d6a8e27dfde70fcf6ab` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:49.251773 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d7dd27-dde5-46ab-bddc-46e0bc140d0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:59:49.251994 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d7dd27-dde5-46ab-bddc-46e0bc140d0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:49.252781 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a56a976-00f3-4767-9ad0-ac2eaf96e676 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d2599f5ff834d6a8e27dfde70fcf6ab)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:49.253595 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d7dd27-dde5-46ab-bddc-46e0bc140d0e admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:49.254730 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a56a976-00f3-4767-9ad0-ac2eaf96e676 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:49.270873 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1094/2179] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 19:59:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:59:49.275730 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d7dd27-dde5-46ab-bddc-46e0bc140d0e admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:49.286170 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d7dd27-dde5-46ab-bddc-46e0bc140d0e admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:49.292014 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39e3bd-eb39-4ee3-a371-cf916bd5a922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:49.292618 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39e3bd-eb39-4ee3-a371-cf916bd5a922 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:49.292894 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39e3bd-eb39-4ee3-a371-cf916bd5a922 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:49.293164 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39e3bd-eb39-4ee3-a371-cf916bd5a922 admin admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:49.293827 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba39e3bd-eb39-4ee3-a371-cf916bd5a922 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:49.295813 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba39e3bd-eb39-4ee3-a371-cf916bd5a922 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:49.434681 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1095/2180] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 19:59:49 2022] POST /identity/v3/projects => generated 373 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 19:59:49.435624 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39e3bd-eb39-4ee3-a371-cf916bd5a922 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:49.502817 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39e3bd-eb39-4ee3-a371-cf916bd5a922 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:49.507693 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dcbb2d-9bc9-4625-b2a6-f4f190a801b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:49.508296 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcbb2d-9bc9-4625-b2a6-f4f190a801b0 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:49.509125 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcbb2d-9bc9-4625-b2a6-f4f190a801b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:49.509413 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcbb2d-9bc9-4625-b2a6-f4f190a801b0 admin admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:49.510205 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dcbb2d-9bc9-4625-b2a6-f4f190a801b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:49.512219 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dcbb2d-9bc9-4625-b2a6-f4f190a801b0 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:49.536577 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-0a56a976-00f3-4767-9ad0-ac2eaf96e676 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d2599f5ff834d6a8e27dfde70fcf6ab'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:49.617660 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1096/2181] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:59:49 2022] POST /identity/v3/users => generated 287 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 19:59:49.622429 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dcbb2d-9bc9-4625-b2a6-f4f190a801b0 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:49.623602 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-0a56a976-00f3-4767-9ad0-ac2eaf96e676 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d2599f5ff834d6a8e27dfde70fcf6ab'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:49.624530 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-0a56a976-00f3-4767-9ad0-ac2eaf96e676 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d2599f5ff834d6a8e27dfde70fcf6ab'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:49.635213 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dcbb2d-9bc9-4625-b2a6-f4f190a801b0 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:49.640278 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6926fc-8fc3-4150-9c0e-cef88f658d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:49.640819 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-0a56a976-00f3-4767-9ad0-ac2eaf96e676 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d2599f5ff834d6a8e27dfde70fcf6ab'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:49.640940 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6926fc-8fc3-4150-9c0e-cef88f658d12 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:49.641213 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6926fc-8fc3-4150-9c0e-cef88f658d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:49.641487 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6926fc-8fc3-4150-9c0e-cef88f658d12 admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:49.641842 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-0a56a976-00f3-4767-9ad0-ac2eaf96e676 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d2599f5ff834d6a8e27dfde70fcf6ab'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:49.642221 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6926fc-8fc3-4150-9c0e-cef88f658d12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:49.643938 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6926fc-8fc3-4150-9c0e-cef88f658d12 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:49.659751 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1086/2182] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 19:59:49 2022] DELETE /identity/v3/users/4d2599f5ff834d6a8e27dfde70fcf6ab => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:59:49.670800 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1097/2183] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:59:49 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 19:59:49.672137 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a56a976-00f3-4767-9ad0-ac2eaf96e676 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:49.673613 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-0a56a976-00f3-4767-9ad0-ac2eaf96e676 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:49.750500 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a56a976-00f3-4767-9ad0-ac2eaf96e676 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:49.761585 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9133da36-23c5-49ba-bd3a-a31bee2e0b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:49.762229 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9133da36-23c5-49ba-bd3a-a31bee2e0b4f admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:49.762477 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9133da36-23c5-49ba-bd3a-a31bee2e0b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:49.762748 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9133da36-23c5-49ba-bd3a-a31bee2e0b4f admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:49.763399 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9133da36-23c5-49ba-bd3a-a31bee2e0b4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:49.765814 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9133da36-23c5-49ba-bd3a-a31bee2e0b4f admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:49.777540 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1087/2184] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:59:49 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:59:49.782016 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6926fc-8fc3-4150-9c0e-cef88f658d12 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:49.792659 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6926fc-8fc3-4150-9c0e-cef88f658d12 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:49.797428 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba9fc14-6d80-4ad7-8706-7a4a8192169a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:49.798116 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9fc14-6d80-4ad7-8706-7a4a8192169a admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:49.798428 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9fc14-6d80-4ad7-8706-7a4a8192169a admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:49.798775 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9fc14-6d80-4ad7-8706-7a4a8192169a admin admin] PATH_INFO: `/v3/projects/7b7606b01f984bcabb8d0f43a1ee3737/users/7a52d70c04ef4598a63d84ec838e6ef5/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:49.815128 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba9fc14-6d80-4ad7-8706-7a4a8192169a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b7606b01f984bcabb8d0f43a1ee3737, user_id=7a52d70c04ef4598a63d84ec838e6ef5, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:49.818211 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba9fc14-6d80-4ad7-8706-7a4a8192169a admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:49.944201 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1098/2185] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:59:49 2022] PUT /identity/v3/projects/7b7606b01f984bcabb8d0f43a1ee3737/users/7a52d70c04ef4598a63d84ec838e6ef5/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 19:59:49.959285 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86183119-f391-4782-a4cc-8471c1869ba9 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:49.959571 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86183119-f391-4782-a4cc-8471c1869ba9 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:49.960054 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86183119-f391-4782-a4cc-8471c1869ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:49.990412 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-86183119-f391-4782-a4cc-8471c1869ba9 None None] MFA Rules not processed for user `7a52d70c04ef4598a63d84ec838e6ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:59:49.991854 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-86183119-f391-4782-a4cc-8471c1869ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:50.068273 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1088/2186] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:59:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:59:50.084448 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba9fc14-6d80-4ad7-8706-7a4a8192169a admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:50.086227 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-9ba9fc14-6d80-4ad7-8706-7a4a8192169a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:50.169511 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba9fc14-6d80-4ad7-8706-7a4a8192169a admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:50.173813 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b15ad-8b9f-4524-be95-9c32ca869dbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:50.178521 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b15ad-8b9f-4524-be95-9c32ca869dbc service cinder] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:50.178521 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b15ad-8b9f-4524-be95-9c32ca869dbc service cinder] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:50.178521 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b15ad-8b9f-4524-be95-9c32ca869dbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:50.185363 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459b15ad-8b9f-4524-be95-9c32ca869dbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:50.186835 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459b15ad-8b9f-4524-be95-9c32ca869dbc service cinder] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:50.196373 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1099/2187] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:59:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:59:50.222712 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86183119-f391-4782-a4cc-8471c1869ba9 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:50.251862 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b15ad-8b9f-4524-be95-9c32ca869dbc service cinder] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:50.253358 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-459b15ad-8b9f-4524-be95-9c32ca869dbc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:50.311701 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86183119-f391-4782-a4cc-8471c1869ba9 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:50.318258 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56281019-8cab-46da-b364-15a5754b4fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:50.318921 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56281019-8cab-46da-b364-15a5754b4fdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:50.319207 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56281019-8cab-46da-b364-15a5754b4fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:50.319486 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56281019-8cab-46da-b364-15a5754b4fdc admin admin] PATH_INFO: `/v3/users/7a52d70c04ef4598a63d84ec838e6ef5` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:50.320830 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56281019-8cab-46da-b364-15a5754b4fdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a52d70c04ef4598a63d84ec838e6ef5)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:50.324347 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56281019-8cab-46da-b364-15a5754b4fdc admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:50.355631 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b15ad-8b9f-4524-be95-9c32ca869dbc service cinder] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:50.361029 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed82cb-5538-4686-88ba-37dded614215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:50.361810 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed82cb-5538-4686-88ba-37dded614215 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:50.362109 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed82cb-5538-4686-88ba-37dded614215 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:50.362352 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed82cb-5538-4686-88ba-37dded614215 admin admin] PATH_INFO: `/v3/projects/8c3f907c451f4ce3bffb91ce4924239f` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:50.363745 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ed82cb-5538-4686-88ba-37dded614215 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c3f907c451f4ce3bffb91ce4924239f)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:50.365743 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ed82cb-5538-4686-88ba-37dded614215 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:50.585481 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-75ed82cb-5538-4686-88ba-37dded614215 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c3f907c451f4ce3bffb91ce4924239f', 'request_id': 'req-75ed82cb-5538-4686-88ba-37dded614215'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:50.592447 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-75ed82cb-5538-4686-88ba-37dded614215 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c3f907c451f4ce3bffb91ce4924239f', 'request_id': 'req-75ed82cb-5538-4686-88ba-37dded614215'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:50.691853 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-75ed82cb-5538-4686-88ba-37dded614215 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c3f907c451f4ce3bffb91ce4924239f', 'request_id': 'req-75ed82cb-5538-4686-88ba-37dded614215'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:50.709011 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-75ed82cb-5538-4686-88ba-37dded614215 admin admin] The token cache is being invalidate because project 8c3f907c451f4ce3bffb91ce4924239f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 19:59:50.709308 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-75ed82cb-5538-4686-88ba-37dded614215 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:50.710169 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-75ed82cb-5538-4686-88ba-37dded614215 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:50.717321 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1100/2188] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 19:59:50 2022] DELETE /identity/v3/projects/8c3f907c451f4ce3bffb91ce4924239f => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:59:50.718748 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed82cb-5538-4686-88ba-37dded614215 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:50.719964 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-56281019-8cab-46da-b364-15a5754b4fdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a52d70c04ef4598a63d84ec838e6ef5'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:50.720431 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-75ed82cb-5538-4686-88ba-37dded614215 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:50.798413 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-56281019-8cab-46da-b364-15a5754b4fdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a52d70c04ef4598a63d84ec838e6ef5'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:50.799582 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-56281019-8cab-46da-b364-15a5754b4fdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a52d70c04ef4598a63d84ec838e6ef5'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:50.848627 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed82cb-5538-4686-88ba-37dded614215 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:50.850729 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-56281019-8cab-46da-b364-15a5754b4fdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a52d70c04ef4598a63d84ec838e6ef5'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:50.852467 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-56281019-8cab-46da-b364-15a5754b4fdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a52d70c04ef4598a63d84ec838e6ef5'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:50.857837 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6716754-49cb-40be-99f8-cd8155ff6bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:50.857837 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6716754-49cb-40be-99f8-cd8155ff6bf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:50.858212 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6716754-49cb-40be-99f8-cd8155ff6bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:50.858493 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6716754-49cb-40be-99f8-cd8155ff6bf1 admin admin] PATH_INFO: `/v3/users/7e10fc40de6f413bb40add1de14ac2b9` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:50.859691 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6716754-49cb-40be-99f8-cd8155ff6bf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e10fc40de6f413bb40add1de14ac2b9)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:50.861856 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6716754-49cb-40be-99f8-cd8155ff6bf1 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:50.874856 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1089/2189] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 19:59:50 2022] DELETE /identity/v3/users/7a52d70c04ef4598a63d84ec838e6ef5 => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:59:50.881189 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85055b6-f5f0-4943-99c3-f80321436772 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:50.881785 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85055b6-f5f0-4943-99c3-f80321436772 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:50.882384 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85055b6-f5f0-4943-99c3-f80321436772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:50.914411 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-c85055b6-f5f0-4943-99c3-f80321436772 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:59:50.915024 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-c85055b6-f5f0-4943-99c3-f80321436772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:50.929912 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:50.985401 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1090/2190] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:59:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:59:50.996376 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85055b6-f5f0-4943-99c3-f80321436772 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:50.998302 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-c85055b6-f5f0-4943-99c3-f80321436772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:51.060307 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85055b6-f5f0-4943-99c3-f80321436772 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:51.064061 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc75a82-b2bb-48c4-a1b4-41bc07cc66dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:51.064679 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc75a82-b2bb-48c4-a1b4-41bc07cc66dc service neutron] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:51.064958 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc75a82-b2bb-48c4-a1b4-41bc07cc66dc service neutron] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:51.065231 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc75a82-b2bb-48c4-a1b4-41bc07cc66dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:51.077942 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc75a82-b2bb-48c4-a1b4-41bc07cc66dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:51.079393 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc75a82-b2bb-48c4-a1b4-41bc07cc66dc service neutron] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:51.090648 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1091/2191] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:59:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 19:59:51.141239 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-f6716754-49cb-40be-99f8-cd8155ff6bf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e10fc40de6f413bb40add1de14ac2b9'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:51.179398 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc75a82-b2bb-48c4-a1b4-41bc07cc66dc service neutron] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:51.180997 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-adc75a82-b2bb-48c4-a1b4-41bc07cc66dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:51.198872 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc75a82-b2bb-48c4-a1b4-41bc07cc66dc service neutron] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:51.204101 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a500c17-7857-4b15-a07d-50832d81cd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:51.204816 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a500c17-7857-4b15-a07d-50832d81cd00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:51.205162 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a500c17-7857-4b15-a07d-50832d81cd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:51.205565 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a500c17-7857-4b15-a07d-50832d81cd00 admin admin] PATH_INFO: `/v3/users/79bfc7e01803430da014c4fa7d2c9ca2` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:51.207496 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a500c17-7857-4b15-a07d-50832d81cd00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79bfc7e01803430da014c4fa7d2c9ca2)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:51.212124 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a500c17-7857-4b15-a07d-50832d81cd00 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:51.257269 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-f6716754-49cb-40be-99f8-cd8155ff6bf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e10fc40de6f413bb40add1de14ac2b9'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:51.258024 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-f6716754-49cb-40be-99f8-cd8155ff6bf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e10fc40de6f413bb40add1de14ac2b9'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:51.258715 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-f6716754-49cb-40be-99f8-cd8155ff6bf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e10fc40de6f413bb40add1de14ac2b9'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:51.281604 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-f6716754-49cb-40be-99f8-cd8155ff6bf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e10fc40de6f413bb40add1de14ac2b9'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:51.297119 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1101/2192] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 19:59:50 2022] DELETE /identity/v3/users/7e10fc40de6f413bb40add1de14ac2b9 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:59:51.478882 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-2a500c17-7857-4b15-a07d-50832d81cd00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79bfc7e01803430da014c4fa7d2c9ca2'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:51.548998 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-2a500c17-7857-4b15-a07d-50832d81cd00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79bfc7e01803430da014c4fa7d2c9ca2'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:51.549752 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-2a500c17-7857-4b15-a07d-50832d81cd00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79bfc7e01803430da014c4fa7d2c9ca2'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:51.569479 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-2a500c17-7857-4b15-a07d-50832d81cd00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79bfc7e01803430da014c4fa7d2c9ca2'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:51.570563 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-2a500c17-7857-4b15-a07d-50832d81cd00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79bfc7e01803430da014c4fa7d2c9ca2'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:51.586682 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1092/2193] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 19:59:51 2022] DELETE /identity/v3/users/79bfc7e01803430da014c4fa7d2c9ca2 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:59:51.591161 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c94d4-1d7f-4668-b9a4-d55b2be0147a None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:51.591449 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c94d4-1d7f-4668-b9a4-d55b2be0147a None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:51.591724 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c94d4-1d7f-4668-b9a4-d55b2be0147a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:51.626760 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-dd9c94d4-1d7f-4668-b9a4-d55b2be0147a None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:59:51.628061 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-dd9c94d4-1d7f-4668-b9a4-d55b2be0147a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:51.674899 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:51.712627 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1102/2194] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:59:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:59:51.734471 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a500c17-7857-4b15-a07d-50832d81cd00 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:51.736335 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-2a500c17-7857-4b15-a07d-50832d81cd00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:51.809856 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c94d4-1d7f-4668-b9a4-d55b2be0147a None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:51.812042 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-dd9c94d4-1d7f-4668-b9a4-d55b2be0147a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:51.817164 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a500c17-7857-4b15-a07d-50832d81cd00 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:51.821021 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479aa69-eda7-4427-8743-6efae4bbd4b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:51.821670 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479aa69-eda7-4427-8743-6efae4bbd4b0 service neutron] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:51.822551 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479aa69-eda7-4427-8743-6efae4bbd4b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:51.822843 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479aa69-eda7-4427-8743-6efae4bbd4b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:51.826133 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c94d4-1d7f-4668-b9a4-d55b2be0147a None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:51.831679 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f69c06-fe73-4ad5-8e22-00eb1fbd1ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:51.832313 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f69c06-fe73-4ad5-8e22-00eb1fbd1ed7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:51.832587 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f69c06-fe73-4ad5-8e22-00eb1fbd1ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:51.832893 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f69c06-fe73-4ad5-8e22-00eb1fbd1ed7 admin admin] PATH_INFO: `/v3/users/87be7aafd99b48c3be2b837a66c7a89f` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:51.833644 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9479aa69-eda7-4427-8743-6efae4bbd4b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:51.834233 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f69c06-fe73-4ad5-8e22-00eb1fbd1ed7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87be7aafd99b48c3be2b837a66c7a89f)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:51.835076 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9479aa69-eda7-4427-8743-6efae4bbd4b0 service neutron] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:51.836156 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f69c06-fe73-4ad5-8e22-00eb1fbd1ed7 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:51.848143 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1093/2195] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:59:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:59:51.883220 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479aa69-eda7-4427-8743-6efae4bbd4b0 service neutron] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:51.885593 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-9479aa69-eda7-4427-8743-6efae4bbd4b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:51.898518 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479aa69-eda7-4427-8743-6efae4bbd4b0 service neutron] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:51.904728 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7333857b-d255-4aeb-b9c7-d352fc7bb5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:51.905377 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333857b-d255-4aeb-b9c7-d352fc7bb5f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:51.905687 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333857b-d255-4aeb-b9c7-d352fc7bb5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:51.906529 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333857b-d255-4aeb-b9c7-d352fc7bb5f3 admin admin] PATH_INFO: `/v3/projects/a0e4d126a4e24da38d9025d009941f11` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:51.907133 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7333857b-d255-4aeb-b9c7-d352fc7bb5f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0e4d126a4e24da38d9025d009941f11)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:51.909352 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7333857b-d255-4aeb-b9c7-d352fc7bb5f3 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:52.087970 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-17f69c06-fe73-4ad5-8e22-00eb1fbd1ed7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87be7aafd99b48c3be2b837a66c7a89f'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:52.088207 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-7333857b-d255-4aeb-b9c7-d352fc7bb5f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0e4d126a4e24da38d9025d009941f11', 'request_id': 'req-7333857b-d255-4aeb-b9c7-d352fc7bb5f3'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:52.194403 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-17f69c06-fe73-4ad5-8e22-00eb1fbd1ed7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87be7aafd99b48c3be2b837a66c7a89f'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:52.195033 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-17f69c06-fe73-4ad5-8e22-00eb1fbd1ed7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87be7aafd99b48c3be2b837a66c7a89f'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:52.195653 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-17f69c06-fe73-4ad5-8e22-00eb1fbd1ed7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87be7aafd99b48c3be2b837a66c7a89f'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:52.210268 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-17f69c06-fe73-4ad5-8e22-00eb1fbd1ed7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87be7aafd99b48c3be2b837a66c7a89f'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:52.222873 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1103/2196] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 19:59:51 2022] DELETE /identity/v3/users/87be7aafd99b48c3be2b837a66c7a89f => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:59:52.225995 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f69c06-fe73-4ad5-8e22-00eb1fbd1ed7 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:52.225995 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-17f69c06-fe73-4ad5-8e22-00eb1fbd1ed7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:52.283751 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-7333857b-d255-4aeb-b9c7-d352fc7bb5f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0e4d126a4e24da38d9025d009941f11', 'request_id': 'req-7333857b-d255-4aeb-b9c7-d352fc7bb5f3'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:52.292749 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f69c06-fe73-4ad5-8e22-00eb1fbd1ed7 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:52.294843 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-7333857b-d255-4aeb-b9c7-d352fc7bb5f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0e4d126a4e24da38d9025d009941f11', 'request_id': 'req-7333857b-d255-4aeb-b9c7-d352fc7bb5f3'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:52.298055 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb348083-d1fe-493c-8ddb-2b854940c4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:52.298691 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb348083-d1fe-493c-8ddb-2b854940c4eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:52.298966 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb348083-d1fe-493c-8ddb-2b854940c4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:52.299242 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb348083-d1fe-493c-8ddb-2b854940c4eb admin admin] PATH_INFO: `/v3/projects/7b7606b01f984bcabb8d0f43a1ee3737` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:52.300464 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb348083-d1fe-493c-8ddb-2b854940c4eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b7606b01f984bcabb8d0f43a1ee3737)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:52.303063 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb348083-d1fe-493c-8ddb-2b854940c4eb admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:52.312115 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-7333857b-d255-4aeb-b9c7-d352fc7bb5f3 admin admin] The token cache is being invalidate because project a0e4d126a4e24da38d9025d009941f11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 19:59:52.312404 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-7333857b-d255-4aeb-b9c7-d352fc7bb5f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:52.313133 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-7333857b-d255-4aeb-b9c7-d352fc7bb5f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:52.318144 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1094/2197] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 19:59:51 2022] DELETE /identity/v3/projects/a0e4d126a4e24da38d9025d009941f11 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 19:59:52.318144 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde8ab8-c5b6-4e3a-a2e6-d32fe02745e4 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:52.318144 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde8ab8-c5b6-4e3a-a2e6-d32fe02745e4 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:52.318144 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde8ab8-c5b6-4e3a-a2e6-d32fe02745e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:52.341255 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-cdde8ab8-c5b6-4e3a-a2e6-d32fe02745e4 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:59:52.342503 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-cdde8ab8-c5b6-4e3a-a2e6-d32fe02745e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:52.350979 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1095/2198] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:59:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:59:52.352114 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e7364-1fb6-4dde-b641-f6978e72c1f6 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:52.352556 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e7364-1fb6-4dde-b641-f6978e72c1f6 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:52.352896 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e7364-1fb6-4dde-b641-f6978e72c1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:52.379944 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-ae8e7364-1fb6-4dde-b641-f6978e72c1f6 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:59:52.381100 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-ae8e7364-1fb6-4dde-b641-f6978e72c1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:52.390329 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1096/2199] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:59:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:59:52.391268 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e7364-1fb6-4dde-b641-f6978e72c1f6 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:52.392540 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-ae8e7364-1fb6-4dde-b641-f6978e72c1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:52.465874 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e7364-1fb6-4dde-b641-f6978e72c1f6 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:52.467763 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-fb348083-d1fe-493c-8ddb-2b854940c4eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b7606b01f984bcabb8d0f43a1ee3737', 'request_id': 'req-fb348083-d1fe-493c-8ddb-2b854940c4eb'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:52.474554 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-fb348083-d1fe-493c-8ddb-2b854940c4eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b7606b01f984bcabb8d0f43a1ee3737', 'request_id': 'req-fb348083-d1fe-493c-8ddb-2b854940c4eb'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:52.522819 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc91384f-ebd2-40b7-a3ec-f68d1edaaf84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:52.523435 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91384f-ebd2-40b7-a3ec-f68d1edaaf84 service neutron] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:52.523766 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91384f-ebd2-40b7-a3ec-f68d1edaaf84 service neutron] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:52.524049 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91384f-ebd2-40b7-a3ec-f68d1edaaf84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:52.595255 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-fb348083-d1fe-493c-8ddb-2b854940c4eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b7606b01f984bcabb8d0f43a1ee3737', 'request_id': 'req-fb348083-d1fe-493c-8ddb-2b854940c4eb'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:52.598677 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc91384f-ebd2-40b7-a3ec-f68d1edaaf84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:52.600194 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc91384f-ebd2-40b7-a3ec-f68d1edaaf84 service neutron] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:52.610087 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-fb348083-d1fe-493c-8ddb-2b854940c4eb admin admin] The token cache is being invalidate because project 7b7606b01f984bcabb8d0f43a1ee3737 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 19:59:52.615700 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1097/2200] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:59:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:59:52.617109 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c74e1-953b-49fd-bdf0-b373b30f3535 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:52.617391 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c74e1-953b-49fd-bdf0-b373b30f3535 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:52.617668 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c74e1-953b-49fd-bdf0-b373b30f3535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:52.618267 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-fb348083-d1fe-493c-8ddb-2b854940c4eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:52.619078 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-fb348083-d1fe-493c-8ddb-2b854940c4eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:52.620937 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1104/2201] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 19:59:52 2022] DELETE /identity/v3/projects/7b7606b01f984bcabb8d0f43a1ee3737 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:59:52.621560 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb348083-d1fe-493c-8ddb-2b854940c4eb admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:52.623077 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-fb348083-d1fe-493c-8ddb-2b854940c4eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:52.637820 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb348083-d1fe-493c-8ddb-2b854940c4eb admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:52.643566 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0315b489-6cb0-47da-bd9f-67b2584ae805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:52.644268 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315b489-6cb0-47da-bd9f-67b2584ae805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:52.644601 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315b489-6cb0-47da-bd9f-67b2584ae805 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:52.644941 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315b489-6cb0-47da-bd9f-67b2584ae805 admin admin] PATH_INFO: `/v3/projects/76b5669a906847ca8f22361e16c20001` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:52.646263 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0315b489-6cb0-47da-bd9f-67b2584ae805 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76b5669a906847ca8f22361e16c20001)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:52.649031 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0315b489-6cb0-47da-bd9f-67b2584ae805 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:52.661006 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-ff8c74e1-953b-49fd-bdf0-b373b30f3535 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:59:52.662665 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-ff8c74e1-953b-49fd-bdf0-b373b30f3535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:52.683568 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:52.684890 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1098/2202] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:59:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:59:52.686211 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8775539-1383-4927-b7cb-679025464390 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:52.686548 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8775539-1383-4927-b7cb-679025464390 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:52.686833 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8775539-1383-4927-b7cb-679025464390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:52.709666 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-f8775539-1383-4927-b7cb-679025464390 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:59:52.710819 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-f8775539-1383-4927-b7cb-679025464390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:52.719719 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1099/2203] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:59:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:59:52.720532 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8775539-1383-4927-b7cb-679025464390 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:52.731304 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8775539-1383-4927-b7cb-679025464390 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:52.736182 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea6b08-1c7a-4beb-9aab-7230446b04a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:52.736806 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea6b08-1c7a-4beb-9aab-7230446b04a7 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:52.737195 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea6b08-1c7a-4beb-9aab-7230446b04a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:52.737316 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea6b08-1c7a-4beb-9aab-7230446b04a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:52.738085 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbea6b08-1c7a-4beb-9aab-7230446b04a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:59:52.738389 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbea6b08-1c7a-4beb-9aab-7230446b04a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:52.739978 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbea6b08-1c7a-4beb-9aab-7230446b04a7 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:52.752177 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1100/2204] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 19:59:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:59:52.753220 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7937a0-d6c5-433b-b1a7-0711acc7d1b8 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:52.753515 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7937a0-d6c5-433b-b1a7-0711acc7d1b8 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:52.753840 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7937a0-d6c5-433b-b1a7-0711acc7d1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:52.774817 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-1e7937a0-d6c5-433b-b1a7-0711acc7d1b8 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:59:52.776738 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-1e7937a0-d6c5-433b-b1a7-0711acc7d1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:52.784846 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1101/2205] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:59:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:59:52.788756 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7937a0-d6c5-433b-b1a7-0711acc7d1b8 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:52.799261 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7937a0-d6c5-433b-b1a7-0711acc7d1b8 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:52.803872 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebadf0e-138a-4ce5-a021-fcc6523fcb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:52.804470 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebadf0e-138a-4ce5-a021-fcc6523fcb06 admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:52.804747 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebadf0e-138a-4ce5-a021-fcc6523fcb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:52.805016 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebadf0e-138a-4ce5-a021-fcc6523fcb06 admin admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:52.805699 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebadf0e-138a-4ce5-a021-fcc6523fcb06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:52.811544 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebadf0e-138a-4ce5-a021-fcc6523fcb06 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:52.851048 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-0315b489-6cb0-47da-bd9f-67b2584ae805 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76b5669a906847ca8f22361e16c20001', 'request_id': 'req-0315b489-6cb0-47da-bd9f-67b2584ae805'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:52.860001 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-0315b489-6cb0-47da-bd9f-67b2584ae805 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76b5669a906847ca8f22361e16c20001', 'request_id': 'req-0315b489-6cb0-47da-bd9f-67b2584ae805'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:52.928142 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1102/2206] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 19:59:52 2022] POST /identity/v3/projects => generated 385 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:59:52.932527 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebadf0e-138a-4ce5-a021-fcc6523fcb06 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:52.948149 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-0315b489-6cb0-47da-bd9f-67b2584ae805 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76b5669a906847ca8f22361e16c20001', 'request_id': 'req-0315b489-6cb0-47da-bd9f-67b2584ae805'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:52.982452 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-0315b489-6cb0-47da-bd9f-67b2584ae805 admin admin] The token cache is being invalidate because project 76b5669a906847ca8f22361e16c20001 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 19:59:52.982825 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-0315b489-6cb0-47da-bd9f-67b2584ae805 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:52.984990 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-0315b489-6cb0-47da-bd9f-67b2584ae805 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:52.991155 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1105/2207] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 19:59:52 2022] DELETE /identity/v3/projects/76b5669a906847ca8f22361e16c20001 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:59:52.991977 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0315b489-6cb0-47da-bd9f-67b2584ae805 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:52.995318 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-0315b489-6cb0-47da-bd9f-67b2584ae805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:53.027268 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebadf0e-138a-4ce5-a021-fcc6523fcb06 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:53.033673 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da846600-2242-4d89-9891-8a4a281b64d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:53.033673 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da846600-2242-4d89-9891-8a4a281b64d0 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:53.033966 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da846600-2242-4d89-9891-8a4a281b64d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:53.034321 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da846600-2242-4d89-9891-8a4a281b64d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:53.034968 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da846600-2242-4d89-9891-8a4a281b64d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:59:53.035275 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da846600-2242-4d89-9891-8a4a281b64d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:53.037033 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da846600-2242-4d89-9891-8a4a281b64d0 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:53.052632 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1103/2208] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 19:59:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:59:53.052632 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da846600-2242-4d89-9891-8a4a281b64d0 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:53.061793 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-da846600-2242-4d89-9891-8a4a281b64d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:53.072198 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da846600-2242-4d89-9891-8a4a281b64d0 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:53.078589 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96526bb-eb93-4bb3-96ac-2c8e73591c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:53.079225 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96526bb-eb93-4bb3-96ac-2c8e73591c22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:53.079493 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96526bb-eb93-4bb3-96ac-2c8e73591c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:53.079768 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96526bb-eb93-4bb3-96ac-2c8e73591c22 admin admin] PATH_INFO: `/v3/users/ac03fe362952470783f38384919c2a02` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:53.086886 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96526bb-eb93-4bb3-96ac-2c8e73591c22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac03fe362952470783f38384919c2a02)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:53.086886 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96526bb-eb93-4bb3-96ac-2c8e73591c22 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:53.090300 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0315b489-6cb0-47da-bd9f-67b2584ae805 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:53.095481 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea1403-8c42-4590-8797-48b03bb6230d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:53.096204 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea1403-8c42-4590-8797-48b03bb6230d admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:53.096578 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea1403-8c42-4590-8797-48b03bb6230d admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:53.096922 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea1403-8c42-4590-8797-48b03bb6230d admin admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:53.097889 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daea1403-8c42-4590-8797-48b03bb6230d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:53.102270 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daea1403-8c42-4590-8797-48b03bb6230d admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:53.224651 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1106/2209] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:59:52 2022] POST /identity/v3/users => generated 293 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:59:53.232230 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea1403-8c42-4590-8797-48b03bb6230d admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:53.232230 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-daea1403-8c42-4590-8797-48b03bb6230d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:53.242487 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea1403-8c42-4590-8797-48b03bb6230d admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:53.247683 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5b9d4f-3791-4a33-91d1-5c68e513eb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:53.248333 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b9d4f-3791-4a33-91d1-5c68e513eb5b admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:53.248614 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b9d4f-3791-4a33-91d1-5c68e513eb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:53.248886 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b9d4f-3791-4a33-91d1-5c68e513eb5b admin admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:53.249609 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5b9d4f-3791-4a33-91d1-5c68e513eb5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:53.251814 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5b9d4f-3791-4a33-91d1-5c68e513eb5b admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:53.327666 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-a96526bb-eb93-4bb3-96ac-2c8e73591c22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac03fe362952470783f38384919c2a02'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:53.357408 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1107/2210] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 19:59:53 2022] POST /identity/v3/projects => generated 383 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:59:53.357408 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5b9d4f-3791-4a33-91d1-5c68e513eb5b admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:53.357408 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-de5b9d4f-3791-4a33-91d1-5c68e513eb5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:53.403179 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-a96526bb-eb93-4bb3-96ac-2c8e73591c22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac03fe362952470783f38384919c2a02'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:53.403971 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-a96526bb-eb93-4bb3-96ac-2c8e73591c22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac03fe362952470783f38384919c2a02'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:53.416929 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-a96526bb-eb93-4bb3-96ac-2c8e73591c22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac03fe362952470783f38384919c2a02'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:53.417640 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-a96526bb-eb93-4bb3-96ac-2c8e73591c22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac03fe362952470783f38384919c2a02'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:53.425609 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5b9d4f-3791-4a33-91d1-5c68e513eb5b admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:53.430254 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1104/2211] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 19:59:53 2022] DELETE /identity/v3/users/ac03fe362952470783f38384919c2a02 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:59:53.430402 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6654eaf2-8aa0-4df3-80c7-cd4ab674d8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:53.430925 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654eaf2-8aa0-4df3-80c7-cd4ab674d8b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:53.431169 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654eaf2-8aa0-4df3-80c7-cd4ab674d8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:53.431975 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654eaf2-8aa0-4df3-80c7-cd4ab674d8b2 admin admin] PATH_INFO: `/v3/projects/d7b117f71833404a99f19a89e6efa163` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:53.432251 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96526bb-eb93-4bb3-96ac-2c8e73591c22 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:53.433392 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6654eaf2-8aa0-4df3-80c7-cd4ab674d8b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7b117f71833404a99f19a89e6efa163)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:53.436990 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-a96526bb-eb93-4bb3-96ac-2c8e73591c22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:53.440550 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6654eaf2-8aa0-4df3-80c7-cd4ab674d8b2 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:53.512820 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96526bb-eb93-4bb3-96ac-2c8e73591c22 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:53.518618 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08310e64-9c98-4c72-8795-85f6d19f8af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:53.519504 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08310e64-9c98-4c72-8795-85f6d19f8af4 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:53.520055 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08310e64-9c98-4c72-8795-85f6d19f8af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:53.520844 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08310e64-9c98-4c72-8795-85f6d19f8af4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:53.521615 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08310e64-9c98-4c72-8795-85f6d19f8af4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:53.523226 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08310e64-9c98-4c72-8795-85f6d19f8af4 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:53.533958 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1105/2212] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:59:53 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:59:53.534903 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08310e64-9c98-4c72-8795-85f6d19f8af4 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:53.536707 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-08310e64-9c98-4c72-8795-85f6d19f8af4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:53.550102 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08310e64-9c98-4c72-8795-85f6d19f8af4 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:53.554822 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec5badf-a9ef-436c-8ed1-d576748684ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:53.555510 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec5badf-a9ef-436c-8ed1-d576748684ae admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:53.555904 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec5badf-a9ef-436c-8ed1-d576748684ae admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:53.556184 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec5badf-a9ef-436c-8ed1-d576748684ae admin admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:53.557777 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec5badf-a9ef-436c-8ed1-d576748684ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:53.563448 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec5badf-a9ef-436c-8ed1-d576748684ae admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:53.569902 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-6654eaf2-8aa0-4df3-80c7-cd4ab674d8b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7b117f71833404a99f19a89e6efa163', 'request_id': 'req-6654eaf2-8aa0-4df3-80c7-cd4ab674d8b2'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:53.576679 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-6654eaf2-8aa0-4df3-80c7-cd4ab674d8b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7b117f71833404a99f19a89e6efa163', 'request_id': 'req-6654eaf2-8aa0-4df3-80c7-cd4ab674d8b2'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:53.686530 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-6654eaf2-8aa0-4df3-80c7-cd4ab674d8b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7b117f71833404a99f19a89e6efa163', 'request_id': 'req-6654eaf2-8aa0-4df3-80c7-cd4ab674d8b2'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:53.692435 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1106/2213] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:59:53 2022] POST /identity/v3/users => generated 292 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:59:53.693635 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec5badf-a9ef-436c-8ed1-d576748684ae admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:53.710982 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec5badf-a9ef-436c-8ed1-d576748684ae admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:53.718900 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-6654eaf2-8aa0-4df3-80c7-cd4ab674d8b2 admin admin] The token cache is being invalidate because project d7b117f71833404a99f19a89e6efa163 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 19:59:53.719230 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-6654eaf2-8aa0-4df3-80c7-cd4ab674d8b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:53.719902 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-6654eaf2-8aa0-4df3-80c7-cd4ab674d8b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:53.721453 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1108/2214] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 19:59:53 2022] DELETE /identity/v3/projects/d7b117f71833404a99f19a89e6efa163 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:59:53.722428 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6654eaf2-8aa0-4df3-80c7-cd4ab674d8b2 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:53.723936 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-6654eaf2-8aa0-4df3-80c7-cd4ab674d8b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:53.806323 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715aae31-0d12-400a-a925-f65bd887000c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:53.808092 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715aae31-0d12-400a-a925-f65bd887000c admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:53.808218 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715aae31-0d12-400a-a925-f65bd887000c admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:53.808518 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715aae31-0d12-400a-a925-f65bd887000c admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:53.809306 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715aae31-0d12-400a-a925-f65bd887000c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:53.811573 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715aae31-0d12-400a-a925-f65bd887000c admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:53.824083 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6654eaf2-8aa0-4df3-80c7-cd4ab674d8b2 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:53.826912 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1107/2215] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:59:53 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:59:53.828737 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a026df9-18ae-4f03-a271-0396708c7d61 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:53.828737 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a026df9-18ae-4f03-a271-0396708c7d61 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:53.828956 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a026df9-18ae-4f03-a271-0396708c7d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:53.835568 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af37eb-5d6b-4ec9-baef-acc4b428235a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:53.836208 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af37eb-5d6b-4ec9-baef-acc4b428235a admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:53.836491 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af37eb-5d6b-4ec9-baef-acc4b428235a admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:53.836831 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af37eb-5d6b-4ec9-baef-acc4b428235a admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:53.837525 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af37eb-5d6b-4ec9-baef-acc4b428235a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:53.840861 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af37eb-5d6b-4ec9-baef-acc4b428235a admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:53.851822 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-9a026df9-18ae-4f03-a271-0396708c7d61 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:59:53.851969 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1109/2216] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:59:53 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:59:53.852846 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af37eb-5d6b-4ec9-baef-acc4b428235a admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:53.853438 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-9a026df9-18ae-4f03-a271-0396708c7d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:53.855389 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-53af37eb-5d6b-4ec9-baef-acc4b428235a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:53.862710 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1108/2217] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:59:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:59:53.863595 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a026df9-18ae-4f03-a271-0396708c7d61 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:53.874667 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a026df9-18ae-4f03-a271-0396708c7d61 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:53.881882 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefa8f65-fb53-46ab-a0be-94551bd155d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:53.882859 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa8f65-fb53-46ab-a0be-94551bd155d1 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:53.883193 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa8f65-fb53-46ab-a0be-94551bd155d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:53.885767 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af37eb-5d6b-4ec9-baef-acc4b428235a admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:53.885903 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa8f65-fb53-46ab-a0be-94551bd155d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:53.885903 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefa8f65-fb53-46ab-a0be-94551bd155d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:53.886920 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefa8f65-fb53-46ab-a0be-94551bd155d1 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:53.899877 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1109/2218] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:59:53 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:59:53.902401 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b5b66-5d73-4f22-b8ea-f5105c9546c9 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:53.902992 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b5b66-5d73-4f22-b8ea-f5105c9546c9 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:53.903359 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b5b66-5d73-4f22-b8ea-f5105c9546c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:53.903554 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60d849-ea44-4f15-b4fd-f80134e68c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:53.904420 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60d849-ea44-4f15-b4fd-f80134e68c7e admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:53.904733 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60d849-ea44-4f15-b4fd-f80134e68c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:53.908223 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60d849-ea44-4f15-b4fd-f80134e68c7e admin admin] PATH_INFO: `/v3/projects/abfcba48c87a4e84a0fb22d56dd341c7/users/05940a97dada45228a6fabe6cc315f6d/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:53.932119 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-b86b5b66-5d73-4f22-b8ea-f5105c9546c9 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:59:53.932812 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-b86b5b66-5d73-4f22-b8ea-f5105c9546c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:53.936437 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a60d849-ea44-4f15-b4fd-f80134e68c7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=abfcba48c87a4e84a0fb22d56dd341c7, user_id=05940a97dada45228a6fabe6cc315f6d, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:53.939951 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a60d849-ea44-4f15-b4fd-f80134e68c7e admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:53.949446 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1110/2219] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:59:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:59:53.950507 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b5b66-5d73-4f22-b8ea-f5105c9546c9 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:53.961819 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b5b66-5d73-4f22-b8ea-f5105c9546c9 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:53.967764 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5295733-7e50-4f0e-bed2-8ffdca397515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:53.968421 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5295733-7e50-4f0e-bed2-8ffdca397515 admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:53.968726 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5295733-7e50-4f0e-bed2-8ffdca397515 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:53.968985 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5295733-7e50-4f0e-bed2-8ffdca397515 admin admin] PATH_INFO: `/v3/projects/671b621e67104cc684a3213851f8502b/users/3843949a2f6d41a295f56d5697733d5f/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:53.985187 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5295733-7e50-4f0e-bed2-8ffdca397515 admin admin] RBAC: Authorizing `identity:create_grant(project_id=671b621e67104cc684a3213851f8502b, user_id=3843949a2f6d41a295f56d5697733d5f, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:53.987915 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5295733-7e50-4f0e-bed2-8ffdca397515 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:54.093533 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1110/2220] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:59:53 2022] PUT /identity/v3/projects/abfcba48c87a4e84a0fb22d56dd341c7/users/05940a97dada45228a6fabe6cc315f6d/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:59:54.093533 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60d849-ea44-4f15-b4fd-f80134e68c7e admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:54.110371 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1111/2221] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:59:53 2022] PUT /identity/v3/projects/671b621e67104cc684a3213851f8502b/users/3843949a2f6d41a295f56d5697733d5f/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:59:54.113037 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5295733-7e50-4f0e-bed2-8ffdca397515 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:54.126055 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-e5295733-7e50-4f0e-bed2-8ffdca397515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:54.145089 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:54.215909 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60d849-ea44-4f15-b4fd-f80134e68c7e admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:54.217187 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5295733-7e50-4f0e-bed2-8ffdca397515 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:54.221047 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9346dc37-1164-42be-a44a-23345c748a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:54.221686 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346dc37-1164-42be-a44a-23345c748a8b admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:54.221962 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346dc37-1164-42be-a44a-23345c748a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:54.222058 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad8280-896f-4424-9f8e-0b1faa766a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:54.222236 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346dc37-1164-42be-a44a-23345c748a8b admin admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:54.222859 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad8280-896f-4424-9f8e-0b1faa766a9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:54.222982 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9346dc37-1164-42be-a44a-23345c748a8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:59:54.223146 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad8280-896f-4424-9f8e-0b1faa766a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:54.223266 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9346dc37-1164-42be-a44a-23345c748a8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:54.223422 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad8280-896f-4424-9f8e-0b1faa766a9c admin admin] PATH_INFO: `/v3/projects/bc9aef5fec374903bd53be8192fd1df7` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:54.224866 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9346dc37-1164-42be-a44a-23345c748a8b admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:54.227237 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efad8280-896f-4424-9f8e-0b1faa766a9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc9aef5fec374903bd53be8192fd1df7)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:54.230048 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efad8280-896f-4424-9f8e-0b1faa766a9c admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:54.241262 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1111/2222] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 19:59:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:59:54.243172 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735e961-a6ae-46f6-a9a8-32d4629387e4 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:54.243638 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735e961-a6ae-46f6-a9a8-32d4629387e4 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:54.243755 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735e961-a6ae-46f6-a9a8-32d4629387e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:54.267187 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-e735e961-a6ae-46f6-a9a8-32d4629387e4 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:59:54.268415 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-e735e961-a6ae-46f6-a9a8-32d4629387e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:54.277345 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1112/2223] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:59:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:59:54.278613 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a9957-fd52-44e9-b712-2b8b1849cb27 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:54.278898 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a9957-fd52-44e9-b712-2b8b1849cb27 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:54.279189 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a9957-fd52-44e9-b712-2b8b1849cb27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:54.312253 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-4b2a9957-fd52-44e9-b712-2b8b1849cb27 None None] MFA Rules not processed for user `05940a97dada45228a6fabe6cc315f6d`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:59:54.313511 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-4b2a9957-fd52-44e9-b712-2b8b1849cb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:54.391309 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1113/2224] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:59:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:59:54.392551 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a9957-fd52-44e9-b712-2b8b1849cb27 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:54.399175 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-efad8280-896f-4424-9f8e-0b1faa766a9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc9aef5fec374903bd53be8192fd1df7', 'request_id': 'req-efad8280-896f-4424-9f8e-0b1faa766a9c'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:54.405753 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a9957-fd52-44e9-b712-2b8b1849cb27 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:54.464498 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8295a4-88c0-4f0d-98e3-66e8de6e0320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:54.465116 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8295a4-88c0-4f0d-98e3-66e8de6e0320 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:54.465426 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8295a4-88c0-4f0d-98e3-66e8de6e0320 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:54.465746 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8295a4-88c0-4f0d-98e3-66e8de6e0320 admin admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:54.466374 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8295a4-88c0-4f0d-98e3-66e8de6e0320 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:54.468322 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8295a4-88c0-4f0d-98e3-66e8de6e0320 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:54.479664 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-efad8280-896f-4424-9f8e-0b1faa766a9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc9aef5fec374903bd53be8192fd1df7', 'request_id': 'req-efad8280-896f-4424-9f8e-0b1faa766a9c'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:54.487349 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-efad8280-896f-4424-9f8e-0b1faa766a9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc9aef5fec374903bd53be8192fd1df7', 'request_id': 'req-efad8280-896f-4424-9f8e-0b1faa766a9c'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:54.499662 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-efad8280-896f-4424-9f8e-0b1faa766a9c admin admin] The token cache is being invalidate because project bc9aef5fec374903bd53be8192fd1df7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 19:59:54.499951 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-efad8280-896f-4424-9f8e-0b1faa766a9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:54.500630 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-efad8280-896f-4424-9f8e-0b1faa766a9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:59:54.502230 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1112/2225] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 19:59:54 2022] DELETE /identity/v3/projects/bc9aef5fec374903bd53be8192fd1df7 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:59:54.507509 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad8280-896f-4424-9f8e-0b1faa766a9c admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:54.507941 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-efad8280-896f-4424-9f8e-0b1faa766a9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:54.573598 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad8280-896f-4424-9f8e-0b1faa766a9c admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:54.577481 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f886034-74fa-4470-8cf4-6bd6f5d2b956 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:54.578139 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f886034-74fa-4470-8cf4-6bd6f5d2b956 service neutron] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:54.578418 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f886034-74fa-4470-8cf4-6bd6f5d2b956 service neutron] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:54.578720 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f886034-74fa-4470-8cf4-6bd6f5d2b956 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:54.580503 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-0f886034-74fa-4470-8cf4-6bd6f5d2b956 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:54.589328 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1114/2226] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 19:59:54 2022] POST /identity/v3/projects => generated 365 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:59:54.589328 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8295a4-88c0-4f0d-98e3-66e8de6e0320 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:54.594854 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-0b8295a4-88c0-4f0d-98e3-66e8de6e0320 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:54.600992 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f886034-74fa-4470-8cf4-6bd6f5d2b956 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:54.602571 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f886034-74fa-4470-8cf4-6bd6f5d2b956 service neutron] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:54.613134 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1113/2227] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:59:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:59:54.614514 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c17a7b-39be-40d8-b388-3b4490eed8c8 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:54.614862 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c17a7b-39be-40d8-b388-3b4490eed8c8 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:54.615199 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c17a7b-39be-40d8-b388-3b4490eed8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:54.644862 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-b1c17a7b-39be-40d8-b388-3b4490eed8c8 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:59:54.646944 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-b1c17a7b-39be-40d8-b388-3b4490eed8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:54.655351 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:54.707400 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8295a4-88c0-4f0d-98e3-66e8de6e0320 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:54.714375 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb2f19-5c59-4146-ba7e-44acdf4911f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:54.715870 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb2f19-5c59-4146-ba7e-44acdf4911f0 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:54.716301 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb2f19-5c59-4146-ba7e-44acdf4911f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:54.716723 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb2f19-5c59-4146-ba7e-44acdf4911f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:54.717693 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fb2f19-5c59-4146-ba7e-44acdf4911f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:54.719775 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fb2f19-5c59-4146-ba7e-44acdf4911f0 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:54.745519 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1114/2228] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:59:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:59:54.746653 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c17a7b-39be-40d8-b388-3b4490eed8c8 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:54.748056 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-b1c17a7b-39be-40d8-b388-3b4490eed8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:54.766270 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c17a7b-39be-40d8-b388-3b4490eed8c8 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:54.771479 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b79538-607f-44fc-b380-109aa70280a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:54.772251 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b79538-607f-44fc-b380-109aa70280a5 admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:54.772541 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b79538-607f-44fc-b380-109aa70280a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:54.772818 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b79538-607f-44fc-b380-109aa70280a5 admin admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:54.773466 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b79538-607f-44fc-b380-109aa70280a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:54.776282 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b79538-607f-44fc-b380-109aa70280a5 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:54.893780 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1115/2229] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 19:59:54 2022] POST /identity/v3/projects => generated 383 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:59:54.895104 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358bd8f9-4463-4038-bfbb-285367f87c78 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:54.895402 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358bd8f9-4463-4038-bfbb-285367f87c78 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:54.895689 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358bd8f9-4463-4038-bfbb-285367f87c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:54.916214 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-358bd8f9-4463-4038-bfbb-285367f87c78 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:59:54.917398 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-358bd8f9-4463-4038-bfbb-285367f87c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:54.935989 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1115/2230] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:59:54 2022] POST /identity/v3/users => generated 283 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:59:54.936976 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b79538-607f-44fc-b380-109aa70280a5 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:54.949542 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b79538-607f-44fc-b380-109aa70280a5 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:55.034915 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1116/2231] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:59:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:59:55.034915 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358bd8f9-4463-4038-bfbb-285367f87c78 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:55.048055 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358bd8f9-4463-4038-bfbb-285367f87c78 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:55.057535 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee9d3b-f93d-462a-a186-c5bd07a955b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:55.058432 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee9d3b-f93d-462a-a186-c5bd07a955b6 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:55.061210 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee9d3b-f93d-462a-a186-c5bd07a955b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:55.061210 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee9d3b-f93d-462a-a186-c5bd07a955b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:55.061879 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee9d3b-f93d-462a-a186-c5bd07a955b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:55.065084 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee9d3b-f93d-462a-a186-c5bd07a955b6 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:55.067656 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a2c00-8fc6-474b-9df9-72899b4a33be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:55.069565 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a2c00-8fc6-474b-9df9-72899b4a33be admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:55.070459 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a2c00-8fc6-474b-9df9-72899b4a33be admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:55.070891 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a2c00-8fc6-474b-9df9-72899b4a33be admin admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:55.071714 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a2c00-8fc6-474b-9df9-72899b4a33be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:55.074371 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a2c00-8fc6-474b-9df9-72899b4a33be admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:55.083204 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1117/2232] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:59:55 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:59:55.086908 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee9d3b-f93d-462a-a186-c5bd07a955b6 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:55.099249 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee9d3b-f93d-462a-a186-c5bd07a955b6 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:55.104622 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b24de6-6218-452d-9125-d6defe66e527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:55.110193 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b24de6-6218-452d-9125-d6defe66e527 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:55.110193 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b24de6-6218-452d-9125-d6defe66e527 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:55.110193 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b24de6-6218-452d-9125-d6defe66e527 admin admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:55.110193 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b24de6-6218-452d-9125-d6defe66e527 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:59:55.110193 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b24de6-6218-452d-9125-d6defe66e527 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:55.110193 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b24de6-6218-452d-9125-d6defe66e527 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:55.122977 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1118/2233] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 19:59:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:59:55.123945 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b24de6-6218-452d-9125-d6defe66e527 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:55.141876 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b24de6-6218-452d-9125-d6defe66e527 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:55.146965 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd81fc0-fd85-407d-b2c7-b9ff94c92dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:55.147575 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd81fc0-fd85-407d-b2c7-b9ff94c92dda admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:55.147843 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd81fc0-fd85-407d-b2c7-b9ff94c92dda admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:55.148109 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd81fc0-fd85-407d-b2c7-b9ff94c92dda admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:55.148745 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd81fc0-fd85-407d-b2c7-b9ff94c92dda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:55.150515 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd81fc0-fd85-407d-b2c7-b9ff94c92dda admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:55.162969 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1119/2234] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:59:55 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:59:55.162969 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd81fc0-fd85-407d-b2c7-b9ff94c92dda admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:55.175961 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd81fc0-fd85-407d-b2c7-b9ff94c92dda admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:55.195989 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1116/2235] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:59:54 2022] POST /identity/v3/users => generated 292 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:59:55.196292 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a2c00-8fc6-474b-9df9-72899b4a33be admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:55.203600 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94845c81-e349-4813-9438-48e4c77501d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:55.204350 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94845c81-e349-4813-9438-48e4c77501d6 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:55.204797 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94845c81-e349-4813-9438-48e4c77501d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:55.205189 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94845c81-e349-4813-9438-48e4c77501d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:55.206582 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94845c81-e349-4813-9438-48e4c77501d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:55.211293 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94845c81-e349-4813-9438-48e4c77501d6 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:55.219114 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a2c00-8fc6-474b-9df9-72899b4a33be admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:55.233960 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef36c3-8ef2-48f5-b131-78435441b681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:55.233960 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef36c3-8ef2-48f5-b131-78435441b681 admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:55.233960 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef36c3-8ef2-48f5-b131-78435441b681 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:55.233960 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef36c3-8ef2-48f5-b131-78435441b681 admin admin] PATH_INFO: `/v3/projects/6ad4996eeebc457c9f11617278ca0430/users/3d11ac7dca094cb28fef042e42d5c30d/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:55.267823 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ef36c3-8ef2-48f5-b131-78435441b681 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ad4996eeebc457c9f11617278ca0430, user_id=3d11ac7dca094cb28fef042e42d5c30d, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:55.271555 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ef36c3-8ef2-48f5-b131-78435441b681 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:55.331459 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1120/2236] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 19:59:55 2022] POST /identity/v3/projects => generated 377 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:59:55.333382 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94845c81-e349-4813-9438-48e4c77501d6 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:55.421348 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94845c81-e349-4813-9438-48e4c77501d6 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:55.429964 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1117/2237] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:59:55 2022] PUT /identity/v3/projects/6ad4996eeebc457c9f11617278ca0430/users/3d11ac7dca094cb28fef042e42d5c30d/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:59:55.429964 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef36c3-8ef2-48f5-b131-78435441b681 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:55.514186 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570ae040-d246-4f2e-947e-fcde675e1d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:55.514891 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ae040-d246-4f2e-947e-fcde675e1d69 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:55.515072 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ae040-d246-4f2e-947e-fcde675e1d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:55.515344 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ae040-d246-4f2e-947e-fcde675e1d69 admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:55.516021 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570ae040-d246-4f2e-947e-fcde675e1d69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:55.517659 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570ae040-d246-4f2e-947e-fcde675e1d69 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:55.528583 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1121/2238] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:59:55 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:59:55.529933 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d1ee8-93e5-45fa-b00d-db8bdc1f7453 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:55.530219 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d1ee8-93e5-45fa-b00d-db8bdc1f7453 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:55.530484 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d1ee8-93e5-45fa-b00d-db8bdc1f7453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:55.531191 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef36c3-8ef2-48f5-b131-78435441b681 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:55.537425 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f62758-9ff7-4cee-8911-6f78683e7e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:55.539362 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f62758-9ff7-4cee-8911-6f78683e7e36 admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:55.539728 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f62758-9ff7-4cee-8911-6f78683e7e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:55.540073 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f62758-9ff7-4cee-8911-6f78683e7e36 admin admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:55.542059 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f62758-9ff7-4cee-8911-6f78683e7e36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:55.544159 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f62758-9ff7-4cee-8911-6f78683e7e36 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:55.564556 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-c28d1ee8-93e5-45fa-b00d-db8bdc1f7453 None None] MFA Rules not processed for user `3d11ac7dca094cb28fef042e42d5c30d`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:59:55.566470 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-c28d1ee8-93e5-45fa-b00d-db8bdc1f7453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:55.633388 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1118/2239] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:59:55 2022] POST /identity/v3/users => generated 289 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:59:55.639625 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1122/2240] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:59:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:59:55.639625 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d1ee8-93e5-45fa-b00d-db8bdc1f7453 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:55.651342 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d1ee8-93e5-45fa-b00d-db8bdc1f7453 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:55.656692 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7ec26-eac7-4e5a-b7e5-861c6eb5851a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:55.657422 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7ec26-eac7-4e5a-b7e5-861c6eb5851a admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:55.657796 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7ec26-eac7-4e5a-b7e5-861c6eb5851a admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:55.658192 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7ec26-eac7-4e5a-b7e5-861c6eb5851a admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:55.658913 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f7ec26-eac7-4e5a-b7e5-861c6eb5851a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:55.660629 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f7ec26-eac7-4e5a-b7e5-861c6eb5851a admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:55.664308 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f62758-9ff7-4cee-8911-6f78683e7e36 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:55.677389 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1123/2241] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:59:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 19:59:55.677389 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7ec26-eac7-4e5a-b7e5-861c6eb5851a admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:55.679921 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-51f7ec26-eac7-4e5a-b7e5-861c6eb5851a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:55.684820 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f62758-9ff7-4cee-8911-6f78683e7e36 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:55.690539 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcf5021-f954-4336-8c40-5d947426d3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:55.691487 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf5021-f954-4336-8c40-5d947426d3d3 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:55.691774 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf5021-f954-4336-8c40-5d947426d3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:55.692202 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf5021-f954-4336-8c40-5d947426d3d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:55.692997 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcf5021-f954-4336-8c40-5d947426d3d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:55.695562 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcf5021-f954-4336-8c40-5d947426d3d3 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:55.709441 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1119/2242] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:59:55 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:59:55.710349 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcf5021-f954-4336-8c40-5d947426d3d3 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:55.728986 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcf5021-f954-4336-8c40-5d947426d3d3 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:55.734251 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c49eb9-28cf-4854-96cb-861677a0707a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:55.734879 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c49eb9-28cf-4854-96cb-861677a0707a admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:55.735552 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c49eb9-28cf-4854-96cb-861677a0707a admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:55.735834 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c49eb9-28cf-4854-96cb-861677a0707a admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:55.736933 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c49eb9-28cf-4854-96cb-861677a0707a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:55.739510 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c49eb9-28cf-4854-96cb-861677a0707a admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:55.757790 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1120/2243] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:59:55 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:59:55.759100 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c49eb9-28cf-4854-96cb-861677a0707a admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:55.777449 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c49eb9-28cf-4854-96cb-861677a0707a admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:55.782637 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b317d8-be4e-4125-ac19-f9722bb3093d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:55.783393 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b317d8-be4e-4125-ac19-f9722bb3093d admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:55.784211 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b317d8-be4e-4125-ac19-f9722bb3093d admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:55.784596 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b317d8-be4e-4125-ac19-f9722bb3093d admin admin] PATH_INFO: `/v3/projects/fd64cfdfb362403bb7b9e92112e72317/users/5747053f14fc4c0cab1425ae2743e860/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:55.789929 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7ec26-eac7-4e5a-b7e5-861c6eb5851a admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:55.796144 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec1a4e-6b32-4a2a-a8a2-39878a1dcd63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:55.797061 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec1a4e-6b32-4a2a-a8a2-39878a1dcd63 service cinder] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:55.797344 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec1a4e-6b32-4a2a-a8a2-39878a1dcd63 service cinder] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:55.797659 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec1a4e-6b32-4a2a-a8a2-39878a1dcd63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:55.802610 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b317d8-be4e-4125-ac19-f9722bb3093d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd64cfdfb362403bb7b9e92112e72317, user_id=5747053f14fc4c0cab1425ae2743e860, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:55.805448 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b317d8-be4e-4125-ac19-f9722bb3093d admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:55.807683 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ec1a4e-6b32-4a2a-a8a2-39878a1dcd63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:55.809917 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ec1a4e-6b32-4a2a-a8a2-39878a1dcd63 service cinder] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:55.819397 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1124/2244] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:59:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:59:55.820275 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec1a4e-6b32-4a2a-a8a2-39878a1dcd63 service cinder] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:55.831446 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec1a4e-6b32-4a2a-a8a2-39878a1dcd63 service cinder] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:55.836218 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69372188-9674-40f4-8fea-5846d7ca0110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:55.836872 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69372188-9674-40f4-8fea-5846d7ca0110 admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:55.837146 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69372188-9674-40f4-8fea-5846d7ca0110 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:55.837421 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69372188-9674-40f4-8fea-5846d7ca0110 admin admin] PATH_INFO: `/v3/projects/4483388728fa4ecf9dedc846e4c19200/users/e629b23c3b9042d4a2d41628ba1d22a0/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:55.854942 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69372188-9674-40f4-8fea-5846d7ca0110 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4483388728fa4ecf9dedc846e4c19200, user_id=e629b23c3b9042d4a2d41628ba1d22a0, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:55.858044 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69372188-9674-40f4-8fea-5846d7ca0110 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:55.903352 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1121/2245] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:59:55 2022] PUT /identity/v3/projects/fd64cfdfb362403bb7b9e92112e72317/users/5747053f14fc4c0cab1425ae2743e860/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:59:55.905011 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f46f5-67b7-4432-99ae-da93c3a14024 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:55.905301 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f46f5-67b7-4432-99ae-da93c3a14024 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:55.905614 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f46f5-67b7-4432-99ae-da93c3a14024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:55.941229 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:55.944822 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-661f46f5-67b7-4432-99ae-da93c3a14024 None None] MFA Rules not processed for user `5747053f14fc4c0cab1425ae2743e860`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:59:55.946807 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-661f46f5-67b7-4432-99ae-da93c3a14024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:55.987273 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1125/2246] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:59:55 2022] PUT /identity/v3/projects/4483388728fa4ecf9dedc846e4c19200/users/e629b23c3b9042d4a2d41628ba1d22a0/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:59:55.988710 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6fa763-38b8-4bb0-9ec3-a9e4d41325d0 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:55.988992 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6fa763-38b8-4bb0-9ec3-a9e4d41325d0 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:55.989260 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6fa763-38b8-4bb0-9ec3-a9e4d41325d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:56.023244 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-4e6fa763-38b8-4bb0-9ec3-a9e4d41325d0 None None] MFA Rules not processed for user `e629b23c3b9042d4a2d41628ba1d22a0`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:59:56.024499 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-4e6fa763-38b8-4bb0-9ec3-a9e4d41325d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:56.032648 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1122/2247] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:59:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:59:56.037141 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661f46f5-67b7-4432-99ae-da93c3a14024 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:56.101703 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1126/2248] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:59:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:59:56.106978 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6fa763-38b8-4bb0-9ec3-a9e4d41325d0 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:56.121908 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661f46f5-67b7-4432-99ae-da93c3a14024 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:56.197810 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d713b-0537-4e4d-879b-52b8fef83cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:56.200122 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d713b-0537-4e4d-879b-52b8fef83cd5 admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:56.200470 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d713b-0537-4e4d-879b-52b8fef83cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:56.200865 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d713b-0537-4e4d-879b-52b8fef83cd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:56.201820 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403d713b-0537-4e4d-879b-52b8fef83cd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:56.204388 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403d713b-0537-4e4d-879b-52b8fef83cd5 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:56.211516 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6fa763-38b8-4bb0-9ec3-a9e4d41325d0 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:56.216929 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b639a1c-5763-45b4-a68d-5d40152f64eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:56.217836 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b639a1c-5763-45b4-a68d-5d40152f64eb admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:56.218469 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b639a1c-5763-45b4-a68d-5d40152f64eb admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:56.218469 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b639a1c-5763-45b4-a68d-5d40152f64eb admin admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:56.219060 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b639a1c-5763-45b4-a68d-5d40152f64eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:56.220993 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b639a1c-5763-45b4-a68d-5d40152f64eb admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:56.351402 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1123/2249] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 19:59:56 2022] POST /identity/v3/projects => generated 385 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 19:59:56.358270 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d713b-0537-4e4d-879b-52b8fef83cd5 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:56.364867 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1127/2250] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 19:59:56 2022] POST /identity/v3/projects => generated 375 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:59:56.370096 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b639a1c-5763-45b4-a68d-5d40152f64eb admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:56.461291 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d713b-0537-4e4d-879b-52b8fef83cd5 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:56.469996 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046a87e-d592-4ef7-ada7-0ef0aa221d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:56.470962 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046a87e-d592-4ef7-ada7-0ef0aa221d2d admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:56.471503 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046a87e-d592-4ef7-ada7-0ef0aa221d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:56.471940 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046a87e-d592-4ef7-ada7-0ef0aa221d2d admin admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:56.473106 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c046a87e-d592-4ef7-ada7-0ef0aa221d2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:56.474690 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b639a1c-5763-45b4-a68d-5d40152f64eb admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:56.479073 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c046a87e-d592-4ef7-ada7-0ef0aa221d2d admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:56.481662 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953753af-5927-430e-985a-9b331a2a377c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:56.482732 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953753af-5927-430e-985a-9b331a2a377c admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:56.483163 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953753af-5927-430e-985a-9b331a2a377c admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:56.483784 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953753af-5927-430e-985a-9b331a2a377c admin admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:56.484599 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953753af-5927-430e-985a-9b331a2a377c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:56.491297 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953753af-5927-430e-985a-9b331a2a377c admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:56.636051 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1128/2251] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:59:56 2022] POST /identity/v3/users => generated 294 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:59:56.638967 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1124/2252] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 19:59:56 2022] POST /identity/v3/users => generated 299 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:59:56.639943 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953753af-5927-430e-985a-9b331a2a377c admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:56.644480 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046a87e-d592-4ef7-ada7-0ef0aa221d2d admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:56.689013 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953753af-5927-430e-985a-9b331a2a377c admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:56.694816 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046a87e-d592-4ef7-ada7-0ef0aa221d2d admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:56.705385 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a575f9-c2e6-4e8c-88da-5bbae669ee47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:56.707779 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a575f9-c2e6-4e8c-88da-5bbae669ee47 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:56.708132 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a575f9-c2e6-4e8c-88da-5bbae669ee47 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:56.708476 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a575f9-c2e6-4e8c-88da-5bbae669ee47 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:56.709299 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a575f9-c2e6-4e8c-88da-5bbae669ee47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:56.718780 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d1f3a0-6124-4275-a469-5c107d3bfe7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:56.719503 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d1f3a0-6124-4275-a469-5c107d3bfe7b admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:56.719908 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d1f3a0-6124-4275-a469-5c107d3bfe7b admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:56.720384 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d1f3a0-6124-4275-a469-5c107d3bfe7b admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:56.721223 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a575f9-c2e6-4e8c-88da-5bbae669ee47 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:56.722017 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d1f3a0-6124-4275-a469-5c107d3bfe7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:56.730618 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d1f3a0-6124-4275-a469-5c107d3bfe7b admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:56.741263 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1129/2253] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:59:56 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 19:59:56.745818 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d1f3a0-6124-4275-a469-5c107d3bfe7b admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:56.746266 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1125/2254] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:59:56 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:59:56.750941 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a575f9-c2e6-4e8c-88da-5bbae669ee47 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:56.764626 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d1f3a0-6124-4275-a469-5c107d3bfe7b admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:56.772044 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44615429-3f52-49c1-9e09-9a6ecd4f6fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:56.772872 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44615429-3f52-49c1-9e09-9a6ecd4f6fe1 admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:56.773246 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44615429-3f52-49c1-9e09-9a6ecd4f6fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:56.774085 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44615429-3f52-49c1-9e09-9a6ecd4f6fe1 admin admin] PATH_INFO: `/v3/projects/3c5140d59c7a403083d039023c0a4bdc/users/87d696cca6b94c46a848982ecb0332ac/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:56.793800 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a575f9-c2e6-4e8c-88da-5bbae669ee47 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:56.796433 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44615429-3f52-49c1-9e09-9a6ecd4f6fe1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c5140d59c7a403083d039023c0a4bdc, user_id=87d696cca6b94c46a848982ecb0332ac, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:56.799817 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44615429-3f52-49c1-9e09-9a6ecd4f6fe1 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:56.802208 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d53df-ad59-41dd-bb61-fdaa250b08a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:56.802949 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d53df-ad59-41dd-bb61-fdaa250b08a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:56.803232 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d53df-ad59-41dd-bb61-fdaa250b08a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:56.804731 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d53df-ad59-41dd-bb61-fdaa250b08a2 admin admin] PATH_INFO: `/v3/projects/501dc706a3fc4bb1b96ef29b5571634a/users/46aa0205c8104672a21db09d1ea7e2d8/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:56.832620 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d53df-ad59-41dd-bb61-fdaa250b08a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=501dc706a3fc4bb1b96ef29b5571634a, user_id=46aa0205c8104672a21db09d1ea7e2d8, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:56.836454 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d53df-ad59-41dd-bb61-fdaa250b08a2 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:56.905532 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1130/2255] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:59:56 2022] PUT /identity/v3/projects/3c5140d59c7a403083d039023c0a4bdc/users/87d696cca6b94c46a848982ecb0332ac/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:59:56.909188 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44615429-3f52-49c1-9e09-9a6ecd4f6fe1 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:56.974398 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:56.980079 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1126/2256] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:59:56 2022] PUT /identity/v3/projects/501dc706a3fc4bb1b96ef29b5571634a/users/46aa0205c8104672a21db09d1ea7e2d8/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:59:56.984128 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d53df-ad59-41dd-bb61-fdaa250b08a2 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:56.997808 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44615429-3f52-49c1-9e09-9a6ecd4f6fe1 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:57.082482 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4519af1-cd27-4881-b2d6-c991ba78f437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:57.083265 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4519af1-cd27-4881-b2d6-c991ba78f437 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:57.085282 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4519af1-cd27-4881-b2d6-c991ba78f437 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:57.085282 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4519af1-cd27-4881-b2d6-c991ba78f437 admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:57.086157 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4519af1-cd27-4881-b2d6-c991ba78f437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:57.089414 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4519af1-cd27-4881-b2d6-c991ba78f437 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:57.102571 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1131/2257] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:59:56 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:59:57.106974 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4519af1-cd27-4881-b2d6-c991ba78f437 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:57.112441 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d53df-ad59-41dd-bb61-fdaa250b08a2 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:57.119659 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a73cd-cfe0-4d93-b302-9d1318f5f893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:57.120687 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a73cd-cfe0-4d93-b302-9d1318f5f893 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:57.121107 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a73cd-cfe0-4d93-b302-9d1318f5f893 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:57.121395 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4519af1-cd27-4881-b2d6-c991ba78f437 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:57.121724 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a73cd-cfe0-4d93-b302-9d1318f5f893 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:57.122543 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a73cd-cfe0-4d93-b302-9d1318f5f893 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:57.125475 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a73cd-cfe0-4d93-b302-9d1318f5f893 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:57.128016 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c84d465-a8c5-4eef-9a64-6afa8b51630a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:57.128794 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c84d465-a8c5-4eef-9a64-6afa8b51630a admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:57.129172 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c84d465-a8c5-4eef-9a64-6afa8b51630a admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:57.129721 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c84d465-a8c5-4eef-9a64-6afa8b51630a admin admin] PATH_INFO: `/v3/projects/3c5140d59c7a403083d039023c0a4bdc/users/87d696cca6b94c46a848982ecb0332ac/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:57.132863 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c84d465-a8c5-4eef-9a64-6afa8b51630a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c5140d59c7a403083d039023c0a4bdc, user_id=87d696cca6b94c46a848982ecb0332ac, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:57.137022 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c84d465-a8c5-4eef-9a64-6afa8b51630a admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:57.143195 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1127/2258] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 19:59:56 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 19:59:57.147376 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a73cd-cfe0-4d93-b302-9d1318f5f893 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:57.160994 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a73cd-cfe0-4d93-b302-9d1318f5f893 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:57.169939 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1132/2259] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:59:57 2022] PUT /identity/v3/projects/3c5140d59c7a403083d039023c0a4bdc/users/87d696cca6b94c46a848982ecb0332ac/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:59:57.181857 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c5b84-b078-4d3e-8491-f2ee525aab1b None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:57.182357 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c5b84-b078-4d3e-8491-f2ee525aab1b None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:57.182814 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c5b84-b078-4d3e-8491-f2ee525aab1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:57.222289 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-1b4c5b84-b078-4d3e-8491-f2ee525aab1b None None] MFA Rules not processed for user `87d696cca6b94c46a848982ecb0332ac`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:59:57.223807 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-1b4c5b84-b078-4d3e-8491-f2ee525aab1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:57.245246 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac64a29-48bd-4887-90e1-fbc408fd2daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:57.245970 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac64a29-48bd-4887-90e1-fbc408fd2daa admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:57.246365 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac64a29-48bd-4887-90e1-fbc408fd2daa admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:57.246732 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac64a29-48bd-4887-90e1-fbc408fd2daa admin admin] PATH_INFO: `/v3/projects/501dc706a3fc4bb1b96ef29b5571634a/users/46aa0205c8104672a21db09d1ea7e2d8/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:57.249641 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac64a29-48bd-4887-90e1-fbc408fd2daa admin admin] RBAC: Authorizing `identity:create_grant(project_id=501dc706a3fc4bb1b96ef29b5571634a, user_id=46aa0205c8104672a21db09d1ea7e2d8, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:57.253107 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac64a29-48bd-4887-90e1-fbc408fd2daa admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:57.275844 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1128/2260] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 19:59:57 2022] PUT /identity/v3/projects/501dc706a3fc4bb1b96ef29b5571634a/users/46aa0205c8104672a21db09d1ea7e2d8/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:59:57.277976 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15037bb6-b6ed-4e54-bea5-7d415b52751c None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:57.278347 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15037bb6-b6ed-4e54-bea5-7d415b52751c None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:57.278832 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15037bb6-b6ed-4e54-bea5-7d415b52751c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:57.328164 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1133/2261] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:59:57 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:59:57.330158 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-15037bb6-b6ed-4e54-bea5-7d415b52751c None None] MFA Rules not processed for user `46aa0205c8104672a21db09d1ea7e2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:59:57.331980 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-15037bb6-b6ed-4e54-bea5-7d415b52751c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:57.341025 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c5b84-b078-4d3e-8491-f2ee525aab1b None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:57.343052 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-1b4c5b84-b078-4d3e-8491-f2ee525aab1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:57.432596 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c5b84-b078-4d3e-8491-f2ee525aab1b None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:57.433663 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1129/2262] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 19:59:57 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:59:57.437400 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15037bb6-b6ed-4e54-bea5-7d415b52751c None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:59:57.514950 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8cbb52-38d9-40d9-b791-d96d22152894 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:57.515756 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8cbb52-38d9-40d9-b791-d96d22152894 service cinder] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:57.515903 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8cbb52-38d9-40d9-b791-d96d22152894 service cinder] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:57.516433 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8cbb52-38d9-40d9-b791-d96d22152894 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:57.529108 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15037bb6-b6ed-4e54-bea5-7d415b52751c None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:59:57.533826 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e8201-801e-40cf-bf66-c146fd15337d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:59:57.535304 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e8201-801e-40cf-bf66-c146fd15337d service cinder] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:59:57.536678 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e8201-801e-40cf-bf66-c146fd15337d service cinder] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:59:57.539350 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e8201-801e-40cf-bf66-c146fd15337d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:59:57.544309 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-1c4e8201-801e-40cf-bf66-c146fd15337d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:59:57.690734 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8cbb52-38d9-40d9-b791-d96d22152894 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:57.696430 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8cbb52-38d9-40d9-b791-d96d22152894 service cinder] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:57.703837 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4e8201-801e-40cf-bf66-c146fd15337d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:59:57.705584 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4e8201-801e-40cf-bf66-c146fd15337d service cinder] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:59:57.717216 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1134/2263] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:59:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 19:59:57.717412 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1130/2264] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 19:59:57 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 19:59:58.773230 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:59:59.875759 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:00.496277 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:01.439170 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8cbb52-38d9-40d9-b791-d96d22152894 service cinder] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:01.455623 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8cbb52-38d9-40d9-b791-d96d22152894 service cinder] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:01.463536 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295306c1-0769-4f6f-8f14-c88c14df5438 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:01.466259 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295306c1-0769-4f6f-8f14-c88c14df5438 service cinder] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:01.466712 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295306c1-0769-4f6f-8f14-c88c14df5438 service cinder] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:01.467108 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295306c1-0769-4f6f-8f14-c88c14df5438 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:01.562626 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295306c1-0769-4f6f-8f14-c88c14df5438 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:01.565053 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295306c1-0769-4f6f-8f14-c88c14df5438 service cinder] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:01.579171 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1135/2265] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:00:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:00:02.133137 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:02.158288 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:02.324200 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee4d325-94ba-4a2f-8f59-26a07cd882ac None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:02.324488 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee4d325-94ba-4a2f-8f59-26a07cd882ac None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:02.324773 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee4d325-94ba-4a2f-8f59-26a07cd882ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:02.360131 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-bee4d325-94ba-4a2f-8f59-26a07cd882ac None None] MFA Rules not processed for user `3843949a2f6d41a295f56d5697733d5f`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:00:02.361622 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-bee4d325-94ba-4a2f-8f59-26a07cd882ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:02.446242 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1131/2266] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:00:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:00:02.451546 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295306c1-0769-4f6f-8f14-c88c14df5438 service cinder] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:02.453207 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-295306c1-0769-4f6f-8f14-c88c14df5438 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:02.530213 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295306c1-0769-4f6f-8f14-c88c14df5438 service cinder] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:02.535489 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b92b247-cb77-47b2-94ad-90e55c7fd8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:02.536121 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92b247-cb77-47b2-94ad-90e55c7fd8ec admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:02.536390 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92b247-cb77-47b2-94ad-90e55c7fd8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:02.536666 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92b247-cb77-47b2-94ad-90e55c7fd8ec admin admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:02.537312 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b92b247-cb77-47b2-94ad-90e55c7fd8ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:02.539400 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b92b247-cb77-47b2-94ad-90e55c7fd8ec admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:02.669912 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1136/2267] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 20:00:02 2022] POST /identity/v3/projects => generated 383 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 20:00:02.678803 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee4d325-94ba-4a2f-8f59-26a07cd882ac None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:02.689776 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee4d325-94ba-4a2f-8f59-26a07cd882ac None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:02.751561 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d657061-9759-4413-9cde-4ece72854a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:02.752364 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d657061-9759-4413-9cde-4ece72854a71 admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:02.752726 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d657061-9759-4413-9cde-4ece72854a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:02.752985 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d657061-9759-4413-9cde-4ece72854a71 admin admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:02.753652 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d657061-9759-4413-9cde-4ece72854a71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:02.755800 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d657061-9759-4413-9cde-4ece72854a71 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:02.871219 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1132/2268] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 20:00:02 2022] POST /identity/v3/users => generated 298 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:00:02.875417 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b92b247-cb77-47b2-94ad-90e55c7fd8ec admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:02.886927 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b92b247-cb77-47b2-94ad-90e55c7fd8ec admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:02.893729 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34fc7d-6caf-41b2-9f4d-ce8d7f68cf87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:02.894205 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34fc7d-6caf-41b2-9f4d-ce8d7f68cf87 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:02.894488 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34fc7d-6caf-41b2-9f4d-ce8d7f68cf87 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:02.899697 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34fc7d-6caf-41b2-9f4d-ce8d7f68cf87 admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:02.899697 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc34fc7d-6caf-41b2-9f4d-ce8d7f68cf87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:02.899697 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc34fc7d-6caf-41b2-9f4d-ce8d7f68cf87 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:02.911432 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1137/2269] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 20:00:02.915687 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d657061-9759-4413-9cde-4ece72854a71 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:02.925661 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d657061-9759-4413-9cde-4ece72854a71 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:02.930161 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2247f4ee-025a-4b7a-81fa-220a2489312f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:02.930798 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247f4ee-025a-4b7a-81fa-220a2489312f admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:02.931075 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247f4ee-025a-4b7a-81fa-220a2489312f admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:02.931378 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247f4ee-025a-4b7a-81fa-220a2489312f admin admin] PATH_INFO: `/v3/projects/404f7dd30e08462c9fb23f0392741290/users/0c095514ca4042d38da06e2babc17243/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:02.945803 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2247f4ee-025a-4b7a-81fa-220a2489312f admin admin] RBAC: Authorizing `identity:create_grant(project_id=404f7dd30e08462c9fb23f0392741290, user_id=0c095514ca4042d38da06e2babc17243, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:02.949037 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2247f4ee-025a-4b7a-81fa-220a2489312f admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:03.032800 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1133/2270] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 20:00:02 2022] PUT /identity/v3/projects/404f7dd30e08462c9fb23f0392741290/users/0c095514ca4042d38da06e2babc17243/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:00:03.037219 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34fc7d-6caf-41b2-9f4d-ce8d7f68cf87 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:03.047578 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34fc7d-6caf-41b2-9f4d-ce8d7f68cf87 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:03.111773 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61258d0-9e65-40c1-9971-0cd9d12fdd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:03.112406 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61258d0-9e65-40c1-9971-0cd9d12fdd63 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:03.112682 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61258d0-9e65-40c1-9971-0cd9d12fdd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:03.112949 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61258d0-9e65-40c1-9971-0cd9d12fdd63 admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:03.113653 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61258d0-9e65-40c1-9971-0cd9d12fdd63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:03.117590 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61258d0-9e65-40c1-9971-0cd9d12fdd63 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:03.126302 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1138/2271] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:00:03 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:00:03.130565 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2247f4ee-025a-4b7a-81fa-220a2489312f admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:03.150730 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2247f4ee-025a-4b7a-81fa-220a2489312f admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:03.150730 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5633087-bb3f-4993-a6a6-ae1e156858e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:03.150730 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5633087-bb3f-4993-a6a6-ae1e156858e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:03.151098 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5633087-bb3f-4993-a6a6-ae1e156858e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:03.151200 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5633087-bb3f-4993-a6a6-ae1e156858e4 admin admin] PATH_INFO: `/v3/projects/404f7dd30e08462c9fb23f0392741290/users/0c095514ca4042d38da06e2babc17243/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:03.153658 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5633087-bb3f-4993-a6a6-ae1e156858e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=404f7dd30e08462c9fb23f0392741290, user_id=0c095514ca4042d38da06e2babc17243, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:03.157770 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5633087-bb3f-4993-a6a6-ae1e156858e4 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:03.173877 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1134/2272] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 20:00:03 2022] PUT /identity/v3/projects/404f7dd30e08462c9fb23f0392741290/users/0c095514ca4042d38da06e2babc17243/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 20:00:03.336995 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61258d0-9e65-40c1-9971-0cd9d12fdd63 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:03.402664 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61258d0-9e65-40c1-9971-0cd9d12fdd63 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:03.453232 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2588c-d3fb-47bd-9e20-e764e8278c78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:03.453879 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2588c-d3fb-47bd-9e20-e764e8278c78 service cinder] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:03.454156 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2588c-d3fb-47bd-9e20-e764e8278c78 service cinder] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:03.454423 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2588c-d3fb-47bd-9e20-e764e8278c78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:03.522049 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f2588c-d3fb-47bd-9e20-e764e8278c78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:03.523710 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f2588c-d3fb-47bd-9e20-e764e8278c78 service cinder] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:03.536901 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1139/2273] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:00:03 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:00:03.921799 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:04.021311 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:04.919439 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5633087-bb3f-4993-a6a6-ae1e156858e4 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:04.932218 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5633087-bb3f-4993-a6a6-ae1e156858e4 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:04.939478 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c63fb5-e074-4391-9388-3e0a9d0e2bcc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:04.939478 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c63fb5-e074-4391-9388-3e0a9d0e2bcc service cinder] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:04.939478 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c63fb5-e074-4391-9388-3e0a9d0e2bcc service cinder] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:04.939478 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c63fb5-e074-4391-9388-3e0a9d0e2bcc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:05.053035 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c63fb5-e074-4391-9388-3e0a9d0e2bcc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:05.054625 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c63fb5-e074-4391-9388-3e0a9d0e2bcc service cinder] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:05.071840 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1135/2274] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:00:04 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:00:06.041645 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:06.143622 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:09.320897 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:09.375909 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:09.717745 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963869d-b16b-4420-b975-fcf5a7593919 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:09.718041 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963869d-b16b-4420-b975-fcf5a7593919 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:09.718339 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963869d-b16b-4420-b975-fcf5a7593919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:09.751740 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-7963869d-b16b-4420-b975-fcf5a7593919 None None] MFA Rules not processed for user `0c095514ca4042d38da06e2babc17243`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:00:09.753091 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-7963869d-b16b-4420-b975-fcf5a7593919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:09.826842 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1140/2275] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:00:09 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:00:09.845121 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c63fb5-e074-4391-9388-3e0a9d0e2bcc service cinder] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:09.846816 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-b3c63fb5-e074-4391-9388-3e0a9d0e2bcc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:09.912460 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c63fb5-e074-4391-9388-3e0a9d0e2bcc service cinder] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:09.922946 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ec5656-b0e6-496b-a812-461dba4884e5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaf6ec7f5b4f490aa22a8e3bea91da39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:09.923590 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec5656-b0e6-496b-a812-461dba4884e5 service glance] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:09.923878 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec5656-b0e6-496b-a812-461dba4884e5 service glance] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:09.924151 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec5656-b0e6-496b-a812-461dba4884e5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:09.991889 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ec5656-b0e6-496b-a812-461dba4884e5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:09.994167 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ec5656-b0e6-496b-a812-461dba4884e5 service glance] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:10.006655 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1136/2276] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:00:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:00:10.101118 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7963869d-b16b-4420-b975-fcf5a7593919 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:10.179107 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7963869d-b16b-4420-b975-fcf5a7593919 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:10.185729 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240adb8-8e1b-49bb-8e9c-ef73a69939b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:10.186837 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240adb8-8e1b-49bb-8e9c-ef73a69939b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:10.187412 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240adb8-8e1b-49bb-8e9c-ef73a69939b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:10.187994 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240adb8-8e1b-49bb-8e9c-ef73a69939b3 admin admin] PATH_INFO: `/v3/users/05940a97dada45228a6fabe6cc315f6d` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:10.189277 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e240adb8-8e1b-49bb-8e9c-ef73a69939b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05940a97dada45228a6fabe6cc315f6d)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:10.191433 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e240adb8-8e1b-49bb-8e9c-ef73a69939b3 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:10.474187 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b002847-525e-44f6-ae8d-da20a67aed07 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:10.474187 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b002847-525e-44f6-ae8d-da20a67aed07 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:10.474187 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b002847-525e-44f6-ae8d-da20a67aed07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:10.490478 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-3b002847-525e-44f6-ae8d-da20a67aed07 None None] MFA Rules not processed for user `fd597f74abdf49288ea0d92642c6a5a2`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:00:10.491752 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-3b002847-525e-44f6-ae8d-da20a67aed07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:10.552258 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1137/2277] 10.222.0.60 () {58 vars in 1009 bytes} [Sat Sep 24 20:00:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 20:00:10.586435 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-e240adb8-8e1b-49bb-8e9c-ef73a69939b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05940a97dada45228a6fabe6cc315f6d'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:10.614469 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b002847-525e-44f6-ae8d-da20a67aed07 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:10.617798 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-3b002847-525e-44f6-ae8d-da20a67aed07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:10.695300 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b002847-525e-44f6-ae8d-da20a67aed07 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:10.702571 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d8e56-5d4e-428f-9976-ad8366296828 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd94cd16acc45e6ac2997204297fb75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:10.703893 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d8e56-5d4e-428f-9976-ad8366296828 service swift] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:10.703893 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d8e56-5d4e-428f-9976-ad8366296828 service swift] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:10.704071 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d8e56-5d4e-428f-9976-ad8366296828 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:10.704219 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-e240adb8-8e1b-49bb-8e9c-ef73a69939b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05940a97dada45228a6fabe6cc315f6d'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:10.706728 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-e240adb8-8e1b-49bb-8e9c-ef73a69939b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05940a97dada45228a6fabe6cc315f6d'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:10.707529 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-e240adb8-8e1b-49bb-8e9c-ef73a69939b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05940a97dada45228a6fabe6cc315f6d'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:10.715192 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d8e56-5d4e-428f-9976-ad8366296828 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:10.717790 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d8e56-5d4e-428f-9976-ad8366296828 service swift] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:10.726589 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-e240adb8-8e1b-49bb-8e9c-ef73a69939b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05940a97dada45228a6fabe6cc315f6d'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:10.728596 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1138/2278] 10.222.0.60 () {60 vars in 1384 bytes} [Sat Sep 24 20:00:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 24 20:00:10.758388 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1141/2279] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 20:00:10 2022] DELETE /identity/v3/users/05940a97dada45228a6fabe6cc315f6d => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:00:10.768029 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90236f9-c1d4-4f6b-b924-416e10a9140c None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:10.768243 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90236f9-c1d4-4f6b-b924-416e10a9140c None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:10.768522 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90236f9-c1d4-4f6b-b924-416e10a9140c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:10.804880 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-d90236f9-c1d4-4f6b-b924-416e10a9140c None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:00:10.807012 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-d90236f9-c1d4-4f6b-b924-416e10a9140c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:10.889404 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1139/2280] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:00:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:00:10.907790 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240adb8-8e1b-49bb-8e9c-ef73a69939b3 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:10.909243 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-e240adb8-8e1b-49bb-8e9c-ef73a69939b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:10.988367 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240adb8-8e1b-49bb-8e9c-ef73a69939b3 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:10.992943 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb6d3c-d970-44e0-81f2-df35d8e957ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:10.994487 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb6d3c-d970-44e0-81f2-df35d8e957ca service neutron] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:10.994988 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb6d3c-d970-44e0-81f2-df35d8e957ca service neutron] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:10.995392 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb6d3c-d970-44e0-81f2-df35d8e957ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:11.029132 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eb6d3c-d970-44e0-81f2-df35d8e957ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:11.030880 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eb6d3c-d970-44e0-81f2-df35d8e957ca service neutron] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:11.047748 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1142/2281] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:00:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:00:12.595822 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90236f9-c1d4-4f6b-b924-416e10a9140c None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:12.601727 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-d90236f9-c1d4-4f6b-b924-416e10a9140c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:12.636351 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90236f9-c1d4-4f6b-b924-416e10a9140c None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:12.649526 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c61528-8e15-46b7-8767-6a419d9b663b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:12.655699 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c61528-8e15-46b7-8767-6a419d9b663b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:12.655975 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c61528-8e15-46b7-8767-6a419d9b663b admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:12.656255 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c61528-8e15-46b7-8767-6a419d9b663b admin admin] PATH_INFO: `/v3/projects/abfcba48c87a4e84a0fb22d56dd341c7` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:12.657849 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c61528-8e15-46b7-8767-6a419d9b663b admin admin] RBAC: Authorizing `identity:delete_project(project_id=abfcba48c87a4e84a0fb22d56dd341c7)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:12.660840 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c61528-8e15-46b7-8767-6a419d9b663b admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:12.781335 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:12.840712 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:12.849686 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-06c61528-8e15-46b7-8767-6a419d9b663b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abfcba48c87a4e84a0fb22d56dd341c7', 'request_id': 'req-06c61528-8e15-46b7-8767-6a419d9b663b'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:12.955340 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-06c61528-8e15-46b7-8767-6a419d9b663b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abfcba48c87a4e84a0fb22d56dd341c7', 'request_id': 'req-06c61528-8e15-46b7-8767-6a419d9b663b'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:12.964701 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-06c61528-8e15-46b7-8767-6a419d9b663b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abfcba48c87a4e84a0fb22d56dd341c7', 'request_id': 'req-06c61528-8e15-46b7-8767-6a419d9b663b'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:12.996160 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-06c61528-8e15-46b7-8767-6a419d9b663b admin admin] The token cache is being invalidate because project abfcba48c87a4e84a0fb22d56dd341c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 20:00:13.000543 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-06c61528-8e15-46b7-8767-6a419d9b663b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:13.000543 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-06c61528-8e15-46b7-8767-6a419d9b663b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:13.002111 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1140/2282] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 20:00:12 2022] DELETE /identity/v3/projects/abfcba48c87a4e84a0fb22d56dd341c7 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:00:13.005746 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb6d3c-d970-44e0-81f2-df35d8e957ca service neutron] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:13.022010 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb6d3c-d970-44e0-81f2-df35d8e957ca service neutron] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:13.103727 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11a4bd-e0de-45cf-b4ba-f9157b287222 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:13.106340 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11a4bd-e0de-45cf-b4ba-f9157b287222 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:13.106751 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11a4bd-e0de-45cf-b4ba-f9157b287222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:13.122052 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea5c433-d935-4ba1-b5cd-431f201ddc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:13.124638 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5c433-d935-4ba1-b5cd-431f201ddc98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:13.124638 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5c433-d935-4ba1-b5cd-431f201ddc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:13.124638 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5c433-d935-4ba1-b5cd-431f201ddc98 admin admin] PATH_INFO: `/v3/users/5747053f14fc4c0cab1425ae2743e860` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:13.126015 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea5c433-d935-4ba1-b5cd-431f201ddc98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5747053f14fc4c0cab1425ae2743e860)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:13.128162 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea5c433-d935-4ba1-b5cd-431f201ddc98 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:13.138178 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-ce11a4bd-e0de-45cf-b4ba-f9157b287222 None None] MFA Rules not processed for user `b418518e8d14456d81965247b5e42003`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:00:13.139671 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-ce11a4bd-e0de-45cf-b4ba-f9157b287222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:13.307921 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1141/2283] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:00:13 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:00:13.443484 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-6ea5c433-d935-4ba1-b5cd-431f201ddc98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5747053f14fc4c0cab1425ae2743e860'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:13.595822 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-6ea5c433-d935-4ba1-b5cd-431f201ddc98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5747053f14fc4c0cab1425ae2743e860'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:13.596509 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-6ea5c433-d935-4ba1-b5cd-431f201ddc98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5747053f14fc4c0cab1425ae2743e860'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:13.597151 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-6ea5c433-d935-4ba1-b5cd-431f201ddc98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5747053f14fc4c0cab1425ae2743e860'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:13.618056 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-6ea5c433-d935-4ba1-b5cd-431f201ddc98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5747053f14fc4c0cab1425ae2743e860'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:13.654067 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1143/2284] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 20:00:13 2022] DELETE /identity/v3/users/5747053f14fc4c0cab1425ae2743e860 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:00:14.369065 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce11a4bd-e0de-45cf-b4ba-f9157b287222 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:14.370761 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-ce11a4bd-e0de-45cf-b4ba-f9157b287222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:14.393929 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce11a4bd-e0de-45cf-b4ba-f9157b287222 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:14.536067 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7710343b-ac9e-4d22-a6c1-60481cac12da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:14.537171 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710343b-ac9e-4d22-a6c1-60481cac12da admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:14.537658 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710343b-ac9e-4d22-a6c1-60481cac12da admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:14.538117 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710343b-ac9e-4d22-a6c1-60481cac12da admin admin] PATH_INFO: `/v3/projects/fd64cfdfb362403bb7b9e92112e72317` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:14.557841 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7710343b-ac9e-4d22-a6c1-60481cac12da admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd64cfdfb362403bb7b9e92112e72317)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:14.559792 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7710343b-ac9e-4d22-a6c1-60481cac12da admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:14.626999 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:14.845864 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-7710343b-ac9e-4d22-a6c1-60481cac12da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd64cfdfb362403bb7b9e92112e72317', 'request_id': 'req-7710343b-ac9e-4d22-a6c1-60481cac12da'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:14.945298 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-7710343b-ac9e-4d22-a6c1-60481cac12da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd64cfdfb362403bb7b9e92112e72317', 'request_id': 'req-7710343b-ac9e-4d22-a6c1-60481cac12da'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:14.951461 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-7710343b-ac9e-4d22-a6c1-60481cac12da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd64cfdfb362403bb7b9e92112e72317', 'request_id': 'req-7710343b-ac9e-4d22-a6c1-60481cac12da'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:14.964306 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-7710343b-ac9e-4d22-a6c1-60481cac12da admin admin] The token cache is being invalidate because project fd64cfdfb362403bb7b9e92112e72317 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 20:00:14.964513 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-7710343b-ac9e-4d22-a6c1-60481cac12da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:14.965421 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-7710343b-ac9e-4d22-a6c1-60481cac12da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:14.966900 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1142/2285] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 20:00:14 2022] DELETE /identity/v3/projects/fd64cfdfb362403bb7b9e92112e72317 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:00:14.970655 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea5c433-d935-4ba1-b5cd-431f201ddc98 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:14.972200 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-6ea5c433-d935-4ba1-b5cd-431f201ddc98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:14.986439 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea5c433-d935-4ba1-b5cd-431f201ddc98 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:15.060695 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd1425-c070-4a60-82a5-4de700fc9aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:15.065715 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd1425-c070-4a60-82a5-4de700fc9aa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:15.065715 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd1425-c070-4a60-82a5-4de700fc9aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:15.065715 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd1425-c070-4a60-82a5-4de700fc9aa6 admin admin] PATH_INFO: `/v3/users/46aa0205c8104672a21db09d1ea7e2d8` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:15.065715 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fd1425-c070-4a60-82a5-4de700fc9aa6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46aa0205c8104672a21db09d1ea7e2d8)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:15.065715 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fd1425-c070-4a60-82a5-4de700fc9aa6 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:15.872285 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-f7fd1425-c070-4a60-82a5-4de700fc9aa6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46aa0205c8104672a21db09d1ea7e2d8'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:15.937016 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-f7fd1425-c070-4a60-82a5-4de700fc9aa6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46aa0205c8104672a21db09d1ea7e2d8'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:15.937874 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-f7fd1425-c070-4a60-82a5-4de700fc9aa6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46aa0205c8104672a21db09d1ea7e2d8'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:15.938531 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-f7fd1425-c070-4a60-82a5-4de700fc9aa6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46aa0205c8104672a21db09d1ea7e2d8'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:15.956662 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-f7fd1425-c070-4a60-82a5-4de700fc9aa6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46aa0205c8104672a21db09d1ea7e2d8'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:15.974826 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1144/2286] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 20:00:14 2022] DELETE /identity/v3/users/46aa0205c8104672a21db09d1ea7e2d8 => generated 0 bytes in 1002 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:00:16.322349 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:16.645193 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7710343b-ac9e-4d22-a6c1-60481cac12da admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:16.645193 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-7710343b-ac9e-4d22-a6c1-60481cac12da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:16.663752 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7710343b-ac9e-4d22-a6c1-60481cac12da admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:16.748146 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bff6ac-6a31-41d9-83e0-28a49840e9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:16.748795 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bff6ac-6a31-41d9-83e0-28a49840e9e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:16.749079 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bff6ac-6a31-41d9-83e0-28a49840e9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:16.749511 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bff6ac-6a31-41d9-83e0-28a49840e9e6 admin admin] PATH_INFO: `/v3/projects/501dc706a3fc4bb1b96ef29b5571634a` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:16.750694 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bff6ac-6a31-41d9-83e0-28a49840e9e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=501dc706a3fc4bb1b96ef29b5571634a)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:16.752595 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bff6ac-6a31-41d9-83e0-28a49840e9e6 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:16.903081 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-75bff6ac-6a31-41d9-83e0-28a49840e9e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '501dc706a3fc4bb1b96ef29b5571634a', 'request_id': 'req-75bff6ac-6a31-41d9-83e0-28a49840e9e6'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:17.017916 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-75bff6ac-6a31-41d9-83e0-28a49840e9e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '501dc706a3fc4bb1b96ef29b5571634a', 'request_id': 'req-75bff6ac-6a31-41d9-83e0-28a49840e9e6'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:17.032360 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-75bff6ac-6a31-41d9-83e0-28a49840e9e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '501dc706a3fc4bb1b96ef29b5571634a', 'request_id': 'req-75bff6ac-6a31-41d9-83e0-28a49840e9e6'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:17.048618 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-75bff6ac-6a31-41d9-83e0-28a49840e9e6 admin admin] The token cache is being invalidate because project 501dc706a3fc4bb1b96ef29b5571634a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 20:00:17.048912 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-75bff6ac-6a31-41d9-83e0-28a49840e9e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:17.049615 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-75bff6ac-6a31-41d9-83e0-28a49840e9e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:17.051306 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1143/2287] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 20:00:16 2022] DELETE /identity/v3/projects/501dc706a3fc4bb1b96ef29b5571634a => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:00:17.056216 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9dee8-8fa1-4811-9844-202b28705aa2 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:17.057271 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9dee8-8fa1-4811-9844-202b28705aa2 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:17.057271 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9dee8-8fa1-4811-9844-202b28705aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:17.091893 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-4cd9dee8-8fa1-4811-9844-202b28705aa2 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:00:17.093663 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-4cd9dee8-8fa1-4811-9844-202b28705aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:17.167011 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1145/2288] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:00:17.174910 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680f7c8-e5d4-403b-8207-328610fc3b14 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:17.175323 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680f7c8-e5d4-403b-8207-328610fc3b14 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:17.175703 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680f7c8-e5d4-403b-8207-328610fc3b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:17.219170 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-5680f7c8-e5d4-403b-8207-328610fc3b14 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:00:17.221279 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-5680f7c8-e5d4-403b-8207-328610fc3b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:17.245367 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1144/2289] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:00:17.255396 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9dee8-8fa1-4811-9844-202b28705aa2 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:17.271228 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9dee8-8fa1-4811-9844-202b28705aa2 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:17.284988 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a6009-13b9-4098-8c4f-a364b050bb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:17.286268 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a6009-13b9-4098-8c4f-a364b050bb88 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:17.288849 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a6009-13b9-4098-8c4f-a364b050bb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:17.289358 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a6009-13b9-4098-8c4f-a364b050bb88 admin admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:17.290234 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5a6009-13b9-4098-8c4f-a364b050bb88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:00:17.291928 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5a6009-13b9-4098-8c4f-a364b050bb88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:17.296022 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5a6009-13b9-4098-8c4f-a364b050bb88 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:17.320340 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:17.332335 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1146/2290] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 20:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:00:17.333039 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680f7c8-e5d4-403b-8207-328610fc3b14 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:17.354167 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680f7c8-e5d4-403b-8207-328610fc3b14 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:17.361616 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a369d1-c9fe-4779-936a-79931b8832f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:17.362597 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a369d1-c9fe-4779-936a-79931b8832f4 admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:17.363036 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a369d1-c9fe-4779-936a-79931b8832f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:17.363511 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a369d1-c9fe-4779-936a-79931b8832f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:17.364702 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a369d1-c9fe-4779-936a-79931b8832f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:17.369000 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a369d1-c9fe-4779-936a-79931b8832f4 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:17.496122 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1145/2291] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 20:00:17 2022] POST /identity/v3/projects => generated 371 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:00:17.497813 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a6009-13b9-4098-8c4f-a364b050bb88 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:17.520658 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a6009-13b9-4098-8c4f-a364b050bb88 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:17.602784 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f87c0-2c6f-4789-beb0-1f4d8736d94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:17.603483 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f87c0-2c6f-4789-beb0-1f4d8736d94d admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:17.603762 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f87c0-2c6f-4789-beb0-1f4d8736d94d admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:17.604034 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f87c0-2c6f-4789-beb0-1f4d8736d94d admin admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:17.604799 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0f87c0-2c6f-4789-beb0-1f4d8736d94d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:17.607216 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0f87c0-2c6f-4789-beb0-1f4d8736d94d admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:17.749911 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1147/2292] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 20:00:17 2022] POST /identity/v3/users => generated 286 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:00:17.756844 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a369d1-c9fe-4779-936a-79931b8832f4 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:17.768303 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a369d1-c9fe-4779-936a-79931b8832f4 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:17.774771 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d838dd-0ec6-4c1d-b259-127e2938af5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:17.782672 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d838dd-0ec6-4c1d-b259-127e2938af5f admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:17.783310 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d838dd-0ec6-4c1d-b259-127e2938af5f admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:17.783743 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d838dd-0ec6-4c1d-b259-127e2938af5f admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:17.784842 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d838dd-0ec6-4c1d-b259-127e2938af5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:17.786618 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d838dd-0ec6-4c1d-b259-127e2938af5f admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:17.810490 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f87c0-2c6f-4789-beb0-1f4d8736d94d admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:17.819048 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1146/2293] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:00:17 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:00:17.826285 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f87c0-2c6f-4789-beb0-1f4d8736d94d admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:17.831894 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b302feaf-698e-4cf6-9ba8-cf3cb8fdf0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:17.832609 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302feaf-698e-4cf6-9ba8-cf3cb8fdf0ad admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:17.833057 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302feaf-698e-4cf6-9ba8-cf3cb8fdf0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:17.833330 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302feaf-698e-4cf6-9ba8-cf3cb8fdf0ad admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:17.834030 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b302feaf-698e-4cf6-9ba8-cf3cb8fdf0ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:17.836123 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b302feaf-698e-4cf6-9ba8-cf3cb8fdf0ad admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:17.848121 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1148/2294] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:00:17 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:00:17.852435 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d838dd-0ec6-4c1d-b259-127e2938af5f admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:17.866126 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d838dd-0ec6-4c1d-b259-127e2938af5f admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:17.872280 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b613298-ff6a-450a-bf84-ec2211056632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:17.873021 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b613298-ff6a-450a-bf84-ec2211056632 admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:17.873383 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b613298-ff6a-450a-bf84-ec2211056632 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:17.873735 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b613298-ff6a-450a-bf84-ec2211056632 admin admin] PATH_INFO: `/v3/projects/8e81b28731444eb68a08d9daa2a5f872/users/c602b5f992104b1fa1daae6dfa9a1531/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:17.891245 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b613298-ff6a-450a-bf84-ec2211056632 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e81b28731444eb68a08d9daa2a5f872, user_id=c602b5f992104b1fa1daae6dfa9a1531, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:17.894387 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b613298-ff6a-450a-bf84-ec2211056632 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:18.008024 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1147/2295] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 20:00:17 2022] PUT /identity/v3/projects/8e81b28731444eb68a08d9daa2a5f872/users/c602b5f992104b1fa1daae6dfa9a1531/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:00:18.019159 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ec307-f8c4-40df-a46b-1795795deb73 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:18.019689 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ec307-f8c4-40df-a46b-1795795deb73 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:18.020118 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ec307-f8c4-40df-a46b-1795795deb73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:18.082638 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-305ec307-f8c4-40df-a46b-1795795deb73 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:00:18.084899 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-305ec307-f8c4-40df-a46b-1795795deb73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:18.163549 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1149/2296] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:00:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:00:18.175764 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b613298-ff6a-450a-bf84-ec2211056632 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:18.181675 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-8b613298-ff6a-450a-bf84-ec2211056632 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:18.268106 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b613298-ff6a-450a-bf84-ec2211056632 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:18.276533 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2dbaa9-4e65-4760-ae4a-c6be785579b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:18.277187 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2dbaa9-4e65-4760-ae4a-c6be785579b4 service neutron] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:18.277465 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2dbaa9-4e65-4760-ae4a-c6be785579b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:18.277881 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2dbaa9-4e65-4760-ae4a-c6be785579b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:18.295776 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2dbaa9-4e65-4760-ae4a-c6be785579b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:18.297458 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2dbaa9-4e65-4760-ae4a-c6be785579b4 service neutron] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:18.308654 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1148/2297] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:00:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:00:18.451442 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:20.010933 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:20.098652 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:20.710790 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb48b90-73e8-4063-82c6-de723f8e1359 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:20.711070 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb48b90-73e8-4063-82c6-de723f8e1359 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:20.711539 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb48b90-73e8-4063-82c6-de723f8e1359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:20.799680 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-2bb48b90-73e8-4063-82c6-de723f8e1359 None None] MFA Rules not processed for user `c602b5f992104b1fa1daae6dfa9a1531`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:00:20.801397 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-2bb48b90-73e8-4063-82c6-de723f8e1359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:20.918426 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:20.948628 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1150/2298] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:00:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:00:20.959028 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2dbaa9-4e65-4760-ae4a-c6be785579b4 service neutron] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:20.960633 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-ec2dbaa9-4e65-4760-ae4a-c6be785579b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:21.044459 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2dbaa9-4e65-4760-ae4a-c6be785579b4 service neutron] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:21.049642 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c2317e-6392-4a04-b193-69bfe13bb41d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:21.050271 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2317e-6392-4a04-b193-69bfe13bb41d service cinder] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:21.050554 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2317e-6392-4a04-b193-69bfe13bb41d service cinder] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:21.050863 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2317e-6392-4a04-b193-69bfe13bb41d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:21.061357 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c2317e-6392-4a04-b193-69bfe13bb41d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:21.067607 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c2317e-6392-4a04-b193-69bfe13bb41d service cinder] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:21.073745 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1149/2299] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:00:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:00:22.411384 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:22.710086 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:22.908449 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:24.170046 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30841cf-cacf-4bbe-bd0f-7e4e367ff6b8 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:24.171257 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30841cf-cacf-4bbe-bd0f-7e4e367ff6b8 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:24.171558 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30841cf-cacf-4bbe-bd0f-7e4e367ff6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:24.195429 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-d30841cf-cacf-4bbe-bd0f-7e4e367ff6b8 None None] MFA Rules not processed for user `c602b5f992104b1fa1daae6dfa9a1531`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:00:24.196750 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-d30841cf-cacf-4bbe-bd0f-7e4e367ff6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:24.210679 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1151/2300] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:00:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:00:24.851853 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:25.352725 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:25.699243 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c2317e-6392-4a04-b193-69bfe13bb41d service cinder] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:25.704159 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-c0c2317e-6392-4a04-b193-69bfe13bb41d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:25.720245 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c2317e-6392-4a04-b193-69bfe13bb41d service cinder] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:25.726538 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113e0832-fb61-4ee2-9550-0bf448413157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:25.727048 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e0832-fb61-4ee2-9550-0bf448413157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:25.727327 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e0832-fb61-4ee2-9550-0bf448413157 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:25.727790 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e0832-fb61-4ee2-9550-0bf448413157 admin admin] PATH_INFO: `/v3/users/e629b23c3b9042d4a2d41628ba1d22a0` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:25.734353 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113e0832-fb61-4ee2-9550-0bf448413157 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e629b23c3b9042d4a2d41628ba1d22a0)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:25.736314 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113e0832-fb61-4ee2-9550-0bf448413157 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:25.857440 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:25.918248 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-113e0832-fb61-4ee2-9550-0bf448413157 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e629b23c3b9042d4a2d41628ba1d22a0'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:26.024469 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-113e0832-fb61-4ee2-9550-0bf448413157 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e629b23c3b9042d4a2d41628ba1d22a0'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:26.025781 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c23647-9c61-4a7b-96cf-e3d59b6e4a0d None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:26.026144 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c23647-9c61-4a7b-96cf-e3d59b6e4a0d None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:26.026334 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c23647-9c61-4a7b-96cf-e3d59b6e4a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:26.027657 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-113e0832-fb61-4ee2-9550-0bf448413157 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e629b23c3b9042d4a2d41628ba1d22a0'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:26.051713 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-46c23647-9c61-4a7b-96cf-e3d59b6e4a0d None None] MFA Rules not processed for user `3843949a2f6d41a295f56d5697733d5f`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:00:26.053881 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-46c23647-9c61-4a7b-96cf-e3d59b6e4a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:26.054019 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-113e0832-fb61-4ee2-9550-0bf448413157 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e629b23c3b9042d4a2d41628ba1d22a0'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:26.054784 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-113e0832-fb61-4ee2-9550-0bf448413157 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e629b23c3b9042d4a2d41628ba1d22a0'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:26.072046 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1150/2301] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 20:00:25 2022] DELETE /identity/v3/users/e629b23c3b9042d4a2d41628ba1d22a0 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:00:26.073583 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5a034-aa78-4ae9-9f49-d3c7b0180596 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:26.073884 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5a034-aa78-4ae9-9f49-d3c7b0180596 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:26.075170 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5a034-aa78-4ae9-9f49-d3c7b0180596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:26.098441 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-1ed5a034-aa78-4ae9-9f49-d3c7b0180596 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:00:26.099782 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-1ed5a034-aa78-4ae9-9f49-d3c7b0180596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:26.126340 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1152/2302] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:00:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 20:00:26.169245 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1151/2303] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:00:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:00:26.178755 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c23647-9c61-4a7b-96cf-e3d59b6e4a0d None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:26.180258 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-46c23647-9c61-4a7b-96cf-e3d59b6e4a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:26.192755 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c23647-9c61-4a7b-96cf-e3d59b6e4a0d None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:26.248550 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee63a9-ce0f-4e92-ab5b-17efd154b871 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:26.249591 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee63a9-ce0f-4e92-ab5b-17efd154b871 service neutron] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:26.249921 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee63a9-ce0f-4e92-ab5b-17efd154b871 service neutron] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:26.250330 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee63a9-ce0f-4e92-ab5b-17efd154b871 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:26.266902 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ee63a9-ce0f-4e92-ab5b-17efd154b871 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:26.269092 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ee63a9-ce0f-4e92-ab5b-17efd154b871 service neutron] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:26.285780 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1153/2304] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:00:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 20:00:26.565689 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:26.898596 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5a034-aa78-4ae9-9f49-d3c7b0180596 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:26.902725 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-1ed5a034-aa78-4ae9-9f49-d3c7b0180596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:26.923398 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5a034-aa78-4ae9-9f49-d3c7b0180596 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:26.931779 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d955c-87e6-461b-9e9f-bf5a84be23c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:26.934138 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d955c-87e6-461b-9e9f-bf5a84be23c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:26.934138 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d955c-87e6-461b-9e9f-bf5a84be23c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:26.934138 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d955c-87e6-461b-9e9f-bf5a84be23c3 admin admin] PATH_INFO: `/v3/projects/4483388728fa4ecf9dedc846e4c19200` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:26.936474 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526d955c-87e6-461b-9e9f-bf5a84be23c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4483388728fa4ecf9dedc846e4c19200)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:26.938767 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526d955c-87e6-461b-9e9f-bf5a84be23c3 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:27.099925 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-526d955c-87e6-461b-9e9f-bf5a84be23c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4483388728fa4ecf9dedc846e4c19200', 'request_id': 'req-526d955c-87e6-461b-9e9f-bf5a84be23c3'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:27.232257 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-526d955c-87e6-461b-9e9f-bf5a84be23c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4483388728fa4ecf9dedc846e4c19200', 'request_id': 'req-526d955c-87e6-461b-9e9f-bf5a84be23c3'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:27.240404 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-526d955c-87e6-461b-9e9f-bf5a84be23c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4483388728fa4ecf9dedc846e4c19200', 'request_id': 'req-526d955c-87e6-461b-9e9f-bf5a84be23c3'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:27.254319 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-526d955c-87e6-461b-9e9f-bf5a84be23c3 admin admin] The token cache is being invalidate because project 4483388728fa4ecf9dedc846e4c19200 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 20:00:27.254565 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-526d955c-87e6-461b-9e9f-bf5a84be23c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:27.255215 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-526d955c-87e6-461b-9e9f-bf5a84be23c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:27.256709 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1152/2305] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 20:00:26 2022] DELETE /identity/v3/projects/4483388728fa4ecf9dedc846e4c19200 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:00:27.261678 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee63a9-ce0f-4e92-ab5b-17efd154b871 service neutron] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:27.263028 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:27.271356 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee63a9-ce0f-4e92-ab5b-17efd154b871 service neutron] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:27.341947 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a4d89e-a212-4897-9eea-ca6083bf1968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:27.345670 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4d89e-a212-4897-9eea-ca6083bf1968 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:27.345670 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4d89e-a212-4897-9eea-ca6083bf1968 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:27.345670 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4d89e-a212-4897-9eea-ca6083bf1968 admin admin] PATH_INFO: `/v3/users/87d696cca6b94c46a848982ecb0332ac` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:27.345670 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a4d89e-a212-4897-9eea-ca6083bf1968 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87d696cca6b94c46a848982ecb0332ac)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:27.348128 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a4d89e-a212-4897-9eea-ca6083bf1968 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:27.614976 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-66a4d89e-a212-4897-9eea-ca6083bf1968 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87d696cca6b94c46a848982ecb0332ac'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:27.668809 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-66a4d89e-a212-4897-9eea-ca6083bf1968 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87d696cca6b94c46a848982ecb0332ac'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:27.669718 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-66a4d89e-a212-4897-9eea-ca6083bf1968 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87d696cca6b94c46a848982ecb0332ac'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:27.670394 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-66a4d89e-a212-4897-9eea-ca6083bf1968 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87d696cca6b94c46a848982ecb0332ac'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:27.689851 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-66a4d89e-a212-4897-9eea-ca6083bf1968 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87d696cca6b94c46a848982ecb0332ac'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:27.704337 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1154/2306] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 20:00:27 2022] DELETE /identity/v3/users/87d696cca6b94c46a848982ecb0332ac => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:00:27.906866 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:28.180744 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d955c-87e6-461b-9e9f-bf5a84be23c3 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:28.182574 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-526d955c-87e6-461b-9e9f-bf5a84be23c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:28.202829 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d955c-87e6-461b-9e9f-bf5a84be23c3 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:28.276486 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74995bf-7c14-4076-a4d1-d2e967b80850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:28.277126 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74995bf-7c14-4076-a4d1-d2e967b80850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:28.277439 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74995bf-7c14-4076-a4d1-d2e967b80850 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:28.277757 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74995bf-7c14-4076-a4d1-d2e967b80850 admin admin] PATH_INFO: `/v3/projects/3c5140d59c7a403083d039023c0a4bdc` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:28.278926 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74995bf-7c14-4076-a4d1-d2e967b80850 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c5140d59c7a403083d039023c0a4bdc)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:28.280937 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74995bf-7c14-4076-a4d1-d2e967b80850 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:28.450871 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-a74995bf-7c14-4076-a4d1-d2e967b80850 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c5140d59c7a403083d039023c0a4bdc', 'request_id': 'req-a74995bf-7c14-4076-a4d1-d2e967b80850'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:28.563429 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-a74995bf-7c14-4076-a4d1-d2e967b80850 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c5140d59c7a403083d039023c0a4bdc', 'request_id': 'req-a74995bf-7c14-4076-a4d1-d2e967b80850'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:28.569642 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-a74995bf-7c14-4076-a4d1-d2e967b80850 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c5140d59c7a403083d039023c0a4bdc', 'request_id': 'req-a74995bf-7c14-4076-a4d1-d2e967b80850'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:28.582580 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-a74995bf-7c14-4076-a4d1-d2e967b80850 admin admin] The token cache is being invalidate because project 3c5140d59c7a403083d039023c0a4bdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 20:00:28.582862 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-a74995bf-7c14-4076-a4d1-d2e967b80850 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:28.583506 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-a74995bf-7c14-4076-a4d1-d2e967b80850 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:28.585017 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1153/2307] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 20:00:28 2022] DELETE /identity/v3/projects/3c5140d59c7a403083d039023c0a4bdc => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:00:28.591105 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d3479-c072-4f8a-8dd6-784b93b80938 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:28.591392 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d3479-c072-4f8a-8dd6-784b93b80938 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:28.591693 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d3479-c072-4f8a-8dd6-784b93b80938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:28.612969 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-576d3479-c072-4f8a-8dd6-784b93b80938 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:00:28.614317 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-576d3479-c072-4f8a-8dd6-784b93b80938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:28.693882 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1155/2308] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:00:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:00:28.698369 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480db71-1491-4c8d-b1bf-6d10cf5852a1 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:28.698673 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480db71-1491-4c8d-b1bf-6d10cf5852a1 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:28.698979 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480db71-1491-4c8d-b1bf-6d10cf5852a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:28.713762 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:28.738881 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-4480db71-1491-4c8d-b1bf-6d10cf5852a1 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:00:28.740795 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-4480db71-1491-4c8d-b1bf-6d10cf5852a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:28.750090 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1154/2309] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:00:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:00:28.754741 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d3479-c072-4f8a-8dd6-784b93b80938 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:28.766654 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d3479-c072-4f8a-8dd6-784b93b80938 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:28.778645 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc9f78-00a3-4a97-a8a0-bcdf8fbc8125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:28.779276 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc9f78-00a3-4a97-a8a0-bcdf8fbc8125 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:28.779554 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc9f78-00a3-4a97-a8a0-bcdf8fbc8125 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:28.779825 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc9f78-00a3-4a97-a8a0-bcdf8fbc8125 admin admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:28.780481 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fc9f78-00a3-4a97-a8a0-bcdf8fbc8125 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:00:28.780783 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fc9f78-00a3-4a97-a8a0-bcdf8fbc8125 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:28.782448 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fc9f78-00a3-4a97-a8a0-bcdf8fbc8125 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:28.794636 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1156/2310] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 20:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:00:28.799162 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480db71-1491-4c8d-b1bf-6d10cf5852a1 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:28.809709 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480db71-1491-4c8d-b1bf-6d10cf5852a1 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:28.815431 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272967de-d79e-4517-a9a8-dfa644a38186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:28.820275 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272967de-d79e-4517-a9a8-dfa644a38186 admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:28.820275 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272967de-d79e-4517-a9a8-dfa644a38186 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:28.820275 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272967de-d79e-4517-a9a8-dfa644a38186 admin admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:28.820275 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272967de-d79e-4517-a9a8-dfa644a38186 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:28.820275 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272967de-d79e-4517-a9a8-dfa644a38186 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:28.926762 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1155/2311] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 20:00:28 2022] POST /identity/v3/projects => generated 367 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:00:28.931843 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc9f78-00a3-4a97-a8a0-bcdf8fbc8125 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:28.942035 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc9f78-00a3-4a97-a8a0-bcdf8fbc8125 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:29.010809 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b0f72e-2caf-4f26-a340-46e99aa3272f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:29.011368 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0f72e-2caf-4f26-a340-46e99aa3272f admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:29.012285 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0f72e-2caf-4f26-a340-46e99aa3272f admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:29.012799 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0f72e-2caf-4f26-a340-46e99aa3272f admin admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:29.013636 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b0f72e-2caf-4f26-a340-46e99aa3272f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:29.016759 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b0f72e-2caf-4f26-a340-46e99aa3272f admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:29.130243 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1157/2312] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 20:00:28 2022] POST /identity/v3/users => generated 284 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:00:29.131315 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272967de-d79e-4517-a9a8-dfa644a38186 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:29.142551 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272967de-d79e-4517-a9a8-dfa644a38186 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:29.148182 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a48ee-f7c5-4c9a-a967-1fe0fa5c1c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:29.157049 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a48ee-f7c5-4c9a-a967-1fe0fa5c1c98 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:29.157049 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a48ee-f7c5-4c9a-a967-1fe0fa5c1c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:29.157049 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a48ee-f7c5-4c9a-a967-1fe0fa5c1c98 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:29.157049 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a48ee-f7c5-4c9a-a967-1fe0fa5c1c98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:29.157049 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a48ee-f7c5-4c9a-a967-1fe0fa5c1c98 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:29.166341 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1156/2313] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:00:29.167847 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b0f72e-2caf-4f26-a340-46e99aa3272f admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:29.183968 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b0f72e-2caf-4f26-a340-46e99aa3272f admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:29.188972 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a9e1f-529f-4cae-8096-2984e80dbdc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:29.190050 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a9e1f-529f-4cae-8096-2984e80dbdc6 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:29.190050 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a9e1f-529f-4cae-8096-2984e80dbdc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:29.190273 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a9e1f-529f-4cae-8096-2984e80dbdc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:29.190816 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583a9e1f-529f-4cae-8096-2984e80dbdc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:29.192424 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583a9e1f-529f-4cae-8096-2984e80dbdc6 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:29.204685 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1158/2314] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 20:00:29.209302 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a48ee-f7c5-4c9a-a967-1fe0fa5c1c98 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:29.221816 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a48ee-f7c5-4c9a-a967-1fe0fa5c1c98 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:29.226941 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5ea9bb-1e8c-4029-b6d4-dca2f8c7d9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:29.227628 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ea9bb-1e8c-4029-b6d4-dca2f8c7d9c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:29.228109 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ea9bb-1e8c-4029-b6d4-dca2f8c7d9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:29.230739 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ea9bb-1e8c-4029-b6d4-dca2f8c7d9c7 admin admin] PATH_INFO: `/v3/projects/e252279ebc4b40258beebac21197227c/users/80766723b97b4c249db671d5a6bb6cf1/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:29.250413 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5ea9bb-1e8c-4029-b6d4-dca2f8c7d9c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e252279ebc4b40258beebac21197227c, user_id=80766723b97b4c249db671d5a6bb6cf1, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:29.259082 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5ea9bb-1e8c-4029-b6d4-dca2f8c7d9c7 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:29.363155 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1157/2315] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 20:00:29 2022] PUT /identity/v3/projects/e252279ebc4b40258beebac21197227c/users/80766723b97b4c249db671d5a6bb6cf1/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:00:29.374798 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d6285-2173-4a79-8815-db8c1fd41456 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:29.375412 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d6285-2173-4a79-8815-db8c1fd41456 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:29.375841 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d6285-2173-4a79-8815-db8c1fd41456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:29.406486 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-d22d6285-2173-4a79-8815-db8c1fd41456 None None] MFA Rules not processed for user `80766723b97b4c249db671d5a6bb6cf1`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:00:29.407707 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-d22d6285-2173-4a79-8815-db8c1fd41456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:29.487682 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1159/2316] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:00:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:00:29.491671 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5ea9bb-1e8c-4029-b6d4-dca2f8c7d9c7 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:29.592671 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:29.597298 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5ea9bb-1e8c-4029-b6d4-dca2f8c7d9c7 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:29.606604 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a100f5-5364-49e9-8c9c-510c61de9795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:29.607658 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a100f5-5364-49e9-8c9c-510c61de9795 admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:29.607882 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a100f5-5364-49e9-8c9c-510c61de9795 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:29.608234 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a100f5-5364-49e9-8c9c-510c61de9795 admin admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:29.608877 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a100f5-5364-49e9-8c9c-510c61de9795 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:29.610857 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a100f5-5364-49e9-8c9c-510c61de9795 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:29.644245 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:29.708836 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1158/2317] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 20:00:29 2022] POST /identity/v3/projects => generated 367 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:00:29.713125 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d6285-2173-4a79-8815-db8c1fd41456 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:29.723777 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d6285-2173-4a79-8815-db8c1fd41456 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:29.818317 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf143d-d269-4497-8781-fc24d6e42332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:29.818941 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf143d-d269-4497-8781-fc24d6e42332 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:29.819221 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf143d-d269-4497-8781-fc24d6e42332 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:29.819496 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf143d-d269-4497-8781-fc24d6e42332 admin admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:29.820123 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bf143d-d269-4497-8781-fc24d6e42332 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:29.822731 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bf143d-d269-4497-8781-fc24d6e42332 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:29.931907 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1160/2318] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 20:00:29 2022] POST /identity/v3/users => generated 290 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:00:29.935911 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a100f5-5364-49e9-8c9c-510c61de9795 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:29.946204 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a100f5-5364-49e9-8c9c-510c61de9795 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:29.951815 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336ddba-8d74-431c-a28f-14bcf0c594e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:29.955119 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336ddba-8d74-431c-a28f-14bcf0c594e2 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:29.955119 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336ddba-8d74-431c-a28f-14bcf0c594e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:29.955119 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336ddba-8d74-431c-a28f-14bcf0c594e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:29.955119 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2336ddba-8d74-431c-a28f-14bcf0c594e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:29.955984 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2336ddba-8d74-431c-a28f-14bcf0c594e2 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:29.967483 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1159/2319] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:00:29.971744 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf143d-d269-4497-8781-fc24d6e42332 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:29.982172 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf143d-d269-4497-8781-fc24d6e42332 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:29.988403 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e1ebf6-c168-4391-9a10-36035bf81331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:29.989601 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e1ebf6-c168-4391-9a10-36035bf81331 admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:29.989601 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e1ebf6-c168-4391-9a10-36035bf81331 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:29.989797 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e1ebf6-c168-4391-9a10-36035bf81331 admin admin] PATH_INFO: `/v3/projects/bc866d3f129444b38c72c5fe82cceffa/users/77608e5d608b4bda808ceaaab3dc2054/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:30.007199 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e1ebf6-c168-4391-9a10-36035bf81331 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc866d3f129444b38c72c5fe82cceffa, user_id=77608e5d608b4bda808ceaaab3dc2054, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:30.010608 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e1ebf6-c168-4391-9a10-36035bf81331 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:30.120616 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1161/2320] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 20:00:29 2022] PUT /identity/v3/projects/bc866d3f129444b38c72c5fe82cceffa/users/77608e5d608b4bda808ceaaab3dc2054/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:00:30.124690 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336ddba-8d74-431c-a28f-14bcf0c594e2 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:30.135914 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336ddba-8d74-431c-a28f-14bcf0c594e2 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:30.208272 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe90b9-d316-4bc4-a651-76b3a605f4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:30.208894 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe90b9-d316-4bc4-a651-76b3a605f4c8 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:30.209252 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe90b9-d316-4bc4-a651-76b3a605f4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:30.209436 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe90b9-d316-4bc4-a651-76b3a605f4c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:30.210110 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fe90b9-d316-4bc4-a651-76b3a605f4c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:30.211776 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fe90b9-d316-4bc4-a651-76b3a605f4c8 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:30.222508 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1160/2321] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:00:30.226753 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e1ebf6-c168-4391-9a10-36035bf81331 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:30.237838 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e1ebf6-c168-4391-9a10-36035bf81331 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:30.243037 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b34ea-9731-42d8-9116-d702571335ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:30.244593 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b34ea-9731-42d8-9116-d702571335ec admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:30.245033 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b34ea-9731-42d8-9116-d702571335ec admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:30.245313 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b34ea-9731-42d8-9116-d702571335ec admin admin] PATH_INFO: `/v3/projects/bc866d3f129444b38c72c5fe82cceffa/users/77608e5d608b4bda808ceaaab3dc2054/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:30.247671 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807b34ea-9731-42d8-9116-d702571335ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc866d3f129444b38c72c5fe82cceffa, user_id=77608e5d608b4bda808ceaaab3dc2054, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:30.253296 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807b34ea-9731-42d8-9116-d702571335ec admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:30.265235 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1162/2322] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 20:00:30 2022] PUT /identity/v3/projects/bc866d3f129444b38c72c5fe82cceffa/users/77608e5d608b4bda808ceaaab3dc2054/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:00:30.275862 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5d7a3-eae1-4a4f-82f5-ff463fcae257 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:30.276158 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5d7a3-eae1-4a4f-82f5-ff463fcae257 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:30.276433 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5d7a3-eae1-4a4f-82f5-ff463fcae257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:30.305907 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-1cb5d7a3-eae1-4a4f-82f5-ff463fcae257 None None] MFA Rules not processed for user `77608e5d608b4bda808ceaaab3dc2054`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:00:30.308009 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-1cb5d7a3-eae1-4a4f-82f5-ff463fcae257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:30.434298 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1161/2323] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:00:30 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:00:30.440474 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:30.450137 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b34ea-9731-42d8-9116-d702571335ec admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:30.453520 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-807b34ea-9731-42d8-9116-d702571335ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:30.554231 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b34ea-9731-42d8-9116-d702571335ec admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:30.558076 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b69070-3147-4a60-8f54-9c5192cc0f5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:30.558688 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b69070-3147-4a60-8f54-9c5192cc0f5f service cinder] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:30.558966 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b69070-3147-4a60-8f54-9c5192cc0f5f service cinder] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:30.559236 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b69070-3147-4a60-8f54-9c5192cc0f5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:30.569563 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b69070-3147-4a60-8f54-9c5192cc0f5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:30.572428 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b69070-3147-4a60-8f54-9c5192cc0f5f service cinder] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:30.582549 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1163/2324] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:00:30 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:00:30.589365 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:30.699930 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5d7a3-eae1-4a4f-82f5-ff463fcae257 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:30.701391 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-1cb5d7a3-eae1-4a4f-82f5-ff463fcae257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:30.714162 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5d7a3-eae1-4a4f-82f5-ff463fcae257 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:30.719978 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b5107-60ee-443c-aa8c-7881bf3553ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:30.720624 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b5107-60ee-443c-aa8c-7881bf3553ab service cinder] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:30.720909 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b5107-60ee-443c-aa8c-7881bf3553ab service cinder] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:30.721718 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b5107-60ee-443c-aa8c-7881bf3553ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:30.796959 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b5107-60ee-443c-aa8c-7881bf3553ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:30.798771 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b5107-60ee-443c-aa8c-7881bf3553ab service cinder] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:30.814652 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1162/2325] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:00:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:00:31.035530 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:31.161528 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:DELETE=1,keystone:SELECT=93,keystone:INSERT=6 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:31.892705 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:32.010668 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552e245-8708-4142-a7f1-dd3aa18137bc None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:32.011040 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552e245-8708-4142-a7f1-dd3aa18137bc None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:32.011453 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552e245-8708-4142-a7f1-dd3aa18137bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:32.036339 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-4552e245-8708-4142-a7f1-dd3aa18137bc None None] MFA Rules not processed for user `fd597f74abdf49288ea0d92642c6a5a2`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:00:32.037611 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-4552e245-8708-4142-a7f1-dd3aa18137bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:32.101410 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1164/2326] 10.222.0.60 () {58 vars in 1009 bytes} [Sat Sep 24 20:00:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:00:32.115123 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b5107-60ee-443c-aa8c-7881bf3553ab service cinder] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:32.116699 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-435b5107-60ee-443c-aa8c-7881bf3553ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:32.196080 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b5107-60ee-443c-aa8c-7881bf3553ab service cinder] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:32.202237 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349eb343-1a6c-4799-b17f-a5be28a3d014 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd94cd16acc45e6ac2997204297fb75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:32.207964 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349eb343-1a6c-4799-b17f-a5be28a3d014 service swift] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:32.207964 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349eb343-1a6c-4799-b17f-a5be28a3d014 service swift] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:32.207964 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349eb343-1a6c-4799-b17f-a5be28a3d014 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:32.221728 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349eb343-1a6c-4799-b17f-a5be28a3d014 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:32.223335 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349eb343-1a6c-4799-b17f-a5be28a3d014 service swift] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:32.232853 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1163/2327] 10.222.0.60 () {60 vars in 1384 bytes} [Sat Sep 24 20:00:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 24 20:00:32.400795 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:32.497180 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:32.941160 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:33.126400 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:33.506626 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:33.548193 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:33.712520 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:33.769989 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:33.817350 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:33.862487 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:34.038170 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:34.108849 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:34.405903 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:34.668380 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:34.920367 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:35.280752 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:35.486083 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:35.615403 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:35.834018 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:35.919709 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:36.176984 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4552e245-8708-4142-a7f1-dd3aa18137bc None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:36.249221 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4552e245-8708-4142-a7f1-dd3aa18137bc None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:36.254417 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101196a4-f17d-4157-9b19-330723420968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:36.255051 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101196a4-f17d-4157-9b19-330723420968 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:36.255334 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101196a4-f17d-4157-9b19-330723420968 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:36.258740 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101196a4-f17d-4157-9b19-330723420968 admin admin] PATH_INFO: `/v3/users/80766723b97b4c249db671d5a6bb6cf1` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:36.258740 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101196a4-f17d-4157-9b19-330723420968 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80766723b97b4c249db671d5a6bb6cf1)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:36.258932 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101196a4-f17d-4157-9b19-330723420968 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:36.312516 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:36.421862 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:36.441716 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-101196a4-f17d-4157-9b19-330723420968 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80766723b97b4c249db671d5a6bb6cf1'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:36.609733 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-101196a4-f17d-4157-9b19-330723420968 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80766723b97b4c249db671d5a6bb6cf1'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:36.610269 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-101196a4-f17d-4157-9b19-330723420968 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80766723b97b4c249db671d5a6bb6cf1'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:36.610865 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-101196a4-f17d-4157-9b19-330723420968 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80766723b97b4c249db671d5a6bb6cf1'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:36.626825 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-101196a4-f17d-4157-9b19-330723420968 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80766723b97b4c249db671d5a6bb6cf1'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:36.643175 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1165/2328] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 20:00:36 2022] DELETE /identity/v3/users/80766723b97b4c249db671d5a6bb6cf1 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:00:36.664090 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58625db0-1b60-48aa-9aa1-a596ab286481 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:36.664090 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58625db0-1b60-48aa-9aa1-a596ab286481 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:36.664090 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58625db0-1b60-48aa-9aa1-a596ab286481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:36.669067 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-58625db0-1b60-48aa-9aa1-a596ab286481 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:00:36.670517 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-58625db0-1b60-48aa-9aa1-a596ab286481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:36.734665 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1164/2329] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:00:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:00:36.745815 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101196a4-f17d-4157-9b19-330723420968 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:36.747412 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-101196a4-f17d-4157-9b19-330723420968 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:36.809171 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101196a4-f17d-4157-9b19-330723420968 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:36.813072 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e446d3-a9e8-4d96-bc34-f339dfccf1e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:36.813727 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e446d3-a9e8-4d96-bc34-f339dfccf1e6 service neutron] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:36.814050 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e446d3-a9e8-4d96-bc34-f339dfccf1e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:36.814369 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e446d3-a9e8-4d96-bc34-f339dfccf1e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:36.826894 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e446d3-a9e8-4d96-bc34-f339dfccf1e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:36.828691 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e446d3-a9e8-4d96-bc34-f339dfccf1e6 service neutron] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:36.840670 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1166/2330] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:00:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:00:37.165688 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:37.348476 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58625db0-1b60-48aa-9aa1-a596ab286481 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:37.351933 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-58625db0-1b60-48aa-9aa1-a596ab286481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:37.364360 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58625db0-1b60-48aa-9aa1-a596ab286481 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:37.369052 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6d785-f09c-432d-ba09-e3b31f0d54e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:37.369806 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6d785-f09c-432d-ba09-e3b31f0d54e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:37.370191 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6d785-f09c-432d-ba09-e3b31f0d54e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:37.370408 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6d785-f09c-432d-ba09-e3b31f0d54e0 admin admin] PATH_INFO: `/v3/projects/e252279ebc4b40258beebac21197227c` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:37.371546 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef6d785-f09c-432d-ba09-e3b31f0d54e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e252279ebc4b40258beebac21197227c)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:37.373435 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef6d785-f09c-432d-ba09-e3b31f0d54e0 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:37.474739 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-aef6d785-f09c-432d-ba09-e3b31f0d54e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e252279ebc4b40258beebac21197227c', 'request_id': 'req-aef6d785-f09c-432d-ba09-e3b31f0d54e0'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:37.565809 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-aef6d785-f09c-432d-ba09-e3b31f0d54e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e252279ebc4b40258beebac21197227c', 'request_id': 'req-aef6d785-f09c-432d-ba09-e3b31f0d54e0'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:37.573430 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-aef6d785-f09c-432d-ba09-e3b31f0d54e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e252279ebc4b40258beebac21197227c', 'request_id': 'req-aef6d785-f09c-432d-ba09-e3b31f0d54e0'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:37.586177 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-aef6d785-f09c-432d-ba09-e3b31f0d54e0 admin admin] The token cache is being invalidate because project e252279ebc4b40258beebac21197227c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 20:00:37.586465 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-aef6d785-f09c-432d-ba09-e3b31f0d54e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:37.587157 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-aef6d785-f09c-432d-ba09-e3b31f0d54e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:37.591523 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1165/2331] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 20:00:37 2022] DELETE /identity/v3/projects/e252279ebc4b40258beebac21197227c => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:00:37.600483 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e446d3-a9e8-4d96-bc34-f339dfccf1e6 service neutron] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:37.612792 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e446d3-a9e8-4d96-bc34-f339dfccf1e6 service neutron] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:37.697213 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611e4c4-4e94-4670-a926-b9a5e7536648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:37.698906 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611e4c4-4e94-4670-a926-b9a5e7536648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:37.699458 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611e4c4-4e94-4670-a926-b9a5e7536648 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:37.699890 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611e4c4-4e94-4670-a926-b9a5e7536648 admin admin] PATH_INFO: `/v3/users/77608e5d608b4bda808ceaaab3dc2054` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:37.701362 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611e4c4-4e94-4670-a926-b9a5e7536648 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77608e5d608b4bda808ceaaab3dc2054)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:37.703509 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611e4c4-4e94-4670-a926-b9a5e7536648 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:37.748560 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:37.862645 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-6611e4c4-4e94-4670-a926-b9a5e7536648 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77608e5d608b4bda808ceaaab3dc2054'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:37.953251 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-6611e4c4-4e94-4670-a926-b9a5e7536648 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77608e5d608b4bda808ceaaab3dc2054'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:37.953849 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-6611e4c4-4e94-4670-a926-b9a5e7536648 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77608e5d608b4bda808ceaaab3dc2054'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:37.954455 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-6611e4c4-4e94-4670-a926-b9a5e7536648 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77608e5d608b4bda808ceaaab3dc2054'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:37.967147 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-6611e4c4-4e94-4670-a926-b9a5e7536648 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77608e5d608b4bda808ceaaab3dc2054'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:37.979735 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1167/2332] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 20:00:37 2022] DELETE /identity/v3/users/77608e5d608b4bda808ceaaab3dc2054 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:00:38.543736 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:38.685058 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6d785-f09c-432d-ba09-e3b31f0d54e0 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:38.687125 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-aef6d785-f09c-432d-ba09-e3b31f0d54e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:38.707205 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6d785-f09c-432d-ba09-e3b31f0d54e0 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:38.766833 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d75a2e8-45d6-456d-905a-78a336c8f58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:38.767466 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d75a2e8-45d6-456d-905a-78a336c8f58d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:38.767768 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d75a2e8-45d6-456d-905a-78a336c8f58d admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:38.768050 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d75a2e8-45d6-456d-905a-78a336c8f58d admin admin] PATH_INFO: `/v3/projects/bc866d3f129444b38c72c5fe82cceffa` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:38.769191 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d75a2e8-45d6-456d-905a-78a336c8f58d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc866d3f129444b38c72c5fe82cceffa)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:38.771259 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d75a2e8-45d6-456d-905a-78a336c8f58d admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:38.864047 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:38.872736 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-6d75a2e8-45d6-456d-905a-78a336c8f58d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc866d3f129444b38c72c5fe82cceffa', 'request_id': 'req-6d75a2e8-45d6-456d-905a-78a336c8f58d'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:38.951454 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-6d75a2e8-45d6-456d-905a-78a336c8f58d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc866d3f129444b38c72c5fe82cceffa', 'request_id': 'req-6d75a2e8-45d6-456d-905a-78a336c8f58d'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:38.957743 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-6d75a2e8-45d6-456d-905a-78a336c8f58d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc866d3f129444b38c72c5fe82cceffa', 'request_id': 'req-6d75a2e8-45d6-456d-905a-78a336c8f58d'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:38.969899 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-6d75a2e8-45d6-456d-905a-78a336c8f58d admin admin] The token cache is being invalidate because project bc866d3f129444b38c72c5fe82cceffa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 20:00:38.970186 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-6d75a2e8-45d6-456d-905a-78a336c8f58d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:38.970829 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-6d75a2e8-45d6-456d-905a-78a336c8f58d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:38.972346 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1166/2333] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 20:00:38 2022] DELETE /identity/v3/projects/bc866d3f129444b38c72c5fe82cceffa => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:00:38.977275 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8bcdba-25cf-4d9f-bd1b-b47feb78a440 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:38.977873 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8bcdba-25cf-4d9f-bd1b-b47feb78a440 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:38.977873 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8bcdba-25cf-4d9f-bd1b-b47feb78a440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:38.997212 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-3f8bcdba-25cf-4d9f-bd1b-b47feb78a440 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:00:39.000913 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-3f8bcdba-25cf-4d9f-bd1b-b47feb78a440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:39.075548 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1168/2334] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:00:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:00:39.077525 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078405e3-da09-4e3c-a5ae-11f624eea890 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:39.077846 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078405e3-da09-4e3c-a5ae-11f624eea890 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:39.078235 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078405e3-da09-4e3c-a5ae-11f624eea890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:39.100861 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-078405e3-da09-4e3c-a5ae-11f624eea890 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:00:39.104528 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-078405e3-da09-4e3c-a5ae-11f624eea890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:39.111501 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1167/2335] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:00:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 20:00:39.115830 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8bcdba-25cf-4d9f-bd1b-b47feb78a440 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:39.127966 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8bcdba-25cf-4d9f-bd1b-b47feb78a440 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:39.132906 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c7111b-bc7c-4795-aced-0988f3537a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:39.133551 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c7111b-bc7c-4795-aced-0988f3537a39 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:39.133832 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c7111b-bc7c-4795-aced-0988f3537a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:39.134103 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c7111b-bc7c-4795-aced-0988f3537a39 admin admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:39.134746 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c7111b-bc7c-4795-aced-0988f3537a39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:00:39.135674 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c7111b-bc7c-4795-aced-0988f3537a39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:39.137328 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c7111b-bc7c-4795-aced-0988f3537a39 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:39.149472 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1169/2336] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 20:00:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:00:39.154829 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078405e3-da09-4e3c-a5ae-11f624eea890 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:39.164405 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078405e3-da09-4e3c-a5ae-11f624eea890 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:39.173343 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c2ebf4-faeb-45f7-978a-c3cb578f3899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:39.173343 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c2ebf4-faeb-45f7-978a-c3cb578f3899 admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:39.173343 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c2ebf4-faeb-45f7-978a-c3cb578f3899 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:39.173343 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c2ebf4-faeb-45f7-978a-c3cb578f3899 admin admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:39.173844 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c2ebf4-faeb-45f7-978a-c3cb578f3899 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:39.173844 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c2ebf4-faeb-45f7-978a-c3cb578f3899 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:39.372613 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1168/2337] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 20:00:39 2022] POST /identity/v3/projects => generated 391 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:00:39.377109 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c7111b-bc7c-4795-aced-0988f3537a39 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:39.388031 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c7111b-bc7c-4795-aced-0988f3537a39 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:39.391807 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:39.444569 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0dc99-d886-4cd8-a332-baab23baf21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:39.445171 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0dc99-d886-4cd8-a332-baab23baf21d admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:39.445443 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0dc99-d886-4cd8-a332-baab23baf21d admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:39.445740 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0dc99-d886-4cd8-a332-baab23baf21d admin admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:39.446357 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b0dc99-d886-4cd8-a332-baab23baf21d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:39.448803 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b0dc99-d886-4cd8-a332-baab23baf21d admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:39.536453 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1170/2338] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 20:00:39 2022] POST /identity/v3/users => generated 296 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:00:39.540767 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c2ebf4-faeb-45f7-978a-c3cb578f3899 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:39.551783 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c2ebf4-faeb-45f7-978a-c3cb578f3899 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:39.557070 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999754f-615d-4c9a-b818-34603dfe8c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:39.557731 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999754f-615d-4c9a-b818-34603dfe8c00 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:39.558316 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999754f-615d-4c9a-b818-34603dfe8c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:39.558591 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999754f-615d-4c9a-b818-34603dfe8c00 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:39.559252 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2999754f-615d-4c9a-b818-34603dfe8c00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:39.560972 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2999754f-615d-4c9a-b818-34603dfe8c00 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:39.574484 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1169/2339] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:00:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:00:39.579116 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0dc99-d886-4cd8-a332-baab23baf21d admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:39.591796 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0dc99-d886-4cd8-a332-baab23baf21d admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:39.597103 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c566bb-6cd2-4afd-be76-781317d8d2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:39.597865 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c566bb-6cd2-4afd-be76-781317d8d2fe admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:39.598081 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c566bb-6cd2-4afd-be76-781317d8d2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:39.598325 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c566bb-6cd2-4afd-be76-781317d8d2fe admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:39.598953 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c566bb-6cd2-4afd-be76-781317d8d2fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:39.600759 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c566bb-6cd2-4afd-be76-781317d8d2fe admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:39.613881 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1171/2340] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:00:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:00:39.618089 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999754f-615d-4c9a-b818-34603dfe8c00 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:39.630432 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999754f-615d-4c9a-b818-34603dfe8c00 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:39.637953 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a39f65-4f2b-4888-8ede-740ed0dc10f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:39.639543 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a39f65-4f2b-4888-8ede-740ed0dc10f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:39.640391 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a39f65-4f2b-4888-8ede-740ed0dc10f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:39.641022 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a39f65-4f2b-4888-8ede-740ed0dc10f1 admin admin] PATH_INFO: `/v3/projects/3e0d9e83058b4551b4b570bd06ff4725/users/a2556cc258a543ffbc07c4c0daaf8e70/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:39.667188 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a39f65-4f2b-4888-8ede-740ed0dc10f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e0d9e83058b4551b4b570bd06ff4725, user_id=a2556cc258a543ffbc07c4c0daaf8e70, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:39.670220 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a39f65-4f2b-4888-8ede-740ed0dc10f1 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:39.720104 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1170/2341] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 20:00:39 2022] PUT /identity/v3/projects/3e0d9e83058b4551b4b570bd06ff4725/users/a2556cc258a543ffbc07c4c0daaf8e70/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:00:39.731107 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec660898-a036-4851-9ea9-7c57d6b27ec0 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:39.734453 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec660898-a036-4851-9ea9-7c57d6b27ec0 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:39.734453 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec660898-a036-4851-9ea9-7c57d6b27ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:39.759452 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-ec660898-a036-4851-9ea9-7c57d6b27ec0 None None] MFA Rules not processed for user `a2556cc258a543ffbc07c4c0daaf8e70`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:00:39.761325 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-ec660898-a036-4851-9ea9-7c57d6b27ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:39.824468 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1172/2342] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:00:39 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:00:39.829393 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a39f65-4f2b-4888-8ede-740ed0dc10f1 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:39.896468 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a39f65-4f2b-4888-8ede-740ed0dc10f1 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:39.896468 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d4645-e80a-4409-8eda-c66db2ede9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:39.897022 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d4645-e80a-4409-8eda-c66db2ede9ab admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:39.897298 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d4645-e80a-4409-8eda-c66db2ede9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:39.897600 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d4645-e80a-4409-8eda-c66db2ede9ab admin admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:39.898231 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277d4645-e80a-4409-8eda-c66db2ede9ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:39.900136 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277d4645-e80a-4409-8eda-c66db2ede9ab admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:39.983633 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1171/2343] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 20:00:39 2022] POST /identity/v3/projects => generated 393 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:00:39.987522 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec660898-a036-4851-9ea9-7c57d6b27ec0 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:39.999089 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec660898-a036-4851-9ea9-7c57d6b27ec0 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:40.060320 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de1914-e351-4173-abfd-012547658389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:40.060965 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de1914-e351-4173-abfd-012547658389 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:40.061244 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de1914-e351-4173-abfd-012547658389 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:40.061564 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de1914-e351-4173-abfd-012547658389 admin admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:40.062256 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41de1914-e351-4173-abfd-012547658389 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:40.068154 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41de1914-e351-4173-abfd-012547658389 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:40.133574 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1173/2344] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 20:00:39 2022] POST /identity/v3/users => generated 303 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:00:40.137512 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d4645-e80a-4409-8eda-c66db2ede9ab admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:40.161833 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d4645-e80a-4409-8eda-c66db2ede9ab admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:40.167269 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82de78e-4b46-4705-938c-7851b30a3330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:40.167881 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82de78e-4b46-4705-938c-7851b30a3330 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:40.168182 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82de78e-4b46-4705-938c-7851b30a3330 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:40.168457 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82de78e-4b46-4705-938c-7851b30a3330 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:40.169107 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82de78e-4b46-4705-938c-7851b30a3330 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:40.170979 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82de78e-4b46-4705-938c-7851b30a3330 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:40.184208 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1172/2345] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:00:40 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:00:40.188590 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de1914-e351-4173-abfd-012547658389 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:40.195963 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:40.201067 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de1914-e351-4173-abfd-012547658389 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:40.206743 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35333d67-c0ce-4fb4-a5ff-319af925a8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:40.207414 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35333d67-c0ce-4fb4-a5ff-319af925a8ce admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:40.207693 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35333d67-c0ce-4fb4-a5ff-319af925a8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:40.207967 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35333d67-c0ce-4fb4-a5ff-319af925a8ce admin admin] PATH_INFO: `/v3/projects/9fda125f6940448994b0fce247acdd0e/users/8c7ede78e31f4c7e98441306920206b7/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:40.226852 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35333d67-c0ce-4fb4-a5ff-319af925a8ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fda125f6940448994b0fce247acdd0e, user_id=8c7ede78e31f4c7e98441306920206b7, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:40.231895 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35333d67-c0ce-4fb4-a5ff-319af925a8ce admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:40.308458 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1174/2346] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 20:00:40 2022] PUT /identity/v3/projects/9fda125f6940448994b0fce247acdd0e/users/8c7ede78e31f4c7e98441306920206b7/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 20:00:40.312624 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82de78e-4b46-4705-938c-7851b30a3330 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:40.323255 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82de78e-4b46-4705-938c-7851b30a3330 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:40.357092 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:40.380869 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c05552-5fba-431f-9fdc-b6d820cb1d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:40.381469 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c05552-5fba-431f-9fdc-b6d820cb1d4e admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:40.381778 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c05552-5fba-431f-9fdc-b6d820cb1d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:40.382052 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c05552-5fba-431f-9fdc-b6d820cb1d4e admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:40.382740 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c05552-5fba-431f-9fdc-b6d820cb1d4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:40.384308 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c05552-5fba-431f-9fdc-b6d820cb1d4e admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:40.395444 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1173/2347] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:00:40 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:00:40.399771 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35333d67-c0ce-4fb4-a5ff-319af925a8ce admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:40.411990 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35333d67-c0ce-4fb4-a5ff-319af925a8ce admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:40.429970 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547c1928-980c-42f2-ae16-bb3cbf154b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:40.430653 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c1928-980c-42f2-ae16-bb3cbf154b02 admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:40.430934 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c1928-980c-42f2-ae16-bb3cbf154b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:40.431208 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c1928-980c-42f2-ae16-bb3cbf154b02 admin admin] PATH_INFO: `/v3/projects/9fda125f6940448994b0fce247acdd0e/users/8c7ede78e31f4c7e98441306920206b7/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:40.433428 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547c1928-980c-42f2-ae16-bb3cbf154b02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fda125f6940448994b0fce247acdd0e, user_id=8c7ede78e31f4c7e98441306920206b7, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:40.436060 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547c1928-980c-42f2-ae16-bb3cbf154b02 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:40.447046 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1175/2348] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 20:00:40 2022] PUT /identity/v3/projects/9fda125f6940448994b0fce247acdd0e/users/8c7ede78e31f4c7e98441306920206b7/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:00:40.460670 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f9392-9c29-4496-b75f-e0dac5adfe4d None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:40.461249 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f9392-9c29-4496-b75f-e0dac5adfe4d None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:40.461779 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f9392-9c29-4496-b75f-e0dac5adfe4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:40.503029 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-762f9392-9c29-4496-b75f-e0dac5adfe4d None None] MFA Rules not processed for user `8c7ede78e31f4c7e98441306920206b7`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:00:40.504342 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-762f9392-9c29-4496-b75f-e0dac5adfe4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:40.584580 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1174/2349] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:00:40 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:00:40.595964 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547c1928-980c-42f2-ae16-bb3cbf154b02 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:40.597701 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-547c1928-980c-42f2-ae16-bb3cbf154b02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:40.658952 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547c1928-980c-42f2-ae16-bb3cbf154b02 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:40.662738 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c305b908-af86-43ef-aa9d-c83a1c2ee7f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:40.663287 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305b908-af86-43ef-aa9d-c83a1c2ee7f5 service cinder] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:40.663574 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305b908-af86-43ef-aa9d-c83a1c2ee7f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:40.663849 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305b908-af86-43ef-aa9d-c83a1c2ee7f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:40.674123 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c305b908-af86-43ef-aa9d-c83a1c2ee7f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:40.676154 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c305b908-af86-43ef-aa9d-c83a1c2ee7f5 service cinder] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:40.687189 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1176/2350] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:00:40 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:00:40.738731 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f9392-9c29-4496-b75f-e0dac5adfe4d None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:40.740407 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-762f9392-9c29-4496-b75f-e0dac5adfe4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:40.754183 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f9392-9c29-4496-b75f-e0dac5adfe4d None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:40.758342 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935961f-d59c-4f61-b681-90f41465b2e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:40.764625 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935961f-d59c-4f61-b681-90f41465b2e5 service cinder] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:40.764625 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935961f-d59c-4f61-b681-90f41465b2e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:40.764625 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935961f-d59c-4f61-b681-90f41465b2e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:40.836547 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2935961f-d59c-4f61-b681-90f41465b2e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:40.838186 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2935961f-d59c-4f61-b681-90f41465b2e5 service cinder] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:40.847699 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1175/2351] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:00:40 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:00:47.546112 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c305b908-af86-43ef-aa9d-c83a1c2ee7f5 service cinder] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:47.607279 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c305b908-af86-43ef-aa9d-c83a1c2ee7f5 service cinder] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:47.612272 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f356fcb5-9d0d-4739-8493-683636c53cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:47.617267 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356fcb5-9d0d-4739-8493-683636c53cc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:47.617267 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356fcb5-9d0d-4739-8493-683636c53cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:47.617267 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356fcb5-9d0d-4739-8493-683636c53cc6 admin admin] PATH_INFO: `/v3/users/a2556cc258a543ffbc07c4c0daaf8e70` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:47.617267 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f356fcb5-9d0d-4739-8493-683636c53cc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2556cc258a543ffbc07c4c0daaf8e70)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:47.617267 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f356fcb5-9d0d-4739-8493-683636c53cc6 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:47.763040 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-f356fcb5-9d0d-4739-8493-683636c53cc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2556cc258a543ffbc07c4c0daaf8e70'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:47.810758 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-f356fcb5-9d0d-4739-8493-683636c53cc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2556cc258a543ffbc07c4c0daaf8e70'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:47.811384 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-f356fcb5-9d0d-4739-8493-683636c53cc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2556cc258a543ffbc07c4c0daaf8e70'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:47.811994 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-f356fcb5-9d0d-4739-8493-683636c53cc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2556cc258a543ffbc07c4c0daaf8e70'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:47.824472 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-f356fcb5-9d0d-4739-8493-683636c53cc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2556cc258a543ffbc07c4c0daaf8e70'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:47.825822 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:47.838398 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1177/2352] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 20:00:47 2022] DELETE /identity/v3/users/a2556cc258a543ffbc07c4c0daaf8e70 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 20:00:47.843758 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89fb8c2-22cd-4887-844d-119ebcea85e2 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:47.844300 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89fb8c2-22cd-4887-844d-119ebcea85e2 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:47.844300 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89fb8c2-22cd-4887-844d-119ebcea85e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:47.865016 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-c89fb8c2-22cd-4887-844d-119ebcea85e2 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:00:47.866399 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-c89fb8c2-22cd-4887-844d-119ebcea85e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:47.915571 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:47.926522 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1176/2353] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:00:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:00:47.937123 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f356fcb5-9d0d-4739-8493-683636c53cc6 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:47.939251 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-f356fcb5-9d0d-4739-8493-683636c53cc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:47.995663 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f356fcb5-9d0d-4739-8493-683636c53cc6 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:47.999898 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce2e691-7002-453d-9b1d-7e3fe759712e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:48.002444 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2e691-7002-453d-9b1d-7e3fe759712e service neutron] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:48.002444 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2e691-7002-453d-9b1d-7e3fe759712e service neutron] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:48.002444 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2e691-7002-453d-9b1d-7e3fe759712e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:48.010160 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce2e691-7002-453d-9b1d-7e3fe759712e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:48.011590 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce2e691-7002-453d-9b1d-7e3fe759712e service neutron] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:48.021680 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1178/2354] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:00:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:00:48.468449 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89fb8c2-22cd-4887-844d-119ebcea85e2 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:48.469997 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-c89fb8c2-22cd-4887-844d-119ebcea85e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:48.484426 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89fb8c2-22cd-4887-844d-119ebcea85e2 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:48.489067 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05620695-3ce1-46c3-825b-170d697e7765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:48.490298 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05620695-3ce1-46c3-825b-170d697e7765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:48.490760 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05620695-3ce1-46c3-825b-170d697e7765 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:48.491047 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05620695-3ce1-46c3-825b-170d697e7765 admin admin] PATH_INFO: `/v3/projects/3e0d9e83058b4551b4b570bd06ff4725` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:48.492175 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05620695-3ce1-46c3-825b-170d697e7765 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e0d9e83058b4551b4b570bd06ff4725)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:48.494217 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05620695-3ce1-46c3-825b-170d697e7765 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:48.690322 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-05620695-3ce1-46c3-825b-170d697e7765 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e0d9e83058b4551b4b570bd06ff4725', 'request_id': 'req-05620695-3ce1-46c3-825b-170d697e7765'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:48.758920 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce2e691-7002-453d-9b1d-7e3fe759712e service neutron] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:48.760328 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-4ce2e691-7002-453d-9b1d-7e3fe759712e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:48.770409 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-05620695-3ce1-46c3-825b-170d697e7765 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e0d9e83058b4551b4b570bd06ff4725', 'request_id': 'req-05620695-3ce1-46c3-825b-170d697e7765'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:48.773655 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce2e691-7002-453d-9b1d-7e3fe759712e service neutron] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:48.776602 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-05620695-3ce1-46c3-825b-170d697e7765 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e0d9e83058b4551b4b570bd06ff4725', 'request_id': 'req-05620695-3ce1-46c3-825b-170d697e7765'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:48.789149 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-05620695-3ce1-46c3-825b-170d697e7765 admin admin] The token cache is being invalidate because project 3e0d9e83058b4551b4b570bd06ff4725 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 20:00:48.789609 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-05620695-3ce1-46c3-825b-170d697e7765 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:48.790271 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-05620695-3ce1-46c3-825b-170d697e7765 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:48.791977 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1177/2355] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 20:00:48 2022] DELETE /identity/v3/projects/3e0d9e83058b4551b4b570bd06ff4725 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:00:48.795821 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05620695-3ce1-46c3-825b-170d697e7765 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:48.797170 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-05620695-3ce1-46c3-825b-170d697e7765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:48.831902 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a05acd-ac36-48c5-8a51-9abbe08e30ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:48.832537 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a05acd-ac36-48c5-8a51-9abbe08e30ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:48.832823 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a05acd-ac36-48c5-8a51-9abbe08e30ad admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:48.833096 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a05acd-ac36-48c5-8a51-9abbe08e30ad admin admin] PATH_INFO: `/v3/users/3d11ac7dca094cb28fef042e42d5c30d` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:48.834318 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a05acd-ac36-48c5-8a51-9abbe08e30ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d11ac7dca094cb28fef042e42d5c30d)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:48.836245 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a05acd-ac36-48c5-8a51-9abbe08e30ad admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:48.863457 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05620695-3ce1-46c3-825b-170d697e7765 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:48.868405 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f993fa6-42f7-4d95-b441-d0cb24a1128d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:48.869028 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f993fa6-42f7-4d95-b441-d0cb24a1128d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:48.869347 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f993fa6-42f7-4d95-b441-d0cb24a1128d admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:48.869673 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f993fa6-42f7-4d95-b441-d0cb24a1128d admin admin] PATH_INFO: `/v3/users/8c7ede78e31f4c7e98441306920206b7` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:48.872205 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f993fa6-42f7-4d95-b441-d0cb24a1128d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c7ede78e31f4c7e98441306920206b7)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:48.872789 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f993fa6-42f7-4d95-b441-d0cb24a1128d admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:48.989341 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-a1a05acd-ac36-48c5-8a51-9abbe08e30ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d11ac7dca094cb28fef042e42d5c30d'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:49.036259 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-8f993fa6-42f7-4d95-b441-d0cb24a1128d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c7ede78e31f4c7e98441306920206b7'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:49.056577 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-a1a05acd-ac36-48c5-8a51-9abbe08e30ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d11ac7dca094cb28fef042e42d5c30d'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:49.057233 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-a1a05acd-ac36-48c5-8a51-9abbe08e30ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d11ac7dca094cb28fef042e42d5c30d'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:49.057934 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-a1a05acd-ac36-48c5-8a51-9abbe08e30ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d11ac7dca094cb28fef042e42d5c30d'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:49.072060 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-a1a05acd-ac36-48c5-8a51-9abbe08e30ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d11ac7dca094cb28fef042e42d5c30d'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:49.086116 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1179/2356] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 20:00:48 2022] DELETE /identity/v3/users/3d11ac7dca094cb28fef042e42d5c30d => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 20:00:49.090397 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f74ac-b511-4233-bda4-7448927ae47f None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:49.090686 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f74ac-b511-4233-bda4-7448927ae47f None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:49.090960 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f74ac-b511-4233-bda4-7448927ae47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:49.112226 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-c53f74ac-b511-4233-bda4-7448927ae47f None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:00:49.113435 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-c53f74ac-b511-4233-bda4-7448927ae47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:49.118492 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:49.148375 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-8f993fa6-42f7-4d95-b441-d0cb24a1128d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c7ede78e31f4c7e98441306920206b7'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:49.148917 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-8f993fa6-42f7-4d95-b441-d0cb24a1128d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c7ede78e31f4c7e98441306920206b7'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:49.163070 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-8f993fa6-42f7-4d95-b441-d0cb24a1128d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c7ede78e31f4c7e98441306920206b7'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:49.164107 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-8f993fa6-42f7-4d95-b441-d0cb24a1128d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c7ede78e31f4c7e98441306920206b7'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:49.172422 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:49.176356 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1180/2357] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:00:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 20:00:49.180765 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1178/2358] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 20:00:48 2022] DELETE /identity/v3/users/8c7ede78e31f4c7e98441306920206b7 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 20:00:49.188480 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53f74ac-b511-4233-bda4-7448927ae47f None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:49.189677 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-c53f74ac-b511-4233-bda4-7448927ae47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:49.248064 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53f74ac-b511-4233-bda4-7448927ae47f None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:49.299696 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b105838f-7619-4ff3-9c3e-9b11d5e71f2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:49.300310 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105838f-7619-4ff3-9c3e-9b11d5e71f2a service neutron] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:49.300590 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105838f-7619-4ff3-9c3e-9b11d5e71f2a service neutron] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:49.300863 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105838f-7619-4ff3-9c3e-9b11d5e71f2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:49.361020 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b105838f-7619-4ff3-9c3e-9b11d5e71f2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:49.362587 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b105838f-7619-4ff3-9c3e-9b11d5e71f2a service neutron] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:49.372592 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1181/2359] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:00:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 20:00:49.678051 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f993fa6-42f7-4d95-b441-d0cb24a1128d admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:49.679491 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-8f993fa6-42f7-4d95-b441-d0cb24a1128d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:49.694328 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f993fa6-42f7-4d95-b441-d0cb24a1128d admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:49.699521 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b7e0a0-fdbf-4e96-9769-663aa25a8417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:49.700888 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7e0a0-fdbf-4e96-9769-663aa25a8417 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:49.701175 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7e0a0-fdbf-4e96-9769-663aa25a8417 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:49.701870 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7e0a0-fdbf-4e96-9769-663aa25a8417 admin admin] PATH_INFO: `/v3/projects/9fda125f6940448994b0fce247acdd0e` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:49.703352 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b7e0a0-fdbf-4e96-9769-663aa25a8417 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fda125f6940448994b0fce247acdd0e)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:49.705654 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b7e0a0-fdbf-4e96-9769-663aa25a8417 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:49.871383 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-a1b7e0a0-fdbf-4e96-9769-663aa25a8417 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fda125f6940448994b0fce247acdd0e', 'request_id': 'req-a1b7e0a0-fdbf-4e96-9769-663aa25a8417'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:49.907011 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b105838f-7619-4ff3-9c3e-9b11d5e71f2a service neutron] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:49.908542 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-b105838f-7619-4ff3-9c3e-9b11d5e71f2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:49.924304 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b105838f-7619-4ff3-9c3e-9b11d5e71f2a service neutron] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:49.944743 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:49.994757 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-a1b7e0a0-fdbf-4e96-9769-663aa25a8417 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fda125f6940448994b0fce247acdd0e', 'request_id': 'req-a1b7e0a0-fdbf-4e96-9769-663aa25a8417'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:50.001343 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660371ff-95af-4eea-8bfe-569e529cf443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:50.001662 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660371ff-95af-4eea-8bfe-569e529cf443 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:50.002069 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660371ff-95af-4eea-8bfe-569e529cf443 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:50.003314 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660371ff-95af-4eea-8bfe-569e529cf443 admin admin] PATH_INFO: `/v3/projects/6ad4996eeebc457c9f11617278ca0430` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:50.005259 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660371ff-95af-4eea-8bfe-569e529cf443 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ad4996eeebc457c9f11617278ca0430)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:50.007318 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660371ff-95af-4eea-8bfe-569e529cf443 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:50.007806 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-a1b7e0a0-fdbf-4e96-9769-663aa25a8417 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fda125f6940448994b0fce247acdd0e', 'request_id': 'req-a1b7e0a0-fdbf-4e96-9769-663aa25a8417'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:50.028132 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-a1b7e0a0-fdbf-4e96-9769-663aa25a8417 admin admin] The token cache is being invalidate because project 9fda125f6940448994b0fce247acdd0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 20:00:50.028604 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-a1b7e0a0-fdbf-4e96-9769-663aa25a8417 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:50.031985 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-a1b7e0a0-fdbf-4e96-9769-663aa25a8417 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:50.034290 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1179/2360] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 20:00:49 2022] DELETE /identity/v3/projects/9fda125f6940448994b0fce247acdd0e => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:00:50.039468 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0b04a-98da-4b47-b607-4f2f1d2ef758 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:50.039880 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0b04a-98da-4b47-b607-4f2f1d2ef758 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:50.040246 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0b04a-98da-4b47-b607-4f2f1d2ef758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:50.064191 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-e6a0b04a-98da-4b47-b607-4f2f1d2ef758 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:00:50.065745 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-e6a0b04a-98da-4b47-b607-4f2f1d2ef758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:50.079778 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1180/2361] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:00:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:00:50.089355 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e827d-52f1-460f-a921-310831d6316f None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:50.089676 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e827d-52f1-460f-a921-310831d6316f None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:50.089956 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e827d-52f1-460f-a921-310831d6316f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:50.119943 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-d42e827d-52f1-460f-a921-310831d6316f None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:00:50.121265 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-d42e827d-52f1-460f-a921-310831d6316f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:50.132031 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1181/2362] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:00:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 20:00:50.137863 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42e827d-52f1-460f-a921-310831d6316f None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:50.149731 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-660371ff-95af-4eea-8bfe-569e529cf443 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ad4996eeebc457c9f11617278ca0430', 'request_id': 'req-660371ff-95af-4eea-8bfe-569e529cf443'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:50.153989 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42e827d-52f1-460f-a921-310831d6316f None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:50.158924 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-660371ff-95af-4eea-8bfe-569e529cf443 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ad4996eeebc457c9f11617278ca0430', 'request_id': 'req-660371ff-95af-4eea-8bfe-569e529cf443'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:50.225170 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b492ffc4-15ca-4e9e-b972-7a774911dbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:50.226051 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492ffc4-15ca-4e9e-b972-7a774911dbfe admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:50.226810 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492ffc4-15ca-4e9e-b972-7a774911dbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:50.226810 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492ffc4-15ca-4e9e-b972-7a774911dbfe admin admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:50.227831 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b492ffc4-15ca-4e9e-b972-7a774911dbfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:00:50.228226 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b492ffc4-15ca-4e9e-b972-7a774911dbfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:50.229860 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b492ffc4-15ca-4e9e-b972-7a774911dbfe admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:50.246985 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1182/2363] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 20:00:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:00:50.250472 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b492ffc4-15ca-4e9e-b972-7a774911dbfe admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:50.260551 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-660371ff-95af-4eea-8bfe-569e529cf443 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ad4996eeebc457c9f11617278ca0430', 'request_id': 'req-660371ff-95af-4eea-8bfe-569e529cf443'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:50.260719 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b492ffc4-15ca-4e9e-b972-7a774911dbfe admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:50.266686 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65fcaca-df39-4e14-8ee9-08f432d68326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:50.267004 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65fcaca-df39-4e14-8ee9-08f432d68326 admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:50.267426 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65fcaca-df39-4e14-8ee9-08f432d68326 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:50.267771 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65fcaca-df39-4e14-8ee9-08f432d68326 admin admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:50.268345 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65fcaca-df39-4e14-8ee9-08f432d68326 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:50.270278 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65fcaca-df39-4e14-8ee9-08f432d68326 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:50.273457 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-660371ff-95af-4eea-8bfe-569e529cf443 admin admin] The token cache is being invalidate because project 6ad4996eeebc457c9f11617278ca0430 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 20:00:50.273793 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-660371ff-95af-4eea-8bfe-569e529cf443 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:50.274439 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-660371ff-95af-4eea-8bfe-569e529cf443 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:00:50.276133 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1182/2364] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 20:00:49 2022] DELETE /identity/v3/projects/6ad4996eeebc457c9f11617278ca0430 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:00:50.284932 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199cbee-25a9-400c-b832-3ddd01665a95 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:50.285216 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199cbee-25a9-400c-b832-3ddd01665a95 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:50.285515 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199cbee-25a9-400c-b832-3ddd01665a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:50.306006 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-7199cbee-25a9-400c-b832-3ddd01665a95 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:00:50.308362 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-7199cbee-25a9-400c-b832-3ddd01665a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:50.317014 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1183/2365] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:00:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 20:00:50.324850 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd70ce8-f737-432d-a4da-b3cfc86dc524 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:50.325138 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd70ce8-f737-432d-a4da-b3cfc86dc524 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:50.325411 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd70ce8-f737-432d-a4da-b3cfc86dc524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:50.347989 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-1bd70ce8-f737-432d-a4da-b3cfc86dc524 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:00:50.349275 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-1bd70ce8-f737-432d-a4da-b3cfc86dc524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:50.358223 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1184/2366] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:00:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:00:50.363433 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd70ce8-f737-432d-a4da-b3cfc86dc524 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:50.374660 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd70ce8-f737-432d-a4da-b3cfc86dc524 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:50.380292 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d14c86c-201c-45bf-a675-6a89ec0d47aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:50.380966 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d14c86c-201c-45bf-a675-6a89ec0d47aa admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:50.383349 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d14c86c-201c-45bf-a675-6a89ec0d47aa admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:50.383349 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d14c86c-201c-45bf-a675-6a89ec0d47aa admin admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:50.383349 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d14c86c-201c-45bf-a675-6a89ec0d47aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:00:50.383349 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d14c86c-201c-45bf-a675-6a89ec0d47aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:50.401412 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d14c86c-201c-45bf-a675-6a89ec0d47aa admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:50.401412 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1185/2367] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 20:00:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:00:50.404233 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d14c86c-201c-45bf-a675-6a89ec0d47aa admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:50.416109 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d14c86c-201c-45bf-a675-6a89ec0d47aa admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:50.421073 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a212f344-14b6-4889-a30d-5bd18984d772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:50.421831 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212f344-14b6-4889-a30d-5bd18984d772 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:50.422246 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212f344-14b6-4889-a30d-5bd18984d772 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:50.422495 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212f344-14b6-4889-a30d-5bd18984d772 admin admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:50.423173 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a212f344-14b6-4889-a30d-5bd18984d772 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:50.425274 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a212f344-14b6-4889-a30d-5bd18984d772 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:50.453514 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1183/2368] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 20:00:50 2022] POST /identity/v3/projects => generated 407 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:00:50.461344 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65fcaca-df39-4e14-8ee9-08f432d68326 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:50.461344 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-f65fcaca-df39-4e14-8ee9-08f432d68326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:50.504935 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:50.521729 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1186/2369] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 20:00:50 2022] POST /identity/v3/projects => generated 381 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:00:50.523045 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a212f344-14b6-4889-a30d-5bd18984d772 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:50.533196 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65fcaca-df39-4e14-8ee9-08f432d68326 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:50.594133 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a212f344-14b6-4889-a30d-5bd18984d772 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:50.594483 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb4b72d-3050-40cd-a162-217b8aeb6e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:50.595055 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4b72d-3050-40cd-a162-217b8aeb6e31 admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:50.595360 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4b72d-3050-40cd-a162-217b8aeb6e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:50.595643 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4b72d-3050-40cd-a162-217b8aeb6e31 admin admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:50.596277 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb4b72d-3050-40cd-a162-217b8aeb6e31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:50.598241 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb4b72d-3050-40cd-a162-217b8aeb6e31 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:50.598980 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e7ca1d-d130-4e98-aa94-8800896dba7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:50.599639 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e7ca1d-d130-4e98-aa94-8800896dba7e admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:50.599948 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e7ca1d-d130-4e98-aa94-8800896dba7e admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:50.600235 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e7ca1d-d130-4e98-aa94-8800896dba7e admin admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:50.600858 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e7ca1d-d130-4e98-aa94-8800896dba7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:50.602824 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e7ca1d-d130-4e98-aa94-8800896dba7e admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:50.610966 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:50.741677 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1184/2370] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 20:00:50 2022] POST /identity/v3/users => generated 304 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:00:50.747206 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1187/2371] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 20:00:50 2022] POST /identity/v3/users => generated 291 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:00:50.747346 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb4b72d-3050-40cd-a162-217b8aeb6e31 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:50.750539 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e7ca1d-d130-4e98-aa94-8800896dba7e admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:50.760374 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e7ca1d-d130-4e98-aa94-8800896dba7e admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:50.767373 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb4b72d-3050-40cd-a162-217b8aeb6e31 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:50.767549 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38704e-884d-4d23-a498-481f7ebe6e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:50.768160 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38704e-884d-4d23-a498-481f7ebe6e83 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:50.768762 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38704e-884d-4d23-a498-481f7ebe6e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:50.769128 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38704e-884d-4d23-a498-481f7ebe6e83 admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:50.770751 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe38704e-884d-4d23-a498-481f7ebe6e83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:50.771705 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe38704e-884d-4d23-a498-481f7ebe6e83 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:50.779180 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8091b6-cad6-49f0-9a57-efe6c49f8ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:50.779828 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8091b6-cad6-49f0-9a57-efe6c49f8ae9 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:50.780229 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8091b6-cad6-49f0-9a57-efe6c49f8ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:50.780633 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8091b6-cad6-49f0-9a57-efe6c49f8ae9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:50.781428 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8091b6-cad6-49f0-9a57-efe6c49f8ae9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:50.783361 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8091b6-cad6-49f0-9a57-efe6c49f8ae9 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:50.794687 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1185/2372] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 20:00:50.798928 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8091b6-cad6-49f0-9a57-efe6c49f8ae9 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:50.810256 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8091b6-cad6-49f0-9a57-efe6c49f8ae9 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:50.810680 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1188/2373] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 20:00:50.815016 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38704e-884d-4d23-a498-481f7ebe6e83 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:50.818527 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e5785-e85f-47f0-8477-1763623be21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:50.819147 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e5785-e85f-47f0-8477-1763623be21e admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:50.819422 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e5785-e85f-47f0-8477-1763623be21e admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:50.819693 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e5785-e85f-47f0-8477-1763623be21e admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:50.820772 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7e5785-e85f-47f0-8477-1763623be21e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:50.822514 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7e5785-e85f-47f0-8477-1763623be21e admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:50.827849 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38704e-884d-4d23-a498-481f7ebe6e83 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:50.834600 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df678869-29da-4b91-859b-a2c67bad7e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:50.837310 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df678869-29da-4b91-859b-a2c67bad7e2b admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:50.837310 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df678869-29da-4b91-859b-a2c67bad7e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:50.838104 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df678869-29da-4b91-859b-a2c67bad7e2b admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:50.840182 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df678869-29da-4b91-859b-a2c67bad7e2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:50.842324 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1186/2374] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:00:50.843219 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df678869-29da-4b91-859b-a2c67bad7e2b admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:50.849380 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e5785-e85f-47f0-8477-1763623be21e admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:50.856342 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1189/2375] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 20:00:50.860612 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df678869-29da-4b91-859b-a2c67bad7e2b admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:50.862664 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e5785-e85f-47f0-8477-1763623be21e admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:50.867672 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d3430e-0331-4f15-a4bd-14f403a78502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:50.868333 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3430e-0331-4f15-a4bd-14f403a78502 admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:50.868639 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3430e-0331-4f15-a4bd-14f403a78502 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:50.868899 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3430e-0331-4f15-a4bd-14f403a78502 admin admin] PATH_INFO: `/v3/projects/2679ad20ad7448728fce650012d823c1/users/d9622f1cdd1649838caa746d7f9d0ac5/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:50.884384 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df678869-29da-4b91-859b-a2c67bad7e2b admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:50.886799 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d3430e-0331-4f15-a4bd-14f403a78502 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2679ad20ad7448728fce650012d823c1, user_id=d9622f1cdd1649838caa746d7f9d0ac5, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:50.889653 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d3430e-0331-4f15-a4bd-14f403a78502 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:50.895152 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604ecd8-cd92-48d6-b832-2328a136b2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:50.895152 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604ecd8-cd92-48d6-b832-2328a136b2a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:50.895152 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604ecd8-cd92-48d6-b832-2328a136b2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:50.895152 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604ecd8-cd92-48d6-b832-2328a136b2a9 admin admin] PATH_INFO: `/v3/projects/8dcda96696f847b489c52544964275cc/users/ddda822166d4473e96c9fc5cb03df4d2/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:50.910791 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f604ecd8-cd92-48d6-b832-2328a136b2a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dcda96696f847b489c52544964275cc, user_id=ddda822166d4473e96c9fc5cb03df4d2, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:50.914999 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f604ecd8-cd92-48d6-b832-2328a136b2a9 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:50.965134 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1187/2376] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 20:00:50 2022] PUT /identity/v3/projects/2679ad20ad7448728fce650012d823c1/users/d9622f1cdd1649838caa746d7f9d0ac5/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:00:50.976364 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800a340-fe54-488f-9af2-d0f83d7aa021 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:50.976661 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800a340-fe54-488f-9af2-d0f83d7aa021 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:50.976938 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800a340-fe54-488f-9af2-d0f83d7aa021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:50.988444 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1190/2377] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 20:00:50 2022] PUT /identity/v3/projects/8dcda96696f847b489c52544964275cc/users/ddda822166d4473e96c9fc5cb03df4d2/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:00:50.993568 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f34c2-432a-4d34-adff-fc8edfcf8586 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:50.994085 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f34c2-432a-4d34-adff-fc8edfcf8586 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:50.994447 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f34c2-432a-4d34-adff-fc8edfcf8586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:51.015316 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-9e0f34c2-432a-4d34-adff-fc8edfcf8586 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:00:51.015564 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-f800a340-fe54-488f-9af2-d0f83d7aa021 None None] MFA Rules not processed for user `d9622f1cdd1649838caa746d7f9d0ac5`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:00:51.016688 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-f800a340-fe54-488f-9af2-d0f83d7aa021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:51.016815 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-9e0f34c2-432a-4d34-adff-fc8edfcf8586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:51.085833 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1191/2378] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:00:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:00:51.089641 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1188/2379] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:00:50 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:00:51.096127 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f34c2-432a-4d34-adff-fc8edfcf8586 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:51.096653 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f800a340-fe54-488f-9af2-d0f83d7aa021 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:51.098040 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-f800a340-fe54-488f-9af2-d0f83d7aa021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:51.106006 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f34c2-432a-4d34-adff-fc8edfcf8586 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:51.111728 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf4af6-b3b9-4631-b8b4-9cc9dce20493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:51.112025 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf4af6-b3b9-4631-b8b4-9cc9dce20493 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:51.112315 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf4af6-b3b9-4631-b8b4-9cc9dce20493 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:51.112589 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf4af6-b3b9-4631-b8b4-9cc9dce20493 admin admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:51.113359 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cf4af6-b3b9-4631-b8b4-9cc9dce20493 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:51.115352 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cf4af6-b3b9-4631-b8b4-9cc9dce20493 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:51.123191 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:51.162751 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f800a340-fe54-488f-9af2-d0f83d7aa021 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:51.166657 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a3d87-d780-446a-820e-1f1b18f18888 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:51.167270 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a3d87-d780-446a-820e-1f1b18f18888 service neutron] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:51.167548 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a3d87-d780-446a-820e-1f1b18f18888 service neutron] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:51.167816 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a3d87-d780-446a-820e-1f1b18f18888 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:51.177808 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a3d87-d780-446a-820e-1f1b18f18888 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:51.179247 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a3d87-d780-446a-820e-1f1b18f18888 service neutron] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:51.189409 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1189/2380] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:00:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:00:51.217609 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1192/2381] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 20:00:51 2022] POST /identity/v3/projects => generated 409 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 20:00:51.221843 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a3d87-d780-446a-820e-1f1b18f18888 service neutron] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:51.232219 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a3d87-d780-446a-820e-1f1b18f18888 service neutron] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:51.296283 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f505eb-5150-4862-9a4b-bc2b72eaf682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:51.297173 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f505eb-5150-4862-9a4b-bc2b72eaf682 admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:51.297386 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f505eb-5150-4862-9a4b-bc2b72eaf682 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:51.297717 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f505eb-5150-4862-9a4b-bc2b72eaf682 admin admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:51.298361 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f505eb-5150-4862-9a4b-bc2b72eaf682 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:51.300307 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f505eb-5150-4862-9a4b-bc2b72eaf682 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:51.407015 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1190/2382] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 20:00:51 2022] POST /identity/v3/users => generated 311 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:00:51.411038 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf4af6-b3b9-4631-b8b4-9cc9dce20493 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:51.422963 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf4af6-b3b9-4631-b8b4-9cc9dce20493 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:51.427981 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b0c97-9d60-4c7a-b43e-c96eb758794e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:51.428588 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b0c97-9d60-4c7a-b43e-c96eb758794e admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:51.428861 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b0c97-9d60-4c7a-b43e-c96eb758794e admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:51.429126 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b0c97-9d60-4c7a-b43e-c96eb758794e admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:51.429795 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0b0c97-9d60-4c7a-b43e-c96eb758794e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:51.431370 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0b0c97-9d60-4c7a-b43e-c96eb758794e admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:51.443355 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1193/2383] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:00:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:00:51.447603 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f505eb-5150-4862-9a4b-bc2b72eaf682 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:51.458746 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f505eb-5150-4862-9a4b-bc2b72eaf682 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:51.463460 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e573cc05-3f66-4d19-aca9-ef45c4d2ae88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:51.465750 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573cc05-3f66-4d19-aca9-ef45c4d2ae88 admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:51.465750 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573cc05-3f66-4d19-aca9-ef45c4d2ae88 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:51.465750 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573cc05-3f66-4d19-aca9-ef45c4d2ae88 admin admin] PATH_INFO: `/v3/projects/ecb7e7baa5414b2c8f042f9bd867fdab/users/68d878f9ecde4234bbd49c035e0c8129/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:51.481778 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e573cc05-3f66-4d19-aca9-ef45c4d2ae88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecb7e7baa5414b2c8f042f9bd867fdab, user_id=68d878f9ecde4234bbd49c035e0c8129, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:51.485129 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e573cc05-3f66-4d19-aca9-ef45c4d2ae88 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:51.600656 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1191/2384] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 20:00:51 2022] PUT /identity/v3/projects/ecb7e7baa5414b2c8f042f9bd867fdab/users/68d878f9ecde4234bbd49c035e0c8129/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:00:51.604322 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b0c97-9d60-4c7a-b43e-c96eb758794e admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:51.615484 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b0c97-9d60-4c7a-b43e-c96eb758794e admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:51.687736 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cfb9a4-9798-4b3d-b592-ff378c7b63df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:51.689089 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cfb9a4-9798-4b3d-b592-ff378c7b63df admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:51.689089 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cfb9a4-9798-4b3d-b592-ff378c7b63df admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:51.689089 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cfb9a4-9798-4b3d-b592-ff378c7b63df admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:51.689563 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cfb9a4-9798-4b3d-b592-ff378c7b63df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:51.691271 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cfb9a4-9798-4b3d-b592-ff378c7b63df admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:51.702021 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1194/2385] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:00:51 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:00:51.706529 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e573cc05-3f66-4d19-aca9-ef45c4d2ae88 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:51.720592 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e573cc05-3f66-4d19-aca9-ef45c4d2ae88 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:51.725636 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed831afe-9f25-4c7e-b769-00cd23e845b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:51.726302 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed831afe-9f25-4c7e-b769-00cd23e845b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:51.726577 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed831afe-9f25-4c7e-b769-00cd23e845b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:51.726849 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed831afe-9f25-4c7e-b769-00cd23e845b9 admin admin] PATH_INFO: `/v3/projects/ecb7e7baa5414b2c8f042f9bd867fdab/users/68d878f9ecde4234bbd49c035e0c8129/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:51.728813 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed831afe-9f25-4c7e-b769-00cd23e845b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecb7e7baa5414b2c8f042f9bd867fdab, user_id=68d878f9ecde4234bbd49c035e0c8129, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:51.731470 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed831afe-9f25-4c7e-b769-00cd23e845b9 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:51.745291 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1192/2386] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 20:00:51 2022] PUT /identity/v3/projects/ecb7e7baa5414b2c8f042f9bd867fdab/users/68d878f9ecde4234bbd49c035e0c8129/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 20:00:51.756272 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26321b40-5b11-4cf7-ac36-1c8c26a0d506 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:51.758107 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26321b40-5b11-4cf7-ac36-1c8c26a0d506 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:51.758107 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26321b40-5b11-4cf7-ac36-1c8c26a0d506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:51.771755 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:51.789871 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-26321b40-5b11-4cf7-ac36-1c8c26a0d506 None None] MFA Rules not processed for user `68d878f9ecde4234bbd49c035e0c8129`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:00:51.791366 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-26321b40-5b11-4cf7-ac36-1c8c26a0d506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:51.870449 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1195/2387] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:00:51 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:00:51.882256 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed831afe-9f25-4c7e-b769-00cd23e845b9 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:51.884813 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-ed831afe-9f25-4c7e-b769-00cd23e845b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:51.953834 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed831afe-9f25-4c7e-b769-00cd23e845b9 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:51.957902 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e1984a-44ae-4ea3-b1c1-fbf729e2b8ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:51.958517 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1984a-44ae-4ea3-b1c1-fbf729e2b8ac service cinder] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:51.958776 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1984a-44ae-4ea3-b1c1-fbf729e2b8ac service cinder] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:51.959052 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1984a-44ae-4ea3-b1c1-fbf729e2b8ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:51.969865 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e1984a-44ae-4ea3-b1c1-fbf729e2b8ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:51.971831 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e1984a-44ae-4ea3-b1c1-fbf729e2b8ac service cinder] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:51.982483 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1193/2388] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:00:51 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:00:52.412068 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26321b40-5b11-4cf7-ac36-1c8c26a0d506 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:52.423488 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26321b40-5b11-4cf7-ac36-1c8c26a0d506 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:52.427138 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a3d9f-8d6e-4fb4-b543-3ad703202e56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:52.427741 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a3d9f-8d6e-4fb4-b543-3ad703202e56 service cinder] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:52.428019 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a3d9f-8d6e-4fb4-b543-3ad703202e56 service cinder] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:52.428290 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a3d9f-8d6e-4fb4-b543-3ad703202e56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:52.490436 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83a3d9f-8d6e-4fb4-b543-3ad703202e56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:52.495862 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83a3d9f-8d6e-4fb4-b543-3ad703202e56 service cinder] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:52.501382 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1196/2389] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:00:52 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:00:53.125554 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24785251-b22d-4c4c-ae0d-0765f294377b None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:53.126065 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24785251-b22d-4c4c-ae0d-0765f294377b None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:53.126065 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24785251-b22d-4c4c-ae0d-0765f294377b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:53.156757 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-24785251-b22d-4c4c-ae0d-0765f294377b None None] MFA Rules not processed for user `ddda822166d4473e96c9fc5cb03df4d2`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:00:53.158558 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-24785251-b22d-4c4c-ae0d-0765f294377b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:53.163876 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:53.241668 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1194/2390] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:00:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:00:53.255124 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a3d9f-8d6e-4fb4-b543-3ad703202e56 service cinder] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:00:53.265668 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a3d9f-8d6e-4fb4-b543-3ad703202e56 service cinder] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:00:53.270630 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba551868-d8d1-4974-94d8-085b693a4e85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:00:53.271344 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba551868-d8d1-4974-94d8-085b693a4e85 service cinder] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:53.271683 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba551868-d8d1-4974-94d8-085b693a4e85 service cinder] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:53.272058 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba551868-d8d1-4974-94d8-085b693a4e85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:53.282541 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba551868-d8d1-4974-94d8-085b693a4e85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:00:53.287386 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba551868-d8d1-4974-94d8-085b693a4e85 service cinder] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:00:53.294419 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1197/2391] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:00:53 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:00:55.283760 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c8277-59ce-480f-9749-2ed0f4bc2625 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:00:55.284630 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c8277-59ce-480f-9749-2ed0f4bc2625 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:00:55.284961 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c8277-59ce-480f-9749-2ed0f4bc2625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:00:55.305087 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-502c8277-59ce-480f-9749-2ed0f4bc2625 None None] MFA Rules not processed for user `ddda822166d4473e96c9fc5cb03df4d2`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:00:55.306363 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-502c8277-59ce-480f-9749-2ed0f4bc2625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:00:55.315407 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1195/2392] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:00:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:01:00.662185 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba551868-d8d1-4974-94d8-085b693a4e85 service cinder] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:01:00.729888 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba551868-d8d1-4974-94d8-085b693a4e85 service cinder] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:01:00.735116 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c7493-2232-4963-84bc-6b6fb75c8725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:01:00.735752 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c7493-2232-4963-84bc-6b6fb75c8725 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:01:00.735935 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c7493-2232-4963-84bc-6b6fb75c8725 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:01:00.736284 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c7493-2232-4963-84bc-6b6fb75c8725 admin admin] PATH_INFO: `/v3/users/d9622f1cdd1649838caa746d7f9d0ac5` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:01:00.738175 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046c7493-2232-4963-84bc-6b6fb75c8725 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9622f1cdd1649838caa746d7f9d0ac5)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:01:00.741015 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046c7493-2232-4963-84bc-6b6fb75c8725 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:01:00.764875 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:01:00.996796 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-046c7493-2232-4963-84bc-6b6fb75c8725 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9622f1cdd1649838caa746d7f9d0ac5'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:01:01.113936 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-046c7493-2232-4963-84bc-6b6fb75c8725 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9622f1cdd1649838caa746d7f9d0ac5'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:01:01.114551 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-046c7493-2232-4963-84bc-6b6fb75c8725 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9622f1cdd1649838caa746d7f9d0ac5'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:01:01.115219 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-046c7493-2232-4963-84bc-6b6fb75c8725 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9622f1cdd1649838caa746d7f9d0ac5'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:01:01.128316 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-046c7493-2232-4963-84bc-6b6fb75c8725 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9622f1cdd1649838caa746d7f9d0ac5'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:01:01.140916 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1198/2393] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 20:01:00 2022] DELETE /identity/v3/users/d9622f1cdd1649838caa746d7f9d0ac5 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:01:01.146189 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3efcd9-8986-4bb6-ab21-c6a7267aedb0 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:01:01.147012 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3efcd9-8986-4bb6-ab21-c6a7267aedb0 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:01:01.147290 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3efcd9-8986-4bb6-ab21-c6a7267aedb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:01:01.167161 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-cf3efcd9-8986-4bb6-ab21-c6a7267aedb0 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:01:01.168426 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-cf3efcd9-8986-4bb6-ab21-c6a7267aedb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:01:01.247837 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1196/2394] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:01:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:01:01.263977 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c7493-2232-4963-84bc-6b6fb75c8725 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:01:01.265594 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-046c7493-2232-4963-84bc-6b6fb75c8725 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:01:01.334548 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c7493-2232-4963-84bc-6b6fb75c8725 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:01:01.338643 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9802b7-29ca-4a8b-beab-94b98cb80907 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:01:01.340092 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9802b7-29ca-4a8b-beab-94b98cb80907 service neutron] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:01:01.340406 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9802b7-29ca-4a8b-beab-94b98cb80907 service neutron] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:01:01.341232 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9802b7-29ca-4a8b-beab-94b98cb80907 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:01:01.357133 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9802b7-29ca-4a8b-beab-94b98cb80907 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:01:01.358799 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9802b7-29ca-4a8b-beab-94b98cb80907 service neutron] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:01:01.372000 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1199/2395] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:01:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:01:01.847562 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3efcd9-8986-4bb6-ab21-c6a7267aedb0 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:01:01.851514 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-cf3efcd9-8986-4bb6-ab21-c6a7267aedb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:01:01.865436 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3efcd9-8986-4bb6-ab21-c6a7267aedb0 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:01:01.871230 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba0791-ccb7-48a0-80c6-c6a7ce507293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:01:01.871855 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba0791-ccb7-48a0-80c6-c6a7ce507293 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:01:01.872217 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba0791-ccb7-48a0-80c6-c6a7ce507293 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:01:01.872387 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba0791-ccb7-48a0-80c6-c6a7ce507293 admin admin] PATH_INFO: `/v3/projects/2679ad20ad7448728fce650012d823c1` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:01:01.873574 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ba0791-ccb7-48a0-80c6-c6a7ce507293 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2679ad20ad7448728fce650012d823c1)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:01:01.875446 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ba0791-ccb7-48a0-80c6-c6a7ce507293 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:01:01.994589 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-f4ba0791-ccb7-48a0-80c6-c6a7ce507293 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2679ad20ad7448728fce650012d823c1', 'request_id': 'req-f4ba0791-ccb7-48a0-80c6-c6a7ce507293'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:01:02.078583 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-f4ba0791-ccb7-48a0-80c6-c6a7ce507293 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2679ad20ad7448728fce650012d823c1', 'request_id': 'req-f4ba0791-ccb7-48a0-80c6-c6a7ce507293'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:01:02.089020 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-f4ba0791-ccb7-48a0-80c6-c6a7ce507293 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2679ad20ad7448728fce650012d823c1', 'request_id': 'req-f4ba0791-ccb7-48a0-80c6-c6a7ce507293'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:01:02.109946 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-f4ba0791-ccb7-48a0-80c6-c6a7ce507293 admin admin] The token cache is being invalidate because project 2679ad20ad7448728fce650012d823c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 20:01:02.110499 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-f4ba0791-ccb7-48a0-80c6-c6a7ce507293 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:01:02.111149 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-f4ba0791-ccb7-48a0-80c6-c6a7ce507293 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:01:02.119300 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1197/2396] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 20:01:01 2022] DELETE /identity/v3/projects/2679ad20ad7448728fce650012d823c1 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:01:02.123540 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9802b7-29ca-4a8b-beab-94b98cb80907 service neutron] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:01:02.134859 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9802b7-29ca-4a8b-beab-94b98cb80907 service neutron] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:01:02.238065 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad106d-dd69-4683-8a27-5d73116fce7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:01:02.239409 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad106d-dd69-4683-8a27-5d73116fce7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:01:02.239829 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad106d-dd69-4683-8a27-5d73116fce7e admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:01:02.240545 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad106d-dd69-4683-8a27-5d73116fce7e admin admin] PATH_INFO: `/v3/users/68d878f9ecde4234bbd49c035e0c8129` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:01:02.242371 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad106d-dd69-4683-8a27-5d73116fce7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=68d878f9ecde4234bbd49c035e0c8129)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:01:02.247373 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad106d-dd69-4683-8a27-5d73116fce7e admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:01:02.506692 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:01:02.515913 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-4bad106d-dd69-4683-8a27-5d73116fce7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68d878f9ecde4234bbd49c035e0c8129'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:01:02.643952 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-4bad106d-dd69-4683-8a27-5d73116fce7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68d878f9ecde4234bbd49c035e0c8129'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:01:02.644934 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-4bad106d-dd69-4683-8a27-5d73116fce7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68d878f9ecde4234bbd49c035e0c8129'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:01:02.645670 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-4bad106d-dd69-4683-8a27-5d73116fce7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68d878f9ecde4234bbd49c035e0c8129'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:01:02.662825 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-4bad106d-dd69-4683-8a27-5d73116fce7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68d878f9ecde4234bbd49c035e0c8129'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:01:02.686023 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1200/2397] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 20:01:02 2022] DELETE /identity/v3/users/68d878f9ecde4234bbd49c035e0c8129 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:01:03.429744 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba0791-ccb7-48a0-80c6-c6a7ce507293 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:01:03.431278 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-f4ba0791-ccb7-48a0-80c6-c6a7ce507293 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:01:03.447208 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba0791-ccb7-48a0-80c6-c6a7ce507293 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:01:03.470904 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:01:03.509222 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf74bbc-0101-479c-9185-ed695f6e686b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:01:03.509896 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf74bbc-0101-479c-9185-ed695f6e686b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:01:03.510178 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf74bbc-0101-479c-9185-ed695f6e686b admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:01:03.510459 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf74bbc-0101-479c-9185-ed695f6e686b admin admin] PATH_INFO: `/v3/projects/ecb7e7baa5414b2c8f042f9bd867fdab` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:01:03.511582 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf74bbc-0101-479c-9185-ed695f6e686b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecb7e7baa5414b2c8f042f9bd867fdab)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:01:03.513542 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf74bbc-0101-479c-9185-ed695f6e686b admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:01:03.626250 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-baf74bbc-0101-479c-9185-ed695f6e686b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecb7e7baa5414b2c8f042f9bd867fdab', 'request_id': 'req-baf74bbc-0101-479c-9185-ed695f6e686b'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:01:03.693587 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ecbcb-31a5-443e-a405-83b62f525b17 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:01:03.694085 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ecbcb-31a5-443e-a405-83b62f525b17 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:01:03.694199 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ecbcb-31a5-443e-a405-83b62f525b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:01:03.704568 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-baf74bbc-0101-479c-9185-ed695f6e686b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecb7e7baa5414b2c8f042f9bd867fdab', 'request_id': 'req-baf74bbc-0101-479c-9185-ed695f6e686b'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:01:03.717982 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-baf74bbc-0101-479c-9185-ed695f6e686b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecb7e7baa5414b2c8f042f9bd867fdab', 'request_id': 'req-baf74bbc-0101-479c-9185-ed695f6e686b'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:01:03.723379 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-081ecbcb-31a5-443e-a405-83b62f525b17 None None] MFA Rules not processed for user `d2c1ded5aad545148d3e30f6ce994004`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:01:03.724626 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-081ecbcb-31a5-443e-a405-83b62f525b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:01:03.739489 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-baf74bbc-0101-479c-9185-ed695f6e686b admin admin] The token cache is being invalidate because project ecb7e7baa5414b2c8f042f9bd867fdab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 20:01:03.739778 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-baf74bbc-0101-479c-9185-ed695f6e686b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:01:03.740475 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-baf74bbc-0101-479c-9185-ed695f6e686b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:01:03.746923 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1198/2398] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 20:01:03 2022] DELETE /identity/v3/projects/ecb7e7baa5414b2c8f042f9bd867fdab => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:01:03.749900 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60192a-cd48-4884-8cb0-2234692565c4 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:01:03.750241 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60192a-cd48-4884-8cb0-2234692565c4 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:01:03.750524 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60192a-cd48-4884-8cb0-2234692565c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:01:03.781771 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-2b60192a-cd48-4884-8cb0-2234692565c4 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:01:03.783021 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-2b60192a-cd48-4884-8cb0-2234692565c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:01:03.835938 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1201/2399] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:01:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:01:03.880159 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1199/2400] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:01:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 20:01:03.888359 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f491923-51e0-40ad-9e35-aa75602bedc7 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:01:03.888751 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f491923-51e0-40ad-9e35-aa75602bedc7 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:01:03.888949 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f491923-51e0-40ad-9e35-aa75602bedc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:01:03.921087 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-5f491923-51e0-40ad-9e35-aa75602bedc7 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:01:03.922432 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-5f491923-51e0-40ad-9e35-aa75602bedc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:01:03.938869 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1202/2401] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:01:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:01:03.944511 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60192a-cd48-4884-8cb0-2234692565c4 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:01:03.956706 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60192a-cd48-4884-8cb0-2234692565c4 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:01:03.962177 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b83df1-033b-4dbf-b42e-0d83736fcc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:01:03.962890 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b83df1-033b-4dbf-b42e-0d83736fcc9f admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:01:03.963253 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b83df1-033b-4dbf-b42e-0d83736fcc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:01:03.963535 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b83df1-033b-4dbf-b42e-0d83736fcc9f admin admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:01:03.964206 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b83df1-033b-4dbf-b42e-0d83736fcc9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:01:03.964521 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b83df1-033b-4dbf-b42e-0d83736fcc9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:01:03.966406 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b83df1-033b-4dbf-b42e-0d83736fcc9f admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:01:03.985133 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1200/2402] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 20:01:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:01:03.990199 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f491923-51e0-40ad-9e35-aa75602bedc7 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:01:04.002558 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f491923-51e0-40ad-9e35-aa75602bedc7 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:01:04.007888 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abecb9f7-628a-432d-9c2f-48c416420f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:01:04.008517 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abecb9f7-628a-432d-9c2f-48c416420f04 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:01:04.013715 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abecb9f7-628a-432d-9c2f-48c416420f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:01:04.013715 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abecb9f7-628a-432d-9c2f-48c416420f04 admin admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:01:04.013715 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abecb9f7-628a-432d-9c2f-48c416420f04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:01:04.013715 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abecb9f7-628a-432d-9c2f-48c416420f04 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:01:04.105082 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1203/2403] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 20:01:03 2022] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 20:01:04.110867 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b83df1-033b-4dbf-b42e-0d83736fcc9f admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:01:04.124208 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b83df1-033b-4dbf-b42e-0d83736fcc9f admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:01:04.173224 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:01:04.199594 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa22be6-2bd5-4d84-9c62-56461254fe62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:01:04.210261 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa22be6-2bd5-4d84-9c62-56461254fe62 admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:01:04.210261 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa22be6-2bd5-4d84-9c62-56461254fe62 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:01:04.210261 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa22be6-2bd5-4d84-9c62-56461254fe62 admin admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:01:04.210261 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa22be6-2bd5-4d84-9c62-56461254fe62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:01:04.212945 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa22be6-2bd5-4d84-9c62-56461254fe62 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:01:04.235249 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56df575-1bd9-4e64-aaf9-f4c6d60c74f7 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:01:04.236029 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56df575-1bd9-4e64-aaf9-f4c6d60c74f7 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:01:04.237115 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56df575-1bd9-4e64-aaf9-f4c6d60c74f7 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:01:04.239158 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1204/2404] 10.222.0.60 () {54 vars in 961 bytes} [Sat Sep 24 20:01:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:01:04.245452 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc711a9-d78a-47f3-b94f-26dc34ed2c27 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:01:04.245840 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc711a9-d78a-47f3-b94f-26dc34ed2c27 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:01:04.247082 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc711a9-d78a-47f3-b94f-26dc34ed2c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:01:04.271233 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-6bc711a9-d78a-47f3-b94f-26dc34ed2c27 None None] MFA Rules not processed for user `55f19f1385114fa5a921999747a6666b`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:01:04.272425 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-6bc711a9-d78a-47f3-b94f-26dc34ed2c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:01:04.356174 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1205/2405] 10.222.0.60 () {58 vars in 1058 bytes} [Sat Sep 24 20:01:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 20:01:04.371076 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc711a9-d78a-47f3-b94f-26dc34ed2c27 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:01:04.383658 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc711a9-d78a-47f3-b94f-26dc34ed2c27 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:01:04.390280 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b7c97f-1be4-428d-9d20-d41351fa46b6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f19f1385114fa5a921999747a6666b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:01:04.391125 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7c97f-1be4-428d-9d20-d41351fa46b6 service placement] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:01:04.391584 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7c97f-1be4-428d-9d20-d41351fa46b6 service placement] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:01:04.392060 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7c97f-1be4-428d-9d20-d41351fa46b6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:01:04.393440 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1201/2406] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 20:01:04 2022] POST /identity/v3/users => generated 287 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:01:04.399554 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-84b7c97f-1be4-428d-9d20-d41351fa46b6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:01:04.399690 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa22be6-2bd5-4d84-9c62-56461254fe62 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:01:04.415734 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa22be6-2bd5-4d84-9c62-56461254fe62 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:01:04.422625 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b7c97f-1be4-428d-9d20-d41351fa46b6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:01:04.428343 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b7c97f-1be4-428d-9d20-d41351fa46b6 service placement] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:01:04.429747 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc3f43-def3-44bf-8449-0f7de57ad2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:01:04.432260 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc3f43-def3-44bf-8449-0f7de57ad2e1 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:01:04.433696 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc3f43-def3-44bf-8449-0f7de57ad2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:01:04.433995 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc3f43-def3-44bf-8449-0f7de57ad2e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:01:04.434710 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc3f43-def3-44bf-8449-0f7de57ad2e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:01:04.442777 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc3f43-def3-44bf-8449-0f7de57ad2e1 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:01:04.445394 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1206/2407] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:01:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 20:01:04.482123 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1202/2408] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 20:01:04.486209 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b7c97f-1be4-428d-9d20-d41351fa46b6 service placement] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:01:04.498528 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b7c97f-1be4-428d-9d20-d41351fa46b6 service placement] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:01:04.504108 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd139645-9fea-4922-8366-1d1b4b095835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:01:04.505542 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd139645-9fea-4922-8366-1d1b4b095835 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:01:04.505542 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd139645-9fea-4922-8366-1d1b4b095835 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:01:04.506427 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd139645-9fea-4922-8366-1d1b4b095835 admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:01:04.506809 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd139645-9fea-4922-8366-1d1b4b095835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:01:04.508856 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd139645-9fea-4922-8366-1d1b4b095835 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:01:04.522005 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1207/2409] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:01:04.526031 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc3f43-def3-44bf-8449-0f7de57ad2e1 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:01:04.539163 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc3f43-def3-44bf-8449-0f7de57ad2e1 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:01:04.544395 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3dc789-e986-493b-9e6e-29ce081c1ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:01:04.545172 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3dc789-e986-493b-9e6e-29ce081c1ca3 admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:01:04.545939 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3dc789-e986-493b-9e6e-29ce081c1ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:01:04.545939 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3dc789-e986-493b-9e6e-29ce081c1ca3 admin admin] PATH_INFO: `/v3/projects/899b2ebdfc5748ed96f473f732423979/users/23462c576bfb47f393d06679c3fdfb49/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:01:04.571990 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3dc789-e986-493b-9e6e-29ce081c1ca3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=899b2ebdfc5748ed96f473f732423979, user_id=23462c576bfb47f393d06679c3fdfb49, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:01:04.575066 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3dc789-e986-493b-9e6e-29ce081c1ca3 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:01:04.685822 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1203/2410] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 20:01:04 2022] PUT /identity/v3/projects/899b2ebdfc5748ed96f473f732423979/users/23462c576bfb47f393d06679c3fdfb49/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:01:04.697332 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2a05e-10c0-4b1b-9fc8-f77f24a4cad8 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:01:04.697942 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2a05e-10c0-4b1b-9fc8-f77f24a4cad8 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:01:04.697942 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2a05e-10c0-4b1b-9fc8-f77f24a4cad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:01:04.713070 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:01:04.732329 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-f5a2a05e-10c0-4b1b-9fc8-f77f24a4cad8 None None] MFA Rules not processed for user `23462c576bfb47f393d06679c3fdfb49`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:01:04.734099 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-f5a2a05e-10c0-4b1b-9fc8-f77f24a4cad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:01:04.827339 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1208/2411] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:01:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:01:04.839070 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3dc789-e986-493b-9e6e-29ce081c1ca3 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:01:04.840952 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-6f3dc789-e986-493b-9e6e-29ce081c1ca3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:01:04.906650 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3dc789-e986-493b-9e6e-29ce081c1ca3 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:01:04.911379 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb06073-ac2f-4b54-abfa-30b6f13a43ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:01:04.911843 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb06073-ac2f-4b54-abfa-30b6f13a43ab service cinder] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:01:04.912126 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb06073-ac2f-4b54-abfa-30b6f13a43ab service cinder] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:01:04.912398 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb06073-ac2f-4b54-abfa-30b6f13a43ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:01:04.922372 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb06073-ac2f-4b54-abfa-30b6f13a43ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:01:04.924694 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb06073-ac2f-4b54-abfa-30b6f13a43ab service cinder] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:01:04.935872 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1204/2412] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:01:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:01:04.963317 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a2a05e-10c0-4b1b-9fc8-f77f24a4cad8 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:01:05.030077 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a2a05e-10c0-4b1b-9fc8-f77f24a4cad8 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:01:05.035895 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c409202-d4b4-47b9-93eb-4f980a185e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:01:05.036676 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c409202-d4b4-47b9-93eb-4f980a185e7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:01:05.036960 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c409202-d4b4-47b9-93eb-4f980a185e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:01:05.037232 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c409202-d4b4-47b9-93eb-4f980a185e7f admin admin] PATH_INFO: `/v3/users/23462c576bfb47f393d06679c3fdfb49` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:01:05.038542 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c409202-d4b4-47b9-93eb-4f980a185e7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=23462c576bfb47f393d06679c3fdfb49)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:01:05.040552 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c409202-d4b4-47b9-93eb-4f980a185e7f admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:01:05.241382 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-7c409202-d4b4-47b9-93eb-4f980a185e7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23462c576bfb47f393d06679c3fdfb49'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:01:05.375093 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-7c409202-d4b4-47b9-93eb-4f980a185e7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23462c576bfb47f393d06679c3fdfb49'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:01:05.375703 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-7c409202-d4b4-47b9-93eb-4f980a185e7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23462c576bfb47f393d06679c3fdfb49'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:01:05.376309 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-7c409202-d4b4-47b9-93eb-4f980a185e7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23462c576bfb47f393d06679c3fdfb49'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:01:05.390713 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-7c409202-d4b4-47b9-93eb-4f980a185e7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23462c576bfb47f393d06679c3fdfb49'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:01:05.404516 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1209/2413] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 20:01:04 2022] DELETE /identity/v3/users/23462c576bfb47f393d06679c3fdfb49 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:01:05.409593 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5c7ff-8f39-4334-9909-e04b752009a0 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:01:05.409885 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5c7ff-8f39-4334-9909-e04b752009a0 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:01:05.413757 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5c7ff-8f39-4334-9909-e04b752009a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:01:05.431438 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-36d5c7ff-8f39-4334-9909-e04b752009a0 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:01:05.432806 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-36d5c7ff-8f39-4334-9909-e04b752009a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:01:05.506519 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1205/2414] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:01:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:01:05.523166 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c409202-d4b4-47b9-93eb-4f980a185e7f admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:01:05.524889 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-7c409202-d4b4-47b9-93eb-4f980a185e7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:01:05.585231 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c409202-d4b4-47b9-93eb-4f980a185e7f admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:01:05.588858 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be091695-4778-457c-858d-d69c11804c9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:01:05.589455 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be091695-4778-457c-858d-d69c11804c9d service neutron] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:01:05.589776 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be091695-4778-457c-858d-d69c11804c9d service neutron] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:01:05.590048 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be091695-4778-457c-858d-d69c11804c9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:01:05.604919 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be091695-4778-457c-858d-d69c11804c9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:01:05.606402 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be091695-4778-457c-858d-d69c11804c9d service neutron] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:01:05.619585 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1210/2415] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:01:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:01:05.725335 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:01:06.503789 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d5c7ff-8f39-4334-9909-e04b752009a0 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:01:06.506991 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-36d5c7ff-8f39-4334-9909-e04b752009a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:01:06.525799 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d5c7ff-8f39-4334-9909-e04b752009a0 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:01:06.531675 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083c292a-fb11-4c7a-8969-4231fce224e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:01:06.532473 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c292a-fb11-4c7a-8969-4231fce224e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:01:06.534254 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c292a-fb11-4c7a-8969-4231fce224e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:01:06.534254 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c292a-fb11-4c7a-8969-4231fce224e2 admin admin] PATH_INFO: `/v3/projects/899b2ebdfc5748ed96f473f732423979` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:01:06.535162 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083c292a-fb11-4c7a-8969-4231fce224e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=899b2ebdfc5748ed96f473f732423979)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:01:06.537363 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083c292a-fb11-4c7a-8969-4231fce224e2 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:01:06.649187 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:01:06.665283 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-083c292a-fb11-4c7a-8969-4231fce224e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '899b2ebdfc5748ed96f473f732423979', 'request_id': 'req-083c292a-fb11-4c7a-8969-4231fce224e2'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:01:06.718987 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-083c292a-fb11-4c7a-8969-4231fce224e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '899b2ebdfc5748ed96f473f732423979', 'request_id': 'req-083c292a-fb11-4c7a-8969-4231fce224e2'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:01:06.725970 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-083c292a-fb11-4c7a-8969-4231fce224e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '899b2ebdfc5748ed96f473f732423979', 'request_id': 'req-083c292a-fb11-4c7a-8969-4231fce224e2'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:01:06.739721 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-083c292a-fb11-4c7a-8969-4231fce224e2 admin admin] The token cache is being invalidate because project 899b2ebdfc5748ed96f473f732423979 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 20:01:06.740383 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-083c292a-fb11-4c7a-8969-4231fce224e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:01:06.741399 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-083c292a-fb11-4c7a-8969-4231fce224e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:01:06.743219 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1206/2416] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 20:01:06 2022] DELETE /identity/v3/projects/899b2ebdfc5748ed96f473f732423979 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 20:01:10.311680 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab44556-2f78-4581-b969-decccab1bc3b None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:01:10.312529 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab44556-2f78-4581-b969-decccab1bc3b None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:01:10.313006 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab44556-2f78-4581-b969-decccab1bc3b None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:01:10.315663 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1211/2417] 10.222.0.60 () {54 vars in 921 bytes} [Sat Sep 24 20:01:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:01:10.335426 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87db17d8-8de6-47a6-bc62-0f2296a2f12a None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:01:10.335937 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87db17d8-8de6-47a6-bc62-0f2296a2f12a None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:01:10.335937 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87db17d8-8de6-47a6-bc62-0f2296a2f12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:01:10.377034 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-87db17d8-8de6-47a6-bc62-0f2296a2f12a None None] MFA Rules not processed for user `55f19f1385114fa5a921999747a6666b`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:01:10.378703 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-87db17d8-8de6-47a6-bc62-0f2296a2f12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:01:10.457404 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1207/2418] 10.222.0.60 () {58 vars in 1018 bytes} [Sat Sep 24 20:01:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:01:10.476479 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab44556-2f78-4581-b969-decccab1bc3b None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:01:10.479029 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-eab44556-2f78-4581-b969-decccab1bc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:01:10.500645 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab44556-2f78-4581-b969-decccab1bc3b None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:01:10.502774 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4746814-1fee-4bd5-ae85-2a808aafc742 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f19f1385114fa5a921999747a6666b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:01:10.503594 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4746814-1fee-4bd5-ae85-2a808aafc742 service placement] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:01:10.503876 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4746814-1fee-4bd5-ae85-2a808aafc742 service placement] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:01:10.504163 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4746814-1fee-4bd5-ae85-2a808aafc742 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:01:10.513904 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4746814-1fee-4bd5-ae85-2a808aafc742 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:01:10.515522 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4746814-1fee-4bd5-ae85-2a808aafc742 service placement] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:01:10.527233 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1212/2419] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:01:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:01:11.554608 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6e3bc-fe47-4d70-b7d9-b4acd98041d0 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:01:11.555029 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6e3bc-fe47-4d70-b7d9-b4acd98041d0 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:01:11.555261 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6e3bc-fe47-4d70-b7d9-b4acd98041d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:01:11.575227 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-c1e6e3bc-fe47-4d70-b7d9-b4acd98041d0 None None] MFA Rules not processed for user `c602b5f992104b1fa1daae6dfa9a1531`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:01:11.586076 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-c1e6e3bc-fe47-4d70-b7d9-b4acd98041d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:01:11.669199 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1208/2420] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:01:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:01:15.954713 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4746814-1fee-4bd5-ae85-2a808aafc742 service placement] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:01:15.957884 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-a4746814-1fee-4bd5-ae85-2a808aafc742 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:01:16.036357 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4746814-1fee-4bd5-ae85-2a808aafc742 service placement] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:01:16.041185 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69498cb5-e8f6-4ff1-a819-f7d15ae54e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:01:16.041880 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69498cb5-e8f6-4ff1-a819-f7d15ae54e17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:01:16.042163 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69498cb5-e8f6-4ff1-a819-f7d15ae54e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:01:16.042437 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69498cb5-e8f6-4ff1-a819-f7d15ae54e17 admin admin] PATH_INFO: `/v3/users/3e4db966541843189704c7217036067c` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:01:16.043575 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69498cb5-e8f6-4ff1-a819-f7d15ae54e17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e4db966541843189704c7217036067c)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:01:16.045550 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69498cb5-e8f6-4ff1-a819-f7d15ae54e17 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:01:16.196078 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-69498cb5-e8f6-4ff1-a819-f7d15ae54e17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e4db966541843189704c7217036067c'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:01:16.290413 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-69498cb5-e8f6-4ff1-a819-f7d15ae54e17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e4db966541843189704c7217036067c'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:01:16.291137 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-69498cb5-e8f6-4ff1-a819-f7d15ae54e17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e4db966541843189704c7217036067c'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:01:16.291805 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-69498cb5-e8f6-4ff1-a819-f7d15ae54e17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e4db966541843189704c7217036067c'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:01:16.306732 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-69498cb5-e8f6-4ff1-a819-f7d15ae54e17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e4db966541843189704c7217036067c'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:01:16.320156 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1213/2421] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 20:01:15 2022] DELETE /identity/v3/users/3e4db966541843189704c7217036067c => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:01:16.669617 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e6e3bc-fe47-4d70-b7d9-b4acd98041d0 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:01:16.692970 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e6e3bc-fe47-4d70-b7d9-b4acd98041d0 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:01:16.759705 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b1e25-1b59-4716-9f7d-860a9aebded8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:01:16.760341 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b1e25-1b59-4716-9f7d-860a9aebded8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:01:16.760605 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b1e25-1b59-4716-9f7d-860a9aebded8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:01:16.760871 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b1e25-1b59-4716-9f7d-860a9aebded8 admin admin] PATH_INFO: `/v3/projects/bf05261a41ac4e2389d3c3708022674b` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:01:16.762002 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b1e25-1b59-4716-9f7d-860a9aebded8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf05261a41ac4e2389d3c3708022674b)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:01:16.763883 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b1e25-1b59-4716-9f7d-860a9aebded8 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:01:16.770682 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:01:16.893821 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-6b4b1e25-1b59-4716-9f7d-860a9aebded8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf05261a41ac4e2389d3c3708022674b', 'request_id': 'req-6b4b1e25-1b59-4716-9f7d-860a9aebded8'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:01:16.988434 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-6b4b1e25-1b59-4716-9f7d-860a9aebded8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf05261a41ac4e2389d3c3708022674b', 'request_id': 'req-6b4b1e25-1b59-4716-9f7d-860a9aebded8'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:01:16.994613 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-6b4b1e25-1b59-4716-9f7d-860a9aebded8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf05261a41ac4e2389d3c3708022674b', 'request_id': 'req-6b4b1e25-1b59-4716-9f7d-860a9aebded8'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:01:17.007671 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-6b4b1e25-1b59-4716-9f7d-860a9aebded8 admin admin] The token cache is being invalidate because project bf05261a41ac4e2389d3c3708022674b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 20:01:17.007958 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-6b4b1e25-1b59-4716-9f7d-860a9aebded8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:01:17.008645 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-6b4b1e25-1b59-4716-9f7d-860a9aebded8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:01:17.010196 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1209/2422] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 20:01:16 2022] DELETE /identity/v3/projects/bf05261a41ac4e2389d3c3708022674b => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:01:17.014118 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69498cb5-e8f6-4ff1-a819-f7d15ae54e17 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:01:17.015604 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-69498cb5-e8f6-4ff1-a819-f7d15ae54e17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:01:17.033185 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69498cb5-e8f6-4ff1-a819-f7d15ae54e17 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:01:17.055331 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:01:17.099609 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e993898-ed47-4bcc-8964-1cd444043bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:01:17.100329 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e993898-ed47-4bcc-8964-1cd444043bf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:01:17.101860 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e993898-ed47-4bcc-8964-1cd444043bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:01:17.102155 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e993898-ed47-4bcc-8964-1cd444043bf4 admin admin] PATH_INFO: `/v3/users/a406b3f1785441b894ed53eb9ac3981a` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:01:17.103507 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e993898-ed47-4bcc-8964-1cd444043bf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a406b3f1785441b894ed53eb9ac3981a)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:01:17.105432 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e993898-ed47-4bcc-8964-1cd444043bf4 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:01:17.296146 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-0e993898-ed47-4bcc-8964-1cd444043bf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a406b3f1785441b894ed53eb9ac3981a'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:01:17.818965 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-0e993898-ed47-4bcc-8964-1cd444043bf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a406b3f1785441b894ed53eb9ac3981a'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:01:17.822977 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-0e993898-ed47-4bcc-8964-1cd444043bf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a406b3f1785441b894ed53eb9ac3981a'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:01:17.829817 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-0e993898-ed47-4bcc-8964-1cd444043bf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a406b3f1785441b894ed53eb9ac3981a'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:01:17.855774 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-0e993898-ed47-4bcc-8964-1cd444043bf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a406b3f1785441b894ed53eb9ac3981a'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:01:17.870908 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1214/2423] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 20:01:17 2022] DELETE /identity/v3/users/a406b3f1785441b894ed53eb9ac3981a => generated 0 bytes in 857 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:01:17.915074 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b1e25-1b59-4716-9f7d-860a9aebded8 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:01:17.916703 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-6b4b1e25-1b59-4716-9f7d-860a9aebded8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:01:18.022011 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b1e25-1b59-4716-9f7d-860a9aebded8 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:01:18.082038 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2cd6e2-0a5f-4389-8d50-3dbf3ebaba5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:01:18.082670 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2cd6e2-0a5f-4389-8d50-3dbf3ebaba5d service neutron] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:01:18.082954 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2cd6e2-0a5f-4389-8d50-3dbf3ebaba5d service neutron] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:01:18.083227 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2cd6e2-0a5f-4389-8d50-3dbf3ebaba5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:01:18.085021 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-0c2cd6e2-0a5f-4389-8d50-3dbf3ebaba5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:01:18.162644 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2cd6e2-0a5f-4389-8d50-3dbf3ebaba5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:01:18.164017 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2cd6e2-0a5f-4389-8d50-3dbf3ebaba5d service neutron] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:01:18.169259 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:01:18.187300 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1210/2424] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:01:17 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:01:18.187400 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e993898-ed47-4bcc-8964-1cd444043bf4 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:01:18.187400 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-0e993898-ed47-4bcc-8964-1cd444043bf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:01:18.289652 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e993898-ed47-4bcc-8964-1cd444043bf4 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:01:18.294785 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216dfba5-aae5-4573-bcb1-22296cef84c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:01:18.295450 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216dfba5-aae5-4573-bcb1-22296cef84c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:01:18.295749 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216dfba5-aae5-4573-bcb1-22296cef84c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:01:18.296200 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216dfba5-aae5-4573-bcb1-22296cef84c6 admin admin] PATH_INFO: `/v3/projects/f918f780d4ee4049a26de8f2af019872` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:01:18.297535 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216dfba5-aae5-4573-bcb1-22296cef84c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f918f780d4ee4049a26de8f2af019872)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:01:18.300584 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216dfba5-aae5-4573-bcb1-22296cef84c6 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:01:18.416707 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-216dfba5-aae5-4573-bcb1-22296cef84c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f918f780d4ee4049a26de8f2af019872', 'request_id': 'req-216dfba5-aae5-4573-bcb1-22296cef84c6'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:01:18.426872 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:01:18.433486 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-216dfba5-aae5-4573-bcb1-22296cef84c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f918f780d4ee4049a26de8f2af019872', 'request_id': 'req-216dfba5-aae5-4573-bcb1-22296cef84c6'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:01:18.524564 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-216dfba5-aae5-4573-bcb1-22296cef84c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f918f780d4ee4049a26de8f2af019872', 'request_id': 'req-216dfba5-aae5-4573-bcb1-22296cef84c6'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:01:18.542405 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-216dfba5-aae5-4573-bcb1-22296cef84c6 admin admin] The token cache is being invalidate because project f918f780d4ee4049a26de8f2af019872 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 20:01:18.542977 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-216dfba5-aae5-4573-bcb1-22296cef84c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:01:18.543869 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-216dfba5-aae5-4573-bcb1-22296cef84c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:01:18.545975 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1215/2425] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 20:01:18 2022] DELETE /identity/v3/projects/f918f780d4ee4049a26de8f2af019872 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:01:29.124196 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:DELETE=4,keystone:SELECT=7,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:01:46.497988 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231cdb57-bb9b-4bb9-9b34-90a9dc6a2430 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:01:46.498473 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231cdb57-bb9b-4bb9-9b34-90a9dc6a2430 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:01:46.498554 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231cdb57-bb9b-4bb9-9b34-90a9dc6a2430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:01:46.519164 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-231cdb57-bb9b-4bb9-9b34-90a9dc6a2430 None None] MFA Rules not processed for user `fd597f74abdf49288ea0d92642c6a5a2`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:01:46.520404 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-231cdb57-bb9b-4bb9-9b34-90a9dc6a2430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:01:46.577355 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1211/2426] 10.222.0.60 () {58 vars in 1009 bytes} [Sat Sep 24 20:01:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:01:46.623193 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216dfba5-aae5-4573-bcb1-22296cef84c6 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:01:46.623604 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-216dfba5-aae5-4573-bcb1-22296cef84c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:01:46.711258 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216dfba5-aae5-4573-bcb1-22296cef84c6 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:01:46.716339 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a4c7b-3163-4170-94c6-c6b1a7348ca1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd94cd16acc45e6ac2997204297fb75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:01:46.716946 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a4c7b-3163-4170-94c6-c6b1a7348ca1 service swift] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:01:46.717983 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a4c7b-3163-4170-94c6-c6b1a7348ca1 service swift] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:01:46.717983 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a4c7b-3163-4170-94c6-c6b1a7348ca1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:01:46.725976 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843a4c7b-3163-4170-94c6-c6b1a7348ca1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:01:46.727556 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843a4c7b-3163-4170-94c6-c6b1a7348ca1 service swift] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:01:46.735903 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1216/2427] 10.222.0.60 () {60 vars in 1384 bytes} [Sat Sep 24 20:01:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 24 20:01:47.347764 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75005f44-dae7-46e4-9497-d3fa7db6c824 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:01:47.348245 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75005f44-dae7-46e4-9497-d3fa7db6c824 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:01:47.348544 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75005f44-dae7-46e4-9497-d3fa7db6c824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:01:47.369562 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-75005f44-dae7-46e4-9497-d3fa7db6c824 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:01:47.370824 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-75005f44-dae7-46e4-9497-d3fa7db6c824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:01:47.438626 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1212/2428] 10.222.0.33 () {58 vars in 1016 bytes} [Sat Sep 24 20:01:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:01:47.465074 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a4c7b-3163-4170-94c6-c6b1a7348ca1 service swift] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:01:47.467030 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-843a4c7b-3163-4170-94c6-c6b1a7348ca1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:01:47.551860 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a4c7b-3163-4170-94c6-c6b1a7348ca1 service swift] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:01:47.560188 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df6cfc-f74b-49f5-9fbe-7e22e503bd1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5047a59bc4547be643ffa78808a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:01:47.561084 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df6cfc-f74b-49f5-9fbe-7e22e503bd1b service nova] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:01:47.561481 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df6cfc-f74b-49f5-9fbe-7e22e503bd1b service nova] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:01:47.561952 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df6cfc-f74b-49f5-9fbe-7e22e503bd1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:01:47.572631 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96df6cfc-f74b-49f5-9fbe-7e22e503bd1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:01:47.574582 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96df6cfc-f74b-49f5-9fbe-7e22e503bd1b service nova] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:01:47.586614 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1217/2429] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:01:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:01:53.707881 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda4822-4018-4906-ad3d-1061cf3e442a None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:01:53.708644 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda4822-4018-4906-ad3d-1061cf3e442a None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:01:53.708644 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda4822-4018-4906-ad3d-1061cf3e442a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:01:53.729971 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-dbda4822-4018-4906-ad3d-1061cf3e442a None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:01:53.731287 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-dbda4822-4018-4906-ad3d-1061cf3e442a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:01:53.740514 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1213/2430] 10.222.0.33 () {58 vars in 1016 bytes} [Sat Sep 24 20:01:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:01:53.762234 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df6cfc-f74b-49f5-9fbe-7e22e503bd1b service nova] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:01:53.775284 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df6cfc-f74b-49f5-9fbe-7e22e503bd1b service nova] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:01:53.788798 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f838c87-1c18-4226-962d-ac5429f3601f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5047a59bc4547be643ffa78808a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:01:53.789411 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f838c87-1c18-4226-962d-ac5429f3601f service nova] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:01:53.789730 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f838c87-1c18-4226-962d-ac5429f3601f service nova] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:01:53.790002 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f838c87-1c18-4226-962d-ac5429f3601f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:01:53.800743 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f838c87-1c18-4226-962d-ac5429f3601f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:01:53.803580 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f838c87-1c18-4226-962d-ac5429f3601f service nova] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:01:53.821321 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1218/2431] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:01:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:01:58.336862 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8925eb9-b516-40dd-8e09-54c07561d0b6 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:01:58.338152 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8925eb9-b516-40dd-8e09-54c07561d0b6 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:01:58.338152 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8925eb9-b516-40dd-8e09-54c07561d0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:01:58.380133 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-a8925eb9-b516-40dd-8e09-54c07561d0b6 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:01:58.382766 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-a8925eb9-b516-40dd-8e09-54c07561d0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:01:58.393543 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1214/2432] 10.222.0.33 () {58 vars in 1016 bytes} [Sat Sep 24 20:01:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:01:58.421854 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f838c87-1c18-4226-962d-ac5429f3601f service nova] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:01:58.442250 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f838c87-1c18-4226-962d-ac5429f3601f service nova] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:01:58.460773 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f27bc-cf28-4dc6-ba88-6e8163113bf6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5047a59bc4547be643ffa78808a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:01:58.461406 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f27bc-cf28-4dc6-ba88-6e8163113bf6 service nova] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:01:58.461714 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f27bc-cf28-4dc6-ba88-6e8163113bf6 service nova] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:01:58.461987 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f27bc-cf28-4dc6-ba88-6e8163113bf6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:01:58.480219 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597f27bc-cf28-4dc6-ba88-6e8163113bf6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:01:58.481875 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597f27bc-cf28-4dc6-ba88-6e8163113bf6 service nova] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:01:58.493706 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1219/2433] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:01:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:02:04.111237 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc3af1-5c03-4172-ac5a-20aa613cf80e None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:02:04.111738 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc3af1-5c03-4172-ac5a-20aa613cf80e None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:02:04.111887 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc3af1-5c03-4172-ac5a-20aa613cf80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:02:04.131560 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-92bc3af1-5c03-4172-ac5a-20aa613cf80e None None] MFA Rules not processed for user `fd597f74abdf49288ea0d92642c6a5a2`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:02:04.135628 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-92bc3af1-5c03-4172-ac5a-20aa613cf80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:02:04.139760 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1215/2434] 10.222.0.60 () {58 vars in 967 bytes} [Sat Sep 24 20:02:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:02:04.153020 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f27bc-cf28-4dc6-ba88-6e8163113bf6 service nova] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:02:04.164179 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f27bc-cf28-4dc6-ba88-6e8163113bf6 service nova] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:02:04.169133 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523192e-74e2-46d3-a347-bdf493c680b2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd94cd16acc45e6ac2997204297fb75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:02:04.169734 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523192e-74e2-46d3-a347-bdf493c680b2 service swift] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:02:04.170007 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523192e-74e2-46d3-a347-bdf493c680b2 service swift] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:02:04.170272 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523192e-74e2-46d3-a347-bdf493c680b2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:02:04.178819 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c523192e-74e2-46d3-a347-bdf493c680b2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:02:04.180415 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c523192e-74e2-46d3-a347-bdf493c680b2 service swift] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:02:04.188860 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1220/2435] 10.222.0.60 () {60 vars in 1384 bytes} [Sat Sep 24 20:02:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 24 20:02:04.443453 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e0c91-395c-408a-8a72-58b4acb4919e None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:02:04.443676 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e0c91-395c-408a-8a72-58b4acb4919e None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:02:04.443954 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e0c91-395c-408a-8a72-58b4acb4919e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:02:04.464186 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-a89e0c91-395c-408a-8a72-58b4acb4919e None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:02:04.465384 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-a89e0c91-395c-408a-8a72-58b4acb4919e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:02:04.473308 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1216/2436] 10.222.0.33 () {58 vars in 1016 bytes} [Sat Sep 24 20:02:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:02:04.498734 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523192e-74e2-46d3-a347-bdf493c680b2 service swift] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:02:04.510572 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523192e-74e2-46d3-a347-bdf493c680b2 service swift] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:02:04.516096 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ddcaf-ed60-4036-9636-88610bf0db0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5047a59bc4547be643ffa78808a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:02:04.516687 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ddcaf-ed60-4036-9636-88610bf0db0b service nova] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:02:04.516965 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ddcaf-ed60-4036-9636-88610bf0db0b service nova] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:02:04.517235 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ddcaf-ed60-4036-9636-88610bf0db0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:02:04.526271 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27ddcaf-ed60-4036-9636-88610bf0db0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:02:04.528182 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27ddcaf-ed60-4036-9636-88610bf0db0b service nova] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:02:04.539675 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1221/2437] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:02:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:02:07.188057 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e0c91-395c-408a-8a72-58b4acb4919e None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:02:07.189771 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-a89e0c91-395c-408a-8a72-58b4acb4919e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:02:07.202709 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e0c91-395c-408a-8a72-58b4acb4919e None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:02:07.207923 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bffc66-2d3d-4167-8090-0e0e9bb90446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:02:07.213034 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bffc66-2d3d-4167-8090-0e0e9bb90446 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:02:07.213034 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bffc66-2d3d-4167-8090-0e0e9bb90446 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:02:07.213034 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bffc66-2d3d-4167-8090-0e0e9bb90446 admin admin] PATH_INFO: `/v3/users/c602b5f992104b1fa1daae6dfa9a1531` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:02:07.213034 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bffc66-2d3d-4167-8090-0e0e9bb90446 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c602b5f992104b1fa1daae6dfa9a1531)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:02:07.213034 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bffc66-2d3d-4167-8090-0e0e9bb90446 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:02:07.348437 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-46bffc66-2d3d-4167-8090-0e0e9bb90446 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c602b5f992104b1fa1daae6dfa9a1531'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:02:07.398235 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-46bffc66-2d3d-4167-8090-0e0e9bb90446 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c602b5f992104b1fa1daae6dfa9a1531'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:02:07.398856 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-46bffc66-2d3d-4167-8090-0e0e9bb90446 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c602b5f992104b1fa1daae6dfa9a1531'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:02:07.411361 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-46bffc66-2d3d-4167-8090-0e0e9bb90446 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c602b5f992104b1fa1daae6dfa9a1531'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:02:07.412085 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-46bffc66-2d3d-4167-8090-0e0e9bb90446 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c602b5f992104b1fa1daae6dfa9a1531'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:02:07.415264 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:02:07.427927 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1217/2438] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 20:02:07 2022] DELETE /identity/v3/users/c602b5f992104b1fa1daae6dfa9a1531 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:02:07.719940 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ddcaf-ed60-4036-9636-88610bf0db0b service nova] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:02:07.731534 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ddcaf-ed60-4036-9636-88610bf0db0b service nova] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:02:07.754172 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:02:07.793835 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8981b34c-6eac-4b0d-b027-565801433d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:02:07.794548 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981b34c-6eac-4b0d-b027-565801433d96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:02:07.794734 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981b34c-6eac-4b0d-b027-565801433d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:02:07.795030 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981b34c-6eac-4b0d-b027-565801433d96 admin admin] PATH_INFO: `/v3/projects/8e81b28731444eb68a08d9daa2a5f872` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:02:07.796203 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8981b34c-6eac-4b0d-b027-565801433d96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e81b28731444eb68a08d9daa2a5f872)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:02:07.798222 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8981b34c-6eac-4b0d-b027-565801433d96 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:02:07.906667 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-8981b34c-6eac-4b0d-b027-565801433d96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e81b28731444eb68a08d9daa2a5f872', 'request_id': 'req-8981b34c-6eac-4b0d-b027-565801433d96'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:02:07.913416 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-8981b34c-6eac-4b0d-b027-565801433d96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e81b28731444eb68a08d9daa2a5f872', 'request_id': 'req-8981b34c-6eac-4b0d-b027-565801433d96'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:02:07.980299 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-8981b34c-6eac-4b0d-b027-565801433d96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e81b28731444eb68a08d9daa2a5f872', 'request_id': 'req-8981b34c-6eac-4b0d-b027-565801433d96'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:02:07.991843 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-8981b34c-6eac-4b0d-b027-565801433d96 admin admin] The token cache is being invalidate because project 8e81b28731444eb68a08d9daa2a5f872 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 20:02:07.992243 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-8981b34c-6eac-4b0d-b027-565801433d96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:02:07.992920 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-8981b34c-6eac-4b0d-b027-565801433d96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:02:07.994452 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1222/2439] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 20:02:07 2022] DELETE /identity/v3/projects/8e81b28731444eb68a08d9daa2a5f872 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:02:08.728078 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb049ef2-7981-4bc1-a51d-339e56b8e62a None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:02:08.728589 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb049ef2-7981-4bc1-a51d-339e56b8e62a None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:02:08.728589 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb049ef2-7981-4bc1-a51d-339e56b8e62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:02:08.748970 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-cb049ef2-7981-4bc1-a51d-339e56b8e62a None None] MFA Rules not processed for user `fd597f74abdf49288ea0d92642c6a5a2`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:02:08.750322 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-cb049ef2-7981-4bc1-a51d-339e56b8e62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:02:08.809197 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1218/2440] 10.222.0.60 () {58 vars in 1009 bytes} [Sat Sep 24 20:02:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:02:08.823037 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8981b34c-6eac-4b0d-b027-565801433d96 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:02:08.824580 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-8981b34c-6eac-4b0d-b027-565801433d96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:02:08.894514 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8981b34c-6eac-4b0d-b027-565801433d96 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:02:08.899720 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92091b5-6b8d-431a-a630-c6cb4114dc10 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd94cd16acc45e6ac2997204297fb75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:02:08.900316 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92091b5-6b8d-431a-a630-c6cb4114dc10 service swift] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:02:08.900594 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92091b5-6b8d-431a-a630-c6cb4114dc10 service swift] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:02:08.900867 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92091b5-6b8d-431a-a630-c6cb4114dc10 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:02:08.909072 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92091b5-6b8d-431a-a630-c6cb4114dc10 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:02:08.910725 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92091b5-6b8d-431a-a630-c6cb4114dc10 service swift] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:02:08.919030 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1223/2441] 10.222.0.60 () {60 vars in 1384 bytes} [Sat Sep 24 20:02:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 24 20:02:09.767221 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8bd3b-a91b-4c1a-ac22-6b66ce69a645 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:02:09.767894 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8bd3b-a91b-4c1a-ac22-6b66ce69a645 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:02:09.767894 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8bd3b-a91b-4c1a-ac22-6b66ce69a645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:02:09.796374 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-87f8bd3b-a91b-4c1a-ac22-6b66ce69a645 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:02:09.798092 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-87f8bd3b-a91b-4c1a-ac22-6b66ce69a645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:02:09.887915 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1219/2442] 10.222.0.33 () {58 vars in 1016 bytes} [Sat Sep 24 20:02:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:02:09.968579 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92091b5-6b8d-431a-a630-c6cb4114dc10 service swift] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:02:09.970537 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-f92091b5-6b8d-431a-a630-c6cb4114dc10 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:02:10.029891 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:02:10.063040 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92091b5-6b8d-431a-a630-c6cb4114dc10 service swift] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:02:10.071383 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded0772-9590-4bb8-8cdc-21875e55acec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5047a59bc4547be643ffa78808a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:02:10.071990 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded0772-9590-4bb8-8cdc-21875e55acec service nova] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:02:10.072317 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded0772-9590-4bb8-8cdc-21875e55acec service nova] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:02:10.072591 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded0772-9590-4bb8-8cdc-21875e55acec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:02:10.084150 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fded0772-9590-4bb8-8cdc-21875e55acec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:02:10.087173 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fded0772-9590-4bb8-8cdc-21875e55acec service nova] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:02:10.105369 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1224/2443] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:02:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:02:14.036173 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ee4d7-8b4c-4156-a5a3-1e2e7939a61d None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:02:14.036731 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ee4d7-8b4c-4156-a5a3-1e2e7939a61d None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:02:14.037068 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ee4d7-8b4c-4156-a5a3-1e2e7939a61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:02:14.058178 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-ef5ee4d7-8b4c-4156-a5a3-1e2e7939a61d None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:02:14.059378 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-ef5ee4d7-8b4c-4156-a5a3-1e2e7939a61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:02:14.067109 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1220/2444] 10.222.0.33 () {58 vars in 1016 bytes} [Sat Sep 24 20:02:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:02:14.090744 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded0772-9590-4bb8-8cdc-21875e55acec service nova] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:02:14.103494 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded0772-9590-4bb8-8cdc-21875e55acec service nova] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:02:14.109266 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0ba086-de73-4e96-acea-0e373f56ac69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5047a59bc4547be643ffa78808a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:02:14.110021 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ba086-de73-4e96-acea-0e373f56ac69 service nova] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:02:14.110398 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ba086-de73-4e96-acea-0e373f56ac69 service nova] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:02:14.111405 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ba086-de73-4e96-acea-0e373f56ac69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:02:14.120687 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0ba086-de73-4e96-acea-0e373f56ac69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:02:14.122423 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0ba086-de73-4e96-acea-0e373f56ac69 service nova] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:02:14.133846 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1225/2445] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:02:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:02:24.052649 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=59 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:02:24.128287 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=21 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:02:33.960143 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143edf31-aacd-492d-aced-1ca043e08734 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:02:33.960755 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143edf31-aacd-492d-aced-1ca043e08734 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:02:33.960966 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143edf31-aacd-492d-aced-1ca043e08734 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:02:33.962458 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1221/2446] 10.222.0.60 () {54 vars in 921 bytes} [Sat Sep 24 20:02:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:02:33.968573 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a0bac-8383-446e-ad84-1e49a6656ce2 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:02:33.969886 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a0bac-8383-446e-ad84-1e49a6656ce2 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:02:33.969886 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a0bac-8383-446e-ad84-1e49a6656ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:02:33.992133 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-0a2a0bac-8383-446e-ad84-1e49a6656ce2 None None] MFA Rules not processed for user `f3b5047a59bc4547be643ffa78808a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:02:33.993330 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-0a2a0bac-8383-446e-ad84-1e49a6656ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:02:34.003756 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1226/2447] 10.222.0.60 () {58 vars in 1018 bytes} [Sat Sep 24 20:02:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:02:34.017076 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143edf31-aacd-492d-aced-1ca043e08734 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:02:34.018819 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-143edf31-aacd-492d-aced-1ca043e08734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:02:34.087210 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143edf31-aacd-492d-aced-1ca043e08734 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:02:34.091013 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7b644-ddf6-4ca7-9843-c16439831e4f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaf6ec7f5b4f490aa22a8e3bea91da39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:02:34.091700 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7b644-ddf6-4ca7-9843-c16439831e4f service glance] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:02:34.092026 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7b644-ddf6-4ca7-9843-c16439831e4f service glance] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:02:34.092416 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7b644-ddf6-4ca7-9843-c16439831e4f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:02:34.102952 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af7b644-ddf6-4ca7-9843-c16439831e4f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:02:34.104427 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af7b644-ddf6-4ca7-9843-c16439831e4f service glance] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:02:34.116392 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1222/2448] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:02:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:02:34.405256 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf373c-bdbf-47be-b4c1-482eae347506 None None] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:02:34.405459 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf373c-bdbf-47be-b4c1-482eae347506 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:02:34.405742 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf373c-bdbf-47be-b4c1-482eae347506 None None] PATH_INFO: `/` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:02:34.407079 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1227/2449] 10.222.0.60 () {54 vars in 921 bytes} [Sat Sep 24 20:02:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:02:34.412159 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de410ce-6eee-4927-8f69-d4d62d10907a None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:02:34.412450 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de410ce-6eee-4927-8f69-d4d62d10907a None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:02:34.412727 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de410ce-6eee-4927-8f69-d4d62d10907a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:02:34.432564 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-4de410ce-6eee-4927-8f69-d4d62d10907a None None] MFA Rules not processed for user `fed7dee25fd54255ad24cd6ad880fa3f`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:02:34.434449 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-4de410ce-6eee-4927-8f69-d4d62d10907a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:02:34.490400 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1223/2450] 10.222.0.60 () {58 vars in 1018 bytes} [Sat Sep 24 20:02:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:02:34.503299 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf373c-bdbf-47be-b4c1-482eae347506 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:02:34.505069 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-30bf373c-bdbf-47be-b4c1-482eae347506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:02:34.519235 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf373c-bdbf-47be-b4c1-482eae347506 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:02:34.522898 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146d511-f8f3-4ef6-ac22-c43567ceb7bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:02:34.523607 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146d511-f8f3-4ef6-ac22-c43567ceb7bd service neutron] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:02:34.523980 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146d511-f8f3-4ef6-ac22-c43567ceb7bd service neutron] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:02:34.524342 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146d511-f8f3-4ef6-ac22-c43567ceb7bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:02:34.532479 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0146d511-f8f3-4ef6-ac22-c43567ceb7bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:02:34.534088 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0146d511-f8f3-4ef6-ac22-c43567ceb7bd service neutron] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:02:34.553980 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1228/2451] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:02:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:02:34.646372 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821acbd0-849e-4646-af2c-bc8b16471a19 None None] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:02:34.646569 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821acbd0-849e-4646-af2c-bc8b16471a19 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:02:34.646703 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821acbd0-849e-4646-af2c-bc8b16471a19 None None] PATH_INFO: `/` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:02:34.648353 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1224/2452] 10.222.0.60 () {54 vars in 921 bytes} [Sat Sep 24 20:02:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:02:34.654465 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209bded-dc63-4184-b561-7657021afd8e None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:02:34.654746 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209bded-dc63-4184-b561-7657021afd8e None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:02:34.655016 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209bded-dc63-4184-b561-7657021afd8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:02:34.681819 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-8209bded-dc63-4184-b561-7657021afd8e None None] MFA Rules not processed for user `f3b5047a59bc4547be643ffa78808a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:02:34.682934 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-8209bded-dc63-4184-b561-7657021afd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:02:34.696228 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1229/2453] 10.222.0.60 () {58 vars in 1018 bytes} [Sat Sep 24 20:02:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 20:02:34.707939 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821acbd0-849e-4646-af2c-bc8b16471a19 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:02:34.725281 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821acbd0-849e-4646-af2c-bc8b16471a19 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:02:34.729411 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c36cc4a-74f8-493c-b833-ad0b847a6bdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:02:34.730052 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c36cc4a-74f8-493c-b833-ad0b847a6bdd service neutron] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:02:34.730329 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c36cc4a-74f8-493c-b833-ad0b847a6bdd service neutron] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:02:34.731525 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c36cc4a-74f8-493c-b833-ad0b847a6bdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:02:34.745559 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c36cc4a-74f8-493c-b833-ad0b847a6bdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:02:34.749099 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c36cc4a-74f8-493c-b833-ad0b847a6bdd service neutron] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:02:34.761021 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1225/2454] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:02:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 20:02:37.792878 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de934f8-382f-4c23-816d-fdf4fbb17e22 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:02:37.793452 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de934f8-382f-4c23-816d-fdf4fbb17e22 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:02:37.793452 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de934f8-382f-4c23-816d-fdf4fbb17e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:02:37.812963 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-9de934f8-382f-4c23-816d-fdf4fbb17e22 None None] MFA Rules not processed for user `ddda822166d4473e96c9fc5cb03df4d2`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:02:37.814183 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-9de934f8-382f-4c23-816d-fdf4fbb17e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:02:37.870591 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1230/2455] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:02:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:02:38.740030 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feceec3-7dc9-4962-9067-b2c507f5137c None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:02:38.749899 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feceec3-7dc9-4962-9067-b2c507f5137c None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:02:38.750177 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feceec3-7dc9-4962-9067-b2c507f5137c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:02:38.770251 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-6feceec3-7dc9-4962-9067-b2c507f5137c None None] MFA Rules not processed for user `fd597f74abdf49288ea0d92642c6a5a2`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:02:38.771527 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-6feceec3-7dc9-4962-9067-b2c507f5137c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:02:38.781558 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1226/2456] 10.222.0.60 () {58 vars in 1009 bytes} [Sat Sep 24 20:02:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:02:38.795270 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de934f8-382f-4c23-816d-fdf4fbb17e22 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:02:38.811764 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de934f8-382f-4c23-816d-fdf4fbb17e22 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:02:38.817460 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5255beb1-1343-47f7-8294-987463275b0d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd94cd16acc45e6ac2997204297fb75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:02:38.818343 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255beb1-1343-47f7-8294-987463275b0d service swift] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:02:38.818816 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255beb1-1343-47f7-8294-987463275b0d service swift] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:02:38.819085 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255beb1-1343-47f7-8294-987463275b0d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:02:38.829206 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5255beb1-1343-47f7-8294-987463275b0d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:02:38.831369 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5255beb1-1343-47f7-8294-987463275b0d service swift] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:02:38.842035 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1231/2457] 10.222.0.60 () {60 vars in 1384 bytes} [Sat Sep 24 20:02:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 24 20:02:48.766230 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=58 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:02:48.837608 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=43 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:03:01.751324 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feceec3-7dc9-4962-9067-b2c507f5137c None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:03:01.752780 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-6feceec3-7dc9-4962-9067-b2c507f5137c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:03:01.763873 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feceec3-7dc9-4962-9067-b2c507f5137c None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:03:01.767680 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab4359-7055-40cd-98ed-7bb063ce51b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:03:01.768266 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab4359-7055-40cd-98ed-7bb063ce51b6 service neutron] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:03:01.768544 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab4359-7055-40cd-98ed-7bb063ce51b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:03:01.768813 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab4359-7055-40cd-98ed-7bb063ce51b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:03:01.770516 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-37ab4359-7055-40cd-98ed-7bb063ce51b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:03:01.783693 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ab4359-7055-40cd-98ed-7bb063ce51b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:03:01.785087 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ab4359-7055-40cd-98ed-7bb063ce51b6 service neutron] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:03:01.796014 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1227/2458] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:03:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:03:03.285423 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e1a4b-a28a-4192-843a-50d78ce52b3d None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:03:03.286014 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e1a4b-a28a-4192-843a-50d78ce52b3d None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:03:03.286014 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e1a4b-a28a-4192-843a-50d78ce52b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:03:03.305927 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-3c6e1a4b-a28a-4192-843a-50d78ce52b3d None None] MFA Rules not processed for user `b418518e8d14456d81965247b5e42003`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:03:03.307114 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-3c6e1a4b-a28a-4192-843a-50d78ce52b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:03:03.365153 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1232/2459] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:03:03 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 20:03:05.093536 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364cfb9-bfbe-4896-8eca-814f1a5e3c17 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:03:05.094039 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364cfb9-bfbe-4896-8eca-814f1a5e3c17 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:03:05.094154 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364cfb9-bfbe-4896-8eca-814f1a5e3c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:03:05.121815 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-d364cfb9-bfbe-4896-8eca-814f1a5e3c17 None None] MFA Rules not processed for user `fd597f74abdf49288ea0d92642c6a5a2`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:03:05.123100 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-d364cfb9-bfbe-4896-8eca-814f1a5e3c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:03:05.132254 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1228/2460] 10.222.0.60 () {58 vars in 967 bytes} [Sat Sep 24 20:03:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:03:05.167004 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6e1a4b-a28a-4192-843a-50d78ce52b3d None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:03:05.181391 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6e1a4b-a28a-4192-843a-50d78ce52b3d None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:03:05.187066 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603f703-3b40-423c-9105-516e3de03e63 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd94cd16acc45e6ac2997204297fb75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:03:05.189374 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603f703-3b40-423c-9105-516e3de03e63 service swift] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:03:05.189374 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603f703-3b40-423c-9105-516e3de03e63 service swift] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:03:05.189374 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603f703-3b40-423c-9105-516e3de03e63 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:03:05.208312 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a603f703-3b40-423c-9105-516e3de03e63 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:03:05.212394 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a603f703-3b40-423c-9105-516e3de03e63 service swift] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:03:05.230822 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1233/2461] 10.222.0.60 () {60 vars in 1384 bytes} [Sat Sep 24 20:03:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 24 20:03:15.116727 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=9 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:03:15.223811 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=31 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:03:21.616203 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364cfb9-bfbe-4896-8eca-814f1a5e3c17 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:03:21.632083 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364cfb9-bfbe-4896-8eca-814f1a5e3c17 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:03:21.638525 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5196f-4d1d-44d0-94fc-d982351077df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5047a59bc4547be643ffa78808a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:03:21.639393 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5196f-4d1d-44d0-94fc-d982351077df service nova] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:03:21.639393 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5196f-4d1d-44d0-94fc-d982351077df service nova] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:03:21.639699 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5196f-4d1d-44d0-94fc-d982351077df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:03:21.641455 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-45d5196f-4d1d-44d0-94fc-d982351077df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:03:21.710579 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d5196f-4d1d-44d0-94fc-d982351077df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:03:21.710579 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d5196f-4d1d-44d0-94fc-d982351077df service nova] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:03:21.719501 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1229/2462] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:03:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:03:26.821970 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb15d50-d8d1-4a0a-b97a-4b74bde20b5b None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:03:26.822491 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb15d50-d8d1-4a0a-b97a-4b74bde20b5b None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:03:26.822614 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb15d50-d8d1-4a0a-b97a-4b74bde20b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:03:26.845901 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-1bb15d50-d8d1-4a0a-b97a-4b74bde20b5b None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:03:26.847159 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-1bb15d50-d8d1-4a0a-b97a-4b74bde20b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:03:26.856051 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1234/2463] 10.222.0.33 () {58 vars in 1016 bytes} [Sat Sep 24 20:03:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:03:26.878908 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5196f-4d1d-44d0-94fc-d982351077df service nova] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:03:26.892682 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5196f-4d1d-44d0-94fc-d982351077df service nova] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:03:26.901333 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d068a03-9f9e-4fb7-98b9-c9a1d11b0fa3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5047a59bc4547be643ffa78808a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:03:26.902678 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d068a03-9f9e-4fb7-98b9-c9a1d11b0fa3 service nova] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:03:26.904452 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d068a03-9f9e-4fb7-98b9-c9a1d11b0fa3 service nova] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:03:26.904739 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d068a03-9f9e-4fb7-98b9-c9a1d11b0fa3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:03:26.915774 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d068a03-9f9e-4fb7-98b9-c9a1d11b0fa3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:03:26.918243 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d068a03-9f9e-4fb7-98b9-c9a1d11b0fa3 service nova] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:03:26.930915 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1230/2464] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:03:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:03:32.375301 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90896f63-e8b0-434b-95f6-8d0245bb7fc2 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:03:32.375780 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90896f63-e8b0-434b-95f6-8d0245bb7fc2 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:03:32.375898 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90896f63-e8b0-434b-95f6-8d0245bb7fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:03:32.395595 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-90896f63-e8b0-434b-95f6-8d0245bb7fc2 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:03:32.396781 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-90896f63-e8b0-434b-95f6-8d0245bb7fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:03:32.405212 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1235/2465] 10.222.0.33 () {58 vars in 1016 bytes} [Sat Sep 24 20:03:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:03:32.426501 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d068a03-9f9e-4fb7-98b9-c9a1d11b0fa3 service nova] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:03:32.437894 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d068a03-9f9e-4fb7-98b9-c9a1d11b0fa3 service nova] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:03:32.443254 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33396b04-4838-42f2-871a-8eb162be483a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5047a59bc4547be643ffa78808a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:03:32.443843 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33396b04-4838-42f2-871a-8eb162be483a service nova] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:03:32.444147 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33396b04-4838-42f2-871a-8eb162be483a service nova] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:03:32.444412 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33396b04-4838-42f2-871a-8eb162be483a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:03:32.453736 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33396b04-4838-42f2-871a-8eb162be483a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:03:32.455298 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33396b04-4838-42f2-871a-8eb162be483a service nova] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:03:32.465347 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1231/2466] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:03:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:03:37.372874 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006efad3-656a-4f7e-b8a7-a8b80ee95ecc None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:03:37.373300 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006efad3-656a-4f7e-b8a7-a8b80ee95ecc None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:03:37.373426 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006efad3-656a-4f7e-b8a7-a8b80ee95ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:03:37.394423 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-006efad3-656a-4f7e-b8a7-a8b80ee95ecc None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:03:37.395639 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-006efad3-656a-4f7e-b8a7-a8b80ee95ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:03:37.404409 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1236/2467] 10.222.0.33 () {58 vars in 1016 bytes} [Sat Sep 24 20:03:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:03:37.425732 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33396b04-4838-42f2-871a-8eb162be483a service nova] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:03:37.437482 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33396b04-4838-42f2-871a-8eb162be483a service nova] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:03:37.442929 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1778b5c7-44b6-4050-ac6b-a47a2d7d3e40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5047a59bc4547be643ffa78808a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:03:37.443526 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778b5c7-44b6-4050-ac6b-a47a2d7d3e40 service nova] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:03:37.443805 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778b5c7-44b6-4050-ac6b-a47a2d7d3e40 service nova] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:03:37.444078 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778b5c7-44b6-4050-ac6b-a47a2d7d3e40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:03:37.453302 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1778b5c7-44b6-4050-ac6b-a47a2d7d3e40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:03:37.454912 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1778b5c7-44b6-4050-ac6b-a47a2d7d3e40 service nova] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:03:37.464951 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1232/2468] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:03:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:03:37.624953 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006efad3-656a-4f7e-b8a7-a8b80ee95ecc None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:03:37.641812 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006efad3-656a-4f7e-b8a7-a8b80ee95ecc None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:03:37.647590 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eba896e-645a-455e-bcc5-a4eb3b3d07d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5047a59bc4547be643ffa78808a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:03:37.648134 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba896e-645a-455e-bcc5-a4eb3b3d07d3 service nova] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:03:37.648412 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba896e-645a-455e-bcc5-a4eb3b3d07d3 service nova] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:03:37.648688 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba896e-645a-455e-bcc5-a4eb3b3d07d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:03:37.651598 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-1eba896e-645a-455e-bcc5-a4eb3b3d07d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:03:37.667091 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eba896e-645a-455e-bcc5-a4eb3b3d07d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:03:37.669110 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eba896e-645a-455e-bcc5-a4eb3b3d07d3 service nova] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:03:37.681117 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1237/2469] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:03:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:03:41.672254 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17a4df-c221-4e51-b4bd-43d8181fe744 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:03:41.672802 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17a4df-c221-4e51-b4bd-43d8181fe744 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:03:41.677259 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17a4df-c221-4e51-b4bd-43d8181fe744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:03:41.697860 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-2a17a4df-c221-4e51-b4bd-43d8181fe744 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:03:41.699341 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-2a17a4df-c221-4e51-b4bd-43d8181fe744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:03:41.707675 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1233/2470] 10.222.0.33 () {58 vars in 1016 bytes} [Sat Sep 24 20:03:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:03:41.729912 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eba896e-645a-455e-bcc5-a4eb3b3d07d3 service nova] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:03:41.741031 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eba896e-645a-455e-bcc5-a4eb3b3d07d3 service nova] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:03:41.746557 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912dbe86-ecc2-4b3d-bf61-f00b24ba1912 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5047a59bc4547be643ffa78808a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:03:41.747355 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912dbe86-ecc2-4b3d-bf61-f00b24ba1912 service nova] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:03:41.747630 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912dbe86-ecc2-4b3d-bf61-f00b24ba1912 service nova] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:03:41.747898 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912dbe86-ecc2-4b3d-bf61-f00b24ba1912 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:03:41.756634 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912dbe86-ecc2-4b3d-bf61-f00b24ba1912 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:03:41.758279 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912dbe86-ecc2-4b3d-bf61-f00b24ba1912 service nova] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:03:41.768533 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1238/2471] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:03:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:03:44.466228 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d3c79-132f-4aa5-a5a6-9c176a3422be None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:03:44.466736 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d3c79-132f-4aa5-a5a6-9c176a3422be None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:03:44.466833 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d3c79-132f-4aa5-a5a6-9c176a3422be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:03:44.486356 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-366d3c79-132f-4aa5-a5a6-9c176a3422be None None] MFA Rules not processed for user `d2c1ded5aad545148d3e30f6ce994004`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:03:44.487558 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-366d3c79-132f-4aa5-a5a6-9c176a3422be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:03:44.495102 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1234/2472] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:03:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:03:44.807673 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912dbe86-ecc2-4b3d-bf61-f00b24ba1912 service nova] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:03:44.816890 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912dbe86-ecc2-4b3d-bf61-f00b24ba1912 service nova] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:03:44.820394 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2a2c20-0d24-4cb8-924a-a32ff9d30672 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:03:44.820977 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a2c20-0d24-4cb8-924a-a32ff9d30672 service neutron] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:03:44.821251 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a2c20-0d24-4cb8-924a-a32ff9d30672 service neutron] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:03:44.821540 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a2c20-0d24-4cb8-924a-a32ff9d30672 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:03:44.823896 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-7e2a2c20-0d24-4cb8-924a-a32ff9d30672 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:03:44.833922 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2a2c20-0d24-4cb8-924a-a32ff9d30672 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:03:44.835368 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2a2c20-0d24-4cb8-924a-a32ff9d30672 service neutron] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:03:44.845612 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1239/2473] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:03:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 20:03:45.485806 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d3c79-132f-4aa5-a5a6-9c176a3422be None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:03:45.487528 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-366d3c79-132f-4aa5-a5a6-9c176a3422be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:03:45.492636 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=53 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:03:45.562023 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d3c79-132f-4aa5-a5a6-9c176a3422be None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:03:45.566970 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c30862f-52e7-450f-ad2b-6314be5d195a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f19f1385114fa5a921999747a6666b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:03:45.567580 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30862f-52e7-450f-ad2b-6314be5d195a service placement] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:03:45.567860 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30862f-52e7-450f-ad2b-6314be5d195a service placement] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:03:45.568137 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30862f-52e7-450f-ad2b-6314be5d195a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:03:45.569885 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-4c30862f-52e7-450f-ad2b-6314be5d195a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:03:45.581674 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c30862f-52e7-450f-ad2b-6314be5d195a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:03:45.583240 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c30862f-52e7-450f-ad2b-6314be5d195a service placement] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:03:45.593451 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1235/2474] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:03:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:03:46.944564 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0d830-0fe2-4e5d-a98c-85110d7dfbcf None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:03:46.945101 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0d830-0fe2-4e5d-a98c-85110d7dfbcf None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:03:46.945219 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0d830-0fe2-4e5d-a98c-85110d7dfbcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:03:46.965385 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-27a0d830-0fe2-4e5d-a98c-85110d7dfbcf None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:03:46.968531 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-27a0d830-0fe2-4e5d-a98c-85110d7dfbcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:03:46.974636 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1240/2475] 10.222.0.33 () {58 vars in 1016 bytes} [Sat Sep 24 20:03:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:03:46.996212 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c30862f-52e7-450f-ad2b-6314be5d195a service placement] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:03:47.008355 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c30862f-52e7-450f-ad2b-6314be5d195a service placement] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:03:47.014614 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16775f40-24fb-4ca5-9ee8-df7b47760088 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5047a59bc4547be643ffa78808a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:03:47.015206 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16775f40-24fb-4ca5-9ee8-df7b47760088 service nova] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:03:47.015481 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16775f40-24fb-4ca5-9ee8-df7b47760088 service nova] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:03:47.015747 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16775f40-24fb-4ca5-9ee8-df7b47760088 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:03:47.024061 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16775f40-24fb-4ca5-9ee8-df7b47760088 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:03:47.025680 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16775f40-24fb-4ca5-9ee8-df7b47760088 service nova] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:03:47.036012 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1236/2476] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:03:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:03:50.626428 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a0d830-0fe2-4e5d-a98c-85110d7dfbcf None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:03:50.636212 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a0d830-0fe2-4e5d-a98c-85110d7dfbcf None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:03:50.640968 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923dcf8-ab61-4092-94b3-554c8654e3c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:03:50.641618 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923dcf8-ab61-4092-94b3-554c8654e3c4 service neutron] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:03:50.641903 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923dcf8-ab61-4092-94b3-554c8654e3c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:03:50.642177 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923dcf8-ab61-4092-94b3-554c8654e3c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:03:50.643892 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-8923dcf8-ab61-4092-94b3-554c8654e3c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:03:50.653588 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8923dcf8-ab61-4092-94b3-554c8654e3c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:03:50.655619 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8923dcf8-ab61-4092-94b3-554c8654e3c4 service neutron] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:03:50.663911 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1241/2477] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:03:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:03:57.031936 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=37 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:03:59.474649 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16775f40-24fb-4ca5-9ee8-df7b47760088 service nova] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:03:59.486485 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16775f40-24fb-4ca5-9ee8-df7b47760088 service nova] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:03:59.492192 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b60bb4-d0fc-454a-b6ec-33955aca4151 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5047a59bc4547be643ffa78808a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:03:59.492816 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b60bb4-d0fc-454a-b6ec-33955aca4151 service nova] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:03:59.493100 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b60bb4-d0fc-454a-b6ec-33955aca4151 service nova] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:03:59.493372 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b60bb4-d0fc-454a-b6ec-33955aca4151 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:03:59.495149 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-44b60bb4-d0fc-454a-b6ec-33955aca4151 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:03:59.507667 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b60bb4-d0fc-454a-b6ec-33955aca4151 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:03:59.509286 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b60bb4-d0fc-454a-b6ec-33955aca4151 service nova] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:03:59.520114 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1237/2478] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:03:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:04:00.660077 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=36 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:04:01.613222 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923dcf8-ab61-4092-94b3-554c8654e3c4 service neutron] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:04:01.626458 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923dcf8-ab61-4092-94b3-554c8654e3c4 service neutron] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:04:01.631813 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccffda62-e4c7-4692-9fd4-7edeb30d6f1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5047a59bc4547be643ffa78808a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:04:01.632404 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccffda62-e4c7-4692-9fd4-7edeb30d6f1c service nova] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:04:01.632679 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccffda62-e4c7-4692-9fd4-7edeb30d6f1c service nova] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:04:01.632946 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccffda62-e4c7-4692-9fd4-7edeb30d6f1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:04:01.634740 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-ccffda62-e4c7-4692-9fd4-7edeb30d6f1c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:04:01.647239 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccffda62-e4c7-4692-9fd4-7edeb30d6f1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:04:01.648828 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccffda62-e4c7-4692-9fd4-7edeb30d6f1c service nova] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:04:01.659741 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1242/2479] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:04:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:04:09.515789 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=6 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:04:11.654783 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=6 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:04:19.281737 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b60bb4-d0fc-454a-b6ec-33955aca4151 service nova] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:04:19.283144 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-44b60bb4-d0fc-454a-b6ec-33955aca4151 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:04:19.343389 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b60bb4-d0fc-454a-b6ec-33955aca4151 service nova] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:04:19.348369 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79051fd2-e164-47e4-bb8d-015478a5280e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:04:19.349041 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79051fd2-e164-47e4-bb8d-015478a5280e service cinder] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:04:19.349327 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79051fd2-e164-47e4-bb8d-015478a5280e service cinder] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:04:19.349625 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79051fd2-e164-47e4-bb8d-015478a5280e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:04:19.351401 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-79051fd2-e164-47e4-bb8d-015478a5280e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:04:19.363929 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79051fd2-e164-47e4-bb8d-015478a5280e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:04:19.365398 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79051fd2-e164-47e4-bb8d-015478a5280e service cinder] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:04:19.374987 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1238/2480] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:04:19 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:04:29.370320 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=26 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:04:29.560156 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccffda62-e4c7-4692-9fd4-7edeb30d6f1c service nova] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:04:29.562312 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-ccffda62-e4c7-4692-9fd4-7edeb30d6f1c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:04:29.575932 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccffda62-e4c7-4692-9fd4-7edeb30d6f1c service nova] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:04:29.580854 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ab2488-7aa0-46a3-a5d6-c1b360d2cff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:04:29.582123 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab2488-7aa0-46a3-a5d6-c1b360d2cff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:04:29.582446 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab2488-7aa0-46a3-a5d6-c1b360d2cff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:04:29.582722 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab2488-7aa0-46a3-a5d6-c1b360d2cff6 admin admin] PATH_INFO: `/v3/users/ddda822166d4473e96c9fc5cb03df4d2` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:04:29.583985 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ab2488-7aa0-46a3-a5d6-c1b360d2cff6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddda822166d4473e96c9fc5cb03df4d2)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:04:29.585920 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ab2488-7aa0-46a3-a5d6-c1b360d2cff6 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:04:29.801532 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-b3ab2488-7aa0-46a3-a5d6-c1b360d2cff6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddda822166d4473e96c9fc5cb03df4d2'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:04:29.941109 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-b3ab2488-7aa0-46a3-a5d6-c1b360d2cff6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddda822166d4473e96c9fc5cb03df4d2'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:04:29.941708 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-b3ab2488-7aa0-46a3-a5d6-c1b360d2cff6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddda822166d4473e96c9fc5cb03df4d2'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:04:29.942366 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-b3ab2488-7aa0-46a3-a5d6-c1b360d2cff6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddda822166d4473e96c9fc5cb03df4d2'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:04:29.959064 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-b3ab2488-7aa0-46a3-a5d6-c1b360d2cff6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddda822166d4473e96c9fc5cb03df4d2'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:04:29.978942 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1243/2481] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 20:04:29 2022] DELETE /identity/v3/users/ddda822166d4473e96c9fc5cb03df4d2 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:04:30.497007 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79051fd2-e164-47e4-bb8d-015478a5280e service cinder] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:04:30.513843 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79051fd2-e164-47e4-bb8d-015478a5280e service cinder] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:04:30.603298 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00687e08-7585-482f-b08e-229eea5f70dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:04:30.604180 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00687e08-7585-482f-b08e-229eea5f70dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:04:30.604643 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00687e08-7585-482f-b08e-229eea5f70dd admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:04:30.604920 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00687e08-7585-482f-b08e-229eea5f70dd admin admin] PATH_INFO: `/v3/projects/8dcda96696f847b489c52544964275cc` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:04:30.606156 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00687e08-7585-482f-b08e-229eea5f70dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dcda96696f847b489c52544964275cc)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:04:30.610032 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00687e08-7585-482f-b08e-229eea5f70dd admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:04:30.759455 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-00687e08-7585-482f-b08e-229eea5f70dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dcda96696f847b489c52544964275cc', 'request_id': 'req-00687e08-7585-482f-b08e-229eea5f70dd'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:04:30.842816 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-00687e08-7585-482f-b08e-229eea5f70dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dcda96696f847b489c52544964275cc', 'request_id': 'req-00687e08-7585-482f-b08e-229eea5f70dd'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:04:30.850056 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-00687e08-7585-482f-b08e-229eea5f70dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dcda96696f847b489c52544964275cc', 'request_id': 'req-00687e08-7585-482f-b08e-229eea5f70dd'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:04:30.863999 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-00687e08-7585-482f-b08e-229eea5f70dd admin admin] The token cache is being invalidate because project 8dcda96696f847b489c52544964275cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 20:04:30.864287 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-00687e08-7585-482f-b08e-229eea5f70dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:04:30.864942 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-00687e08-7585-482f-b08e-229eea5f70dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:04:30.866504 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1239/2482] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 20:04:30 2022] DELETE /identity/v3/projects/8dcda96696f847b489c52544964275cc => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:04:31.208290 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ec0ad-1c03-4954-bd97-85c07bce7674 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:04:31.210987 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ec0ad-1c03-4954-bd97-85c07bce7674 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:04:31.210987 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ec0ad-1c03-4954-bd97-85c07bce7674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:04:31.228874 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-3c9ec0ad-1c03-4954-bd97-85c07bce7674 None None] MFA Rules not processed for user `f8bf9edbcb314286a4fc23f151062854`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:04:31.230112 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-3c9ec0ad-1c03-4954-bd97-85c07bce7674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:04:31.286142 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1244/2483] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:04:31 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:04:31.297951 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00687e08-7585-482f-b08e-229eea5f70dd admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:04:31.299356 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-00687e08-7585-482f-b08e-229eea5f70dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:04:31.375076 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00687e08-7585-482f-b08e-229eea5f70dd admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:04:31.380494 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5908defa-622d-43ed-a103-ed0b37b150c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5047a59bc4547be643ffa78808a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:04:31.381207 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908defa-622d-43ed-a103-ed0b37b150c1 service nova] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:04:31.381381 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908defa-622d-43ed-a103-ed0b37b150c1 service nova] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:04:31.381665 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908defa-622d-43ed-a103-ed0b37b150c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:04:31.383519 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-5908defa-622d-43ed-a103-ed0b37b150c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:04:31.394521 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5908defa-622d-43ed-a103-ed0b37b150c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:04:31.396127 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5908defa-622d-43ed-a103-ed0b37b150c1 service nova] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:04:31.405107 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1240/2484] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:04:31 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:04:41.278735 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=54,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:04:41.401004 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=85,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:04:49.842409 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76079da-e7e2-4d03-8423-3f9bbe8bcfdf None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:04:49.843289 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76079da-e7e2-4d03-8423-3f9bbe8bcfdf None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:04:49.843563 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76079da-e7e2-4d03-8423-3f9bbe8bcfdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:04:49.864709 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-d76079da-e7e2-4d03-8423-3f9bbe8bcfdf None None] MFA Rules not processed for user `fd597f74abdf49288ea0d92642c6a5a2`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:04:49.866171 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-d76079da-e7e2-4d03-8423-3f9bbe8bcfdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:04:49.929606 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1245/2485] 10.222.0.60 () {58 vars in 967 bytes} [Sat Sep 24 20:04:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:04:50.039912 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5908defa-622d-43ed-a103-ed0b37b150c1 service nova] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:04:50.041447 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-5908defa-622d-43ed-a103-ed0b37b150c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:04:50.086161 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76079da-e7e2-4d03-8423-3f9bbe8bcfdf None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:04:50.087665 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-d76079da-e7e2-4d03-8423-3f9bbe8bcfdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:04:50.107875 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5908defa-622d-43ed-a103-ed0b37b150c1 service nova] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:04:50.112182 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52134b11-d79a-4de3-8df5-7ee9d68d17c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:04:50.112823 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52134b11-d79a-4de3-8df5-7ee9d68d17c7 service neutron] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:04:50.113103 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52134b11-d79a-4de3-8df5-7ee9d68d17c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:04:50.113975 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52134b11-d79a-4de3-8df5-7ee9d68d17c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:04:50.116209 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-52134b11-d79a-4de3-8df5-7ee9d68d17c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:04:50.172229 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76079da-e7e2-4d03-8423-3f9bbe8bcfdf None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:04:50.178093 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d2ce75-f6d0-4028-93a4-d7c98282d044 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd94cd16acc45e6ac2997204297fb75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:04:50.178918 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2ce75-f6d0-4028-93a4-d7c98282d044 service swift] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:04:50.179536 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2ce75-f6d0-4028-93a4-d7c98282d044 service swift] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:04:50.179948 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2ce75-f6d0-4028-93a4-d7c98282d044 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:04:50.189712 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d2ce75-f6d0-4028-93a4-d7c98282d044 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:04:50.191729 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d2ce75-f6d0-4028-93a4-d7c98282d044 service swift] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:04:50.203056 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1246/2486] 10.222.0.60 () {60 vars in 1384 bytes} [Sat Sep 24 20:04:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 24 20:04:50.222302 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52134b11-d79a-4de3-8df5-7ee9d68d17c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:04:50.224954 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52134b11-d79a-4de3-8df5-7ee9d68d17c7 service neutron] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:04:50.238661 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1241/2487] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:04:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:04:54.165106 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d2ce75-f6d0-4028-93a4-d7c98282d044 service swift] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:04:54.167299 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-48d2ce75-f6d0-4028-93a4-d7c98282d044 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:04:54.185663 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d2ce75-f6d0-4028-93a4-d7c98282d044 service swift] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:04:54.190280 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353fd5c8-0b87-4c57-96e1-5e2df59d585d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:04:54.190913 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353fd5c8-0b87-4c57-96e1-5e2df59d585d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:04:54.191732 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353fd5c8-0b87-4c57-96e1-5e2df59d585d admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:04:54.192013 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353fd5c8-0b87-4c57-96e1-5e2df59d585d admin admin] PATH_INFO: `/v3/users/b418518e8d14456d81965247b5e42003` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:04:54.193274 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353fd5c8-0b87-4c57-96e1-5e2df59d585d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b418518e8d14456d81965247b5e42003)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:04:54.195254 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353fd5c8-0b87-4c57-96e1-5e2df59d585d admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:04:54.289282 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52134b11-d79a-4de3-8df5-7ee9d68d17c7 service neutron] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:04:54.290840 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-52134b11-d79a-4de3-8df5-7ee9d68d17c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:04:54.302194 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52134b11-d79a-4de3-8df5-7ee9d68d17c7 service neutron] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:04:54.305982 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f1084-9a07-452f-991d-ee37875864cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:04:54.306733 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f1084-9a07-452f-991d-ee37875864cd service neutron] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:04:54.307029 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f1084-9a07-452f-991d-ee37875864cd service neutron] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:04:54.307301 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f1084-9a07-452f-991d-ee37875864cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:04:54.309057 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-c71f1084-9a07-452f-991d-ee37875864cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:04:54.321419 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71f1084-9a07-452f-991d-ee37875864cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:04:54.322874 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71f1084-9a07-452f-991d-ee37875864cd service neutron] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:04:54.333612 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1242/2488] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:04:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 20:04:54.384908 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-353fd5c8-0b87-4c57-96e1-5e2df59d585d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b418518e8d14456d81965247b5e42003'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:04:54.465157 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-353fd5c8-0b87-4c57-96e1-5e2df59d585d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b418518e8d14456d81965247b5e42003'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:04:54.466056 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-353fd5c8-0b87-4c57-96e1-5e2df59d585d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b418518e8d14456d81965247b5e42003'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:04:54.468955 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-353fd5c8-0b87-4c57-96e1-5e2df59d585d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b418518e8d14456d81965247b5e42003'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:04:54.490043 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-353fd5c8-0b87-4c57-96e1-5e2df59d585d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b418518e8d14456d81965247b5e42003'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:04:54.507408 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1247/2489] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 20:04:54 2022] DELETE /identity/v3/users/b418518e8d14456d81965247b5e42003 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:04:54.844387 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f1084-9a07-452f-991d-ee37875864cd service neutron] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:04:54.856696 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f1084-9a07-452f-991d-ee37875864cd service neutron] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:04:54.928375 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e4d2c5-5647-4252-a779-7809030db4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:04:54.929120 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4d2c5-5647-4252-a779-7809030db4e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:04:54.929472 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4d2c5-5647-4252-a779-7809030db4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:04:54.929861 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4d2c5-5647-4252-a779-7809030db4e4 admin admin] PATH_INFO: `/v3/projects/803d5cd8d67842f79d6d5e909e4b29fd` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:04:54.931091 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e4d2c5-5647-4252-a779-7809030db4e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=803d5cd8d67842f79d6d5e909e4b29fd)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:04:54.933327 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e4d2c5-5647-4252-a779-7809030db4e4 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:04:55.082940 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:04:55.103422 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-80e4d2c5-5647-4252-a779-7809030db4e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '803d5cd8d67842f79d6d5e909e4b29fd', 'request_id': 'req-80e4d2c5-5647-4252-a779-7809030db4e4'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:04:55.194022 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-80e4d2c5-5647-4252-a779-7809030db4e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '803d5cd8d67842f79d6d5e909e4b29fd', 'request_id': 'req-80e4d2c5-5647-4252-a779-7809030db4e4'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:04:55.205392 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-80e4d2c5-5647-4252-a779-7809030db4e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '803d5cd8d67842f79d6d5e909e4b29fd', 'request_id': 'req-80e4d2c5-5647-4252-a779-7809030db4e4'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:04:55.224126 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-80e4d2c5-5647-4252-a779-7809030db4e4 admin admin] The token cache is being invalidate because project 803d5cd8d67842f79d6d5e909e4b29fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 20:04:55.234416 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-80e4d2c5-5647-4252-a779-7809030db4e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:04:55.234416 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-80e4d2c5-5647-4252-a779-7809030db4e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:04:55.234416 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1243/2490] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 20:04:54 2022] DELETE /identity/v3/projects/803d5cd8d67842f79d6d5e909e4b29fd => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:04:55.234753 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ac674-8798-4725-abc5-c77d4e2051de None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:04:55.234753 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ac674-8798-4725-abc5-c77d4e2051de None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:04:55.234753 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ac674-8798-4725-abc5-c77d4e2051de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:04:55.255523 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:04:55.267939 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-507ac674-8798-4725-abc5-c77d4e2051de None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:04:55.270010 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-507ac674-8798-4725-abc5-c77d4e2051de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:04:55.345900 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1248/2491] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:04:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:04:55.354078 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062918ba-f688-4ea9-be12-1a684d9f3fcf None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:04:55.356873 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062918ba-f688-4ea9-be12-1a684d9f3fcf None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:04:55.356873 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062918ba-f688-4ea9-be12-1a684d9f3fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:04:55.378397 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-062918ba-f688-4ea9-be12-1a684d9f3fcf None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:04:55.380414 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-062918ba-f688-4ea9-be12-1a684d9f3fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:04:55.388186 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1244/2492] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:04:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:04:55.392475 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ac674-8798-4725-abc5-c77d4e2051de None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:04:55.402399 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ac674-8798-4725-abc5-c77d4e2051de None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:04:55.406895 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bd1b21-85f2-47b3-885d-969ebac5711a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:04:55.407485 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd1b21-85f2-47b3-885d-969ebac5711a admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:04:55.407759 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd1b21-85f2-47b3-885d-969ebac5711a admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:04:55.408028 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd1b21-85f2-47b3-885d-969ebac5711a admin admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:04:55.408658 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bd1b21-85f2-47b3-885d-969ebac5711a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:04:55.408954 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bd1b21-85f2-47b3-885d-969ebac5711a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:04:55.410702 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bd1b21-85f2-47b3-885d-969ebac5711a admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:04:55.422223 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1249/2493] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 20:04:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:04:55.429634 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062918ba-f688-4ea9-be12-1a684d9f3fcf None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:04:55.438677 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062918ba-f688-4ea9-be12-1a684d9f3fcf None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:04:55.444378 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff74f5f-1231-4825-8d4e-3df85c610a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:04:55.444978 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff74f5f-1231-4825-8d4e-3df85c610a51 admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:04:55.445363 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff74f5f-1231-4825-8d4e-3df85c610a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:04:55.445539 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff74f5f-1231-4825-8d4e-3df85c610a51 admin admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:04:55.446175 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff74f5f-1231-4825-8d4e-3df85c610a51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:04:55.448065 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff74f5f-1231-4825-8d4e-3df85c610a51 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:04:55.571846 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1245/2494] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 20:04:55 2022] POST /identity/v3/projects => generated 371 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:04:55.576000 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bd1b21-85f2-47b3-885d-969ebac5711a admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:04:55.587083 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bd1b21-85f2-47b3-885d-969ebac5711a admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:04:55.649914 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77868b5f-88df-4944-b4a2-519f9b773bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:04:55.650546 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77868b5f-88df-4944-b4a2-519f9b773bba admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:04:55.650991 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77868b5f-88df-4944-b4a2-519f9b773bba admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:04:55.651275 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77868b5f-88df-4944-b4a2-519f9b773bba admin admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:04:55.651925 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77868b5f-88df-4944-b4a2-519f9b773bba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:04:55.653965 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77868b5f-88df-4944-b4a2-519f9b773bba admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:04:55.760105 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1250/2495] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 20:04:55 2022] POST /identity/v3/users => generated 286 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:04:55.761343 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff74f5f-1231-4825-8d4e-3df85c610a51 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:04:55.772687 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff74f5f-1231-4825-8d4e-3df85c610a51 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:04:55.777563 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5826a3-363b-4f11-b67e-f88883e15fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:04:55.778169 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5826a3-363b-4f11-b67e-f88883e15fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:04:55.778446 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5826a3-363b-4f11-b67e-f88883e15fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:04:55.778715 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5826a3-363b-4f11-b67e-f88883e15fd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:04:55.779355 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5826a3-363b-4f11-b67e-f88883e15fd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:04:55.781008 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5826a3-363b-4f11-b67e-f88883e15fd6 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:04:55.797065 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1246/2496] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:04:55.798600 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77868b5f-88df-4944-b4a2-519f9b773bba admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:04:55.809426 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77868b5f-88df-4944-b4a2-519f9b773bba admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:04:55.814137 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d5430a-23f5-43a1-9fbb-4e8eda54a4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:04:55.814734 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5430a-23f5-43a1-9fbb-4e8eda54a4cf admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:04:55.815017 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5430a-23f5-43a1-9fbb-4e8eda54a4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:04:55.815291 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5430a-23f5-43a1-9fbb-4e8eda54a4cf admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:04:55.815962 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d5430a-23f5-43a1-9fbb-4e8eda54a4cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:04:55.817883 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d5430a-23f5-43a1-9fbb-4e8eda54a4cf admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:04:55.829332 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1251/2497] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:04:55.833883 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5826a3-363b-4f11-b67e-f88883e15fd6 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:04:55.843990 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5826a3-363b-4f11-b67e-f88883e15fd6 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:04:55.849466 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91a221-3006-4a25-b69e-ac6e180fcc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:04:55.851855 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91a221-3006-4a25-b69e-ac6e180fcc6f admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:04:55.851855 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91a221-3006-4a25-b69e-ac6e180fcc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:04:55.851855 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91a221-3006-4a25-b69e-ac6e180fcc6f admin admin] PATH_INFO: `/v3/projects/38ad8b0062f342309c382c3773643e72/users/193cfad1a0bf46ec91aadf03ae328fe7/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:04:55.867943 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad91a221-3006-4a25-b69e-ac6e180fcc6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=38ad8b0062f342309c382c3773643e72, user_id=193cfad1a0bf46ec91aadf03ae328fe7, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:04:55.871848 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad91a221-3006-4a25-b69e-ac6e180fcc6f admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:04:55.948706 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1247/2498] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 20:04:55 2022] PUT /identity/v3/projects/38ad8b0062f342309c382c3773643e72/users/193cfad1a0bf46ec91aadf03ae328fe7/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:04:55.960960 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4d772-a8b5-48c9-a5e3-c0fff3c3d353 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:04:55.961258 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4d772-a8b5-48c9-a5e3-c0fff3c3d353 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:04:55.961553 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4d772-a8b5-48c9-a5e3-c0fff3c3d353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:04:55.990403 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-2ab4d772-a8b5-48c9-a5e3-c0fff3c3d353 None None] MFA Rules not processed for user `193cfad1a0bf46ec91aadf03ae328fe7`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:04:55.991616 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-2ab4d772-a8b5-48c9-a5e3-c0fff3c3d353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:04:56.057625 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1252/2499] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:04:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 20:04:56.068582 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91a221-3006-4a25-b69e-ac6e180fcc6f admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:04:56.072672 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-ad91a221-3006-4a25-b69e-ac6e180fcc6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:04:56.151089 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91a221-3006-4a25-b69e-ac6e180fcc6f admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:04:56.156847 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bee8f25-4a07-4935-82d7-3c079f92f8ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5047a59bc4547be643ffa78808a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:04:56.157457 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee8f25-4a07-4935-82d7-3c079f92f8ab service nova] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:04:56.157770 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee8f25-4a07-4935-82d7-3c079f92f8ab service nova] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:04:56.158097 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee8f25-4a07-4935-82d7-3c079f92f8ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:04:56.167091 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bee8f25-4a07-4935-82d7-3c079f92f8ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:04:56.168678 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bee8f25-4a07-4935-82d7-3c079f92f8ab service nova] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:04:56.178717 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1248/2500] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:04:56 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:04:59.040746 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4d772-a8b5-48c9-a5e3-c0fff3c3d353 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:04:59.042159 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-2ab4d772-a8b5-48c9-a5e3-c0fff3c3d353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:04:59.047268 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:04:59.114966 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4d772-a8b5-48c9-a5e3-c0fff3c3d353 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:04:59.120178 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be563d04-6a0d-41b1-8ca7-5f4c53acb1f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f19f1385114fa5a921999747a6666b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:04:59.120777 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be563d04-6a0d-41b1-8ca7-5f4c53acb1f8 service placement] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:04:59.121054 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be563d04-6a0d-41b1-8ca7-5f4c53acb1f8 service placement] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:04:59.121322 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be563d04-6a0d-41b1-8ca7-5f4c53acb1f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:04:59.123156 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-be563d04-6a0d-41b1-8ca7-5f4c53acb1f8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:04:59.134572 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be563d04-6a0d-41b1-8ca7-5f4c53acb1f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:04:59.136252 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be563d04-6a0d-41b1-8ca7-5f4c53acb1f8 service placement] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:04:59.146921 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1253/2501] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:04:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:04:59.187720 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bee8f25-4a07-4935-82d7-3c079f92f8ab service nova] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:04:59.189192 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-1bee8f25-4a07-4935-82d7-3c079f92f8ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:04:59.241309 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:04:59.256374 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bee8f25-4a07-4935-82d7-3c079f92f8ab service nova] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:04:59.260851 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f022aac5-2d4d-4d9b-95ae-23220bc9d9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:04:59.261993 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022aac5-2d4d-4d9b-95ae-23220bc9d9b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:04:59.261993 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022aac5-2d4d-4d9b-95ae-23220bc9d9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:04:59.262187 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022aac5-2d4d-4d9b-95ae-23220bc9d9b6 admin admin] PATH_INFO: `/v3/users/3843949a2f6d41a295f56d5697733d5f` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:04:59.263220 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f022aac5-2d4d-4d9b-95ae-23220bc9d9b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3843949a2f6d41a295f56d5697733d5f)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:04:59.265116 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f022aac5-2d4d-4d9b-95ae-23220bc9d9b6 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:04:59.436364 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be563d04-6a0d-41b1-8ca7-5f4c53acb1f8 service placement] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:04:59.446052 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be563d04-6a0d-41b1-8ca7-5f4c53acb1f8 service placement] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:04:59.450878 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ca489-beb2-4325-8991-64518ba6251a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:04:59.451979 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ca489-beb2-4325-8991-64518ba6251a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:04:59.452257 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ca489-beb2-4325-8991-64518ba6251a admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:04:59.452532 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ca489-beb2-4325-8991-64518ba6251a admin admin] PATH_INFO: `/v3/users/193cfad1a0bf46ec91aadf03ae328fe7` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:04:59.453694 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04ca489-beb2-4325-8991-64518ba6251a admin admin] RBAC: Authorizing `identity:delete_user(user_id=193cfad1a0bf46ec91aadf03ae328fe7)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:04:59.455611 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04ca489-beb2-4325-8991-64518ba6251a admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:04:59.467378 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-f022aac5-2d4d-4d9b-95ae-23220bc9d9b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3843949a2f6d41a295f56d5697733d5f'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:04:59.545449 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-f022aac5-2d4d-4d9b-95ae-23220bc9d9b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3843949a2f6d41a295f56d5697733d5f'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:04:59.546147 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-f022aac5-2d4d-4d9b-95ae-23220bc9d9b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3843949a2f6d41a295f56d5697733d5f'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:04:59.559260 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-f022aac5-2d4d-4d9b-95ae-23220bc9d9b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3843949a2f6d41a295f56d5697733d5f'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:04:59.559901 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-f022aac5-2d4d-4d9b-95ae-23220bc9d9b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3843949a2f6d41a295f56d5697733d5f'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:04:59.573175 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1249/2502] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 20:04:59 2022] DELETE /identity/v3/users/3843949a2f6d41a295f56d5697733d5f => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 20:04:59.672774 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-e04ca489-beb2-4325-8991-64518ba6251a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '193cfad1a0bf46ec91aadf03ae328fe7'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:04:59.747681 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-e04ca489-beb2-4325-8991-64518ba6251a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '193cfad1a0bf46ec91aadf03ae328fe7'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:04:59.748327 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-e04ca489-beb2-4325-8991-64518ba6251a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '193cfad1a0bf46ec91aadf03ae328fe7'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:04:59.748927 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-e04ca489-beb2-4325-8991-64518ba6251a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '193cfad1a0bf46ec91aadf03ae328fe7'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:04:59.762585 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-e04ca489-beb2-4325-8991-64518ba6251a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '193cfad1a0bf46ec91aadf03ae328fe7'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:04:59.775420 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1254/2503] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 20:04:59 2022] DELETE /identity/v3/users/193cfad1a0bf46ec91aadf03ae328fe7 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 20:04:59.780044 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f10d9-fb55-40e3-b681-b616ce125636 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:04:59.780457 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f10d9-fb55-40e3-b681-b616ce125636 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:04:59.780738 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f10d9-fb55-40e3-b681-b616ce125636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:04:59.799491 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-439f10d9-fb55-40e3-b681-b616ce125636 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:04:59.801205 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-439f10d9-fb55-40e3-b681-b616ce125636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:04:59.838179 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ca489-beb2-4325-8991-64518ba6251a admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:04:59.838179 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-e04ca489-beb2-4325-8991-64518ba6251a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:04:59.867994 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1250/2504] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:04:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:04:59.882952 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f10d9-fb55-40e3-b681-b616ce125636 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:04:59.884484 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-439f10d9-fb55-40e3-b681-b616ce125636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:04:59.919644 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ca489-beb2-4325-8991-64518ba6251a admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:04:59.928511 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5bdc2c-c295-455e-bd33-ed284cf58d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:04:59.929063 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5bdc2c-c295-455e-bd33-ed284cf58d7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:04:59.929344 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5bdc2c-c295-455e-bd33-ed284cf58d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:04:59.929659 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5bdc2c-c295-455e-bd33-ed284cf58d7c admin admin] PATH_INFO: `/v3/projects/671b621e67104cc684a3213851f8502b` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:04:59.930960 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5bdc2c-c295-455e-bd33-ed284cf58d7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=671b621e67104cc684a3213851f8502b)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:04:59.932874 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5bdc2c-c295-455e-bd33-ed284cf58d7c admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:04:59.943187 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:04:59.954303 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f10d9-fb55-40e3-b681-b616ce125636 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:04:59.959568 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0be70e-378c-4866-9220-919cb19ae9b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:04:59.960250 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0be70e-378c-4866-9220-919cb19ae9b7 service neutron] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:04:59.961073 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0be70e-378c-4866-9220-919cb19ae9b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:04:59.961357 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0be70e-378c-4866-9220-919cb19ae9b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:04:59.972048 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0be70e-378c-4866-9220-919cb19ae9b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:04:59.974818 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0be70e-378c-4866-9220-919cb19ae9b7 service neutron] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:04:59.983913 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1251/2505] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:04:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 20:05:00.061883 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-df5bdc2c-c295-455e-bd33-ed284cf58d7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '671b621e67104cc684a3213851f8502b', 'request_id': 'req-df5bdc2c-c295-455e-bd33-ed284cf58d7c'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:00.068900 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-df5bdc2c-c295-455e-bd33-ed284cf58d7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '671b621e67104cc684a3213851f8502b', 'request_id': 'req-df5bdc2c-c295-455e-bd33-ed284cf58d7c'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:00.133694 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-df5bdc2c-c295-455e-bd33-ed284cf58d7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '671b621e67104cc684a3213851f8502b', 'request_id': 'req-df5bdc2c-c295-455e-bd33-ed284cf58d7c'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:00.145343 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-df5bdc2c-c295-455e-bd33-ed284cf58d7c admin admin] The token cache is being invalidate because project 671b621e67104cc684a3213851f8502b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 20:05:00.145675 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-df5bdc2c-c295-455e-bd33-ed284cf58d7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:00.146344 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-df5bdc2c-c295-455e-bd33-ed284cf58d7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:00.147862 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1255/2506] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 20:04:59 2022] DELETE /identity/v3/projects/671b621e67104cc684a3213851f8502b => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 20:05:00.152031 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0be70e-378c-4866-9220-919cb19ae9b7 service neutron] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:00.162786 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0be70e-378c-4866-9220-919cb19ae9b7 service neutron] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:00.170899 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:05:00.224976 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00702ed1-4c4a-4120-8f80-057f010da533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:00.225899 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00702ed1-4c4a-4120-8f80-057f010da533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:00.226314 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00702ed1-4c4a-4120-8f80-057f010da533 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:00.226574 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00702ed1-4c4a-4120-8f80-057f010da533 admin admin] PATH_INFO: `/v3/users/0c095514ca4042d38da06e2babc17243` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:00.228032 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00702ed1-4c4a-4120-8f80-057f010da533 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c095514ca4042d38da06e2babc17243)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:00.230491 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00702ed1-4c4a-4120-8f80-057f010da533 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:00.406598 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5bdc2c-c295-455e-bd33-ed284cf58d7c admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:00.408409 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-df5bdc2c-c295-455e-bd33-ed284cf58d7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:05:00.428264 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5bdc2c-c295-455e-bd33-ed284cf58d7c admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:00.434183 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8614e9d5-f90b-475c-b0fb-073c853c5e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:00.435327 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614e9d5-f90b-475c-b0fb-073c853c5e14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:00.435661 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614e9d5-f90b-475c-b0fb-073c853c5e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:00.436149 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614e9d5-f90b-475c-b0fb-073c853c5e14 admin admin] PATH_INFO: `/v3/projects/38ad8b0062f342309c382c3773643e72` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:00.437230 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8614e9d5-f90b-475c-b0fb-073c853c5e14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38ad8b0062f342309c382c3773643e72)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:00.439612 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8614e9d5-f90b-475c-b0fb-073c853c5e14 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:00.489514 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-00702ed1-4c4a-4120-8f80-057f010da533 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c095514ca4042d38da06e2babc17243'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:00.568187 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-8614e9d5-f90b-475c-b0fb-073c853c5e14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38ad8b0062f342309c382c3773643e72', 'request_id': 'req-8614e9d5-f90b-475c-b0fb-073c853c5e14'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:00.574935 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-8614e9d5-f90b-475c-b0fb-073c853c5e14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38ad8b0062f342309c382c3773643e72', 'request_id': 'req-8614e9d5-f90b-475c-b0fb-073c853c5e14'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:00.608234 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-00702ed1-4c4a-4120-8f80-057f010da533 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c095514ca4042d38da06e2babc17243'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:00.608873 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-00702ed1-4c4a-4120-8f80-057f010da533 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c095514ca4042d38da06e2babc17243'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:00.622401 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-00702ed1-4c4a-4120-8f80-057f010da533 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c095514ca4042d38da06e2babc17243'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:00.623103 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-00702ed1-4c4a-4120-8f80-057f010da533 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c095514ca4042d38da06e2babc17243'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:00.635405 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1252/2507] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 20:05:00 2022] DELETE /identity/v3/users/0c095514ca4042d38da06e2babc17243 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:05:00.660586 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-8614e9d5-f90b-475c-b0fb-073c853c5e14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38ad8b0062f342309c382c3773643e72', 'request_id': 'req-8614e9d5-f90b-475c-b0fb-073c853c5e14'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:00.673684 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-8614e9d5-f90b-475c-b0fb-073c853c5e14 admin admin] The token cache is being invalidate because project 38ad8b0062f342309c382c3773643e72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 20:05:00.673684 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-8614e9d5-f90b-475c-b0fb-073c853c5e14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:00.673990 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-8614e9d5-f90b-475c-b0fb-073c853c5e14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:00.680426 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19274893-a54f-41c3-995d-73076cb29a52 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:00.680690 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19274893-a54f-41c3-995d-73076cb29a52 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:00.680993 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19274893-a54f-41c3-995d-73076cb29a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:00.684635 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1256/2508] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 20:05:00 2022] DELETE /identity/v3/projects/38ad8b0062f342309c382c3773643e72 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 20:05:00.702483 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-19274893-a54f-41c3-995d-73076cb29a52 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:05:00.703685 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-19274893-a54f-41c3-995d-73076cb29a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:05:00.768690 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1253/2509] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:05:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 20:05:00.777370 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f26c30-e137-42aa-9bf0-a5383681ed64 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:00.777709 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f26c30-e137-42aa-9bf0-a5383681ed64 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:00.777980 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f26c30-e137-42aa-9bf0-a5383681ed64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:00.798465 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-d8f26c30-e137-42aa-9bf0-a5383681ed64 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:05:00.799659 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-d8f26c30-e137-42aa-9bf0-a5383681ed64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:05:00.807921 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1257/2510] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:05:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:05:00.816162 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19274893-a54f-41c3-995d-73076cb29a52 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:00.826080 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19274893-a54f-41c3-995d-73076cb29a52 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:00.831055 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeedeedf-72d7-459d-b1f1-250f65d9d2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:00.832144 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeedeedf-72d7-459d-b1f1-250f65d9d2ea admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:00.832421 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeedeedf-72d7-459d-b1f1-250f65d9d2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:00.832690 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeedeedf-72d7-459d-b1f1-250f65d9d2ea admin admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:00.833331 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeedeedf-72d7-459d-b1f1-250f65d9d2ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:05:00.833656 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeedeedf-72d7-459d-b1f1-250f65d9d2ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:00.835931 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeedeedf-72d7-459d-b1f1-250f65d9d2ea admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:00.846669 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1254/2511] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 20:05:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:05:00.851991 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f26c30-e137-42aa-9bf0-a5383681ed64 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:00.861171 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f26c30-e137-42aa-9bf0-a5383681ed64 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:00.865969 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023acb77-f9f3-4f9e-8911-392bfca5c3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:00.866553 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023acb77-f9f3-4f9e-8911-392bfca5c3cd admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:00.866828 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023acb77-f9f3-4f9e-8911-392bfca5c3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:00.867097 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023acb77-f9f3-4f9e-8911-392bfca5c3cd admin admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:00.867719 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023acb77-f9f3-4f9e-8911-392bfca5c3cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:00.869679 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023acb77-f9f3-4f9e-8911-392bfca5c3cd admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:00.906670 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeedeedf-72d7-459d-b1f1-250f65d9d2ea admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:00.908390 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-aeedeedf-72d7-459d-b1f1-250f65d9d2ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:05:00.926032 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeedeedf-72d7-459d-b1f1-250f65d9d2ea admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:00.931999 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2799268c-bea3-4eeb-9083-3ede1e516d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:00.932605 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799268c-bea3-4eeb-9083-3ede1e516d22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:00.933242 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799268c-bea3-4eeb-9083-3ede1e516d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:00.933609 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799268c-bea3-4eeb-9083-3ede1e516d22 admin admin] PATH_INFO: `/v3/projects/404f7dd30e08462c9fb23f0392741290` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:00.934788 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2799268c-bea3-4eeb-9083-3ede1e516d22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=404f7dd30e08462c9fb23f0392741290)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:00.936670 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2799268c-bea3-4eeb-9083-3ede1e516d22 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:00.950124 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:05:01.010092 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1258/2512] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 20:05:00 2022] POST /identity/v3/projects => generated 367 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:05:01.014180 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023acb77-f9f3-4f9e-8911-392bfca5c3cd admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:01.057353 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-2799268c-bea3-4eeb-9083-3ede1e516d22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '404f7dd30e08462c9fb23f0392741290', 'request_id': 'req-2799268c-bea3-4eeb-9083-3ede1e516d22'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:01.063013 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:05:01.076957 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023acb77-f9f3-4f9e-8911-392bfca5c3cd admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:01.132781 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103372b0-43dc-4afe-a96e-65a5fced48db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:01.133389 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103372b0-43dc-4afe-a96e-65a5fced48db admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:01.133701 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103372b0-43dc-4afe-a96e-65a5fced48db admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:01.133974 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103372b0-43dc-4afe-a96e-65a5fced48db admin admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:01.134610 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103372b0-43dc-4afe-a96e-65a5fced48db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:01.136556 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103372b0-43dc-4afe-a96e-65a5fced48db admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:01.142243 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-2799268c-bea3-4eeb-9083-3ede1e516d22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '404f7dd30e08462c9fb23f0392741290', 'request_id': 'req-2799268c-bea3-4eeb-9083-3ede1e516d22'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:01.149574 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-2799268c-bea3-4eeb-9083-3ede1e516d22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '404f7dd30e08462c9fb23f0392741290', 'request_id': 'req-2799268c-bea3-4eeb-9083-3ede1e516d22'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:01.161560 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-2799268c-bea3-4eeb-9083-3ede1e516d22 admin admin] The token cache is being invalidate because project 404f7dd30e08462c9fb23f0392741290 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 20:05:01.161867 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-2799268c-bea3-4eeb-9083-3ede1e516d22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:01.162519 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-2799268c-bea3-4eeb-9083-3ede1e516d22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:01.165788 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1255/2513] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 20:05:00 2022] DELETE /identity/v3/projects/404f7dd30e08462c9fb23f0392741290 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 20:05:01.223711 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1259/2514] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 20:05:01 2022] POST /identity/v3/users => generated 284 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 20:05:01.227952 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2799268c-bea3-4eeb-9083-3ede1e516d22 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:01.229455 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-2799268c-bea3-4eeb-9083-3ede1e516d22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:05:01.243728 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2799268c-bea3-4eeb-9083-3ede1e516d22 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:01.248875 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8562c0e4-8bd1-496a-a8f4-b867bb9baab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:01.249224 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8562c0e4-8bd1-496a-a8f4-b867bb9baab9 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:01.249522 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8562c0e4-8bd1-496a-a8f4-b867bb9baab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:01.249810 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8562c0e4-8bd1-496a-a8f4-b867bb9baab9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:01.250469 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8562c0e4-8bd1-496a-a8f4-b867bb9baab9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:01.252091 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8562c0e4-8bd1-496a-a8f4-b867bb9baab9 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:01.267672 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1256/2515] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:05:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:05:01.268618 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103372b0-43dc-4afe-a96e-65a5fced48db admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:01.281371 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103372b0-43dc-4afe-a96e-65a5fced48db admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:01.287410 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8778171-c419-40ab-b5b0-eec4023aa2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:01.290724 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8778171-c419-40ab-b5b0-eec4023aa2c9 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:01.290724 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8778171-c419-40ab-b5b0-eec4023aa2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:01.290724 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8778171-c419-40ab-b5b0-eec4023aa2c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:01.290724 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8778171-c419-40ab-b5b0-eec4023aa2c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:01.291066 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8778171-c419-40ab-b5b0-eec4023aa2c9 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:01.303004 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1260/2516] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:05:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:05:01.307385 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8562c0e4-8bd1-496a-a8f4-b867bb9baab9 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:01.319347 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8562c0e4-8bd1-496a-a8f4-b867bb9baab9 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:01.324308 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f8686-626d-4ba8-a37b-771e9b12f693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:01.324988 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f8686-626d-4ba8-a37b-771e9b12f693 admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:01.325271 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f8686-626d-4ba8-a37b-771e9b12f693 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:01.325577 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f8686-626d-4ba8-a37b-771e9b12f693 admin admin] PATH_INFO: `/v3/projects/7cd960602e924a4f8a6def765711533c/users/99cd1a19e18f45ceaafa9287330f6d67/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:01.342451 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f8686-626d-4ba8-a37b-771e9b12f693 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cd960602e924a4f8a6def765711533c, user_id=99cd1a19e18f45ceaafa9287330f6d67, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:01.345151 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f8686-626d-4ba8-a37b-771e9b12f693 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:01.446319 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1257/2517] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 20:05:01 2022] PUT /identity/v3/projects/7cd960602e924a4f8a6def765711533c/users/99cd1a19e18f45ceaafa9287330f6d67/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:05:01.457217 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ccea5d-3fa0-4a1a-bba5-401ea429d373 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:01.457523 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ccea5d-3fa0-4a1a-bba5-401ea429d373 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:01.457813 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ccea5d-3fa0-4a1a-bba5-401ea429d373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:01.486465 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-b5ccea5d-3fa0-4a1a-bba5-401ea429d373 None None] MFA Rules not processed for user `99cd1a19e18f45ceaafa9287330f6d67`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:05:01.487667 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-b5ccea5d-3fa0-4a1a-bba5-401ea429d373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:05:01.554248 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1261/2518] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:05:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:05:01.566646 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f8686-626d-4ba8-a37b-771e9b12f693 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:01.568424 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-4e7f8686-626d-4ba8-a37b-771e9b12f693 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:05:01.630247 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f8686-626d-4ba8-a37b-771e9b12f693 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:01.633908 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d21f95-863c-45a1-9dde-0f17ec9f9a44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:01.634504 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d21f95-863c-45a1-9dde-0f17ec9f9a44 service cinder] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:01.634782 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d21f95-863c-45a1-9dde-0f17ec9f9a44 service cinder] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:01.635053 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d21f95-863c-45a1-9dde-0f17ec9f9a44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:01.643197 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d21f95-863c-45a1-9dde-0f17ec9f9a44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:01.644733 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d21f95-863c-45a1-9dde-0f17ec9f9a44 service cinder] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:01.653315 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1258/2519] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:05:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:05:11.344680 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ccea5d-3fa0-4a1a-bba5-401ea429d373 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:11.406851 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ccea5d-3fa0-4a1a-bba5-401ea429d373 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:11.411303 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921b769-6d39-42f9-ac8a-b5e378dd17c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:11.411920 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921b769-6d39-42f9-ac8a-b5e378dd17c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:11.412194 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921b769-6d39-42f9-ac8a-b5e378dd17c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:11.412463 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921b769-6d39-42f9-ac8a-b5e378dd17c2 admin admin] PATH_INFO: `/v3/users/99cd1a19e18f45ceaafa9287330f6d67` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:11.413594 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2921b769-6d39-42f9-ac8a-b5e378dd17c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99cd1a19e18f45ceaafa9287330f6d67)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:11.416141 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2921b769-6d39-42f9-ac8a-b5e378dd17c2 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:11.420600 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:05:11.549274 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-2921b769-6d39-42f9-ac8a-b5e378dd17c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99cd1a19e18f45ceaafa9287330f6d67'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:11.607537 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-2921b769-6d39-42f9-ac8a-b5e378dd17c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99cd1a19e18f45ceaafa9287330f6d67'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:11.608089 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-2921b769-6d39-42f9-ac8a-b5e378dd17c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99cd1a19e18f45ceaafa9287330f6d67'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:11.608705 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-2921b769-6d39-42f9-ac8a-b5e378dd17c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99cd1a19e18f45ceaafa9287330f6d67'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:11.621161 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-2921b769-6d39-42f9-ac8a-b5e378dd17c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99cd1a19e18f45ceaafa9287330f6d67'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:11.633320 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1262/2520] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 20:05:11 2022] DELETE /identity/v3/users/99cd1a19e18f45ceaafa9287330f6d67 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:05:11.637926 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d48d29-e340-4b73-be8d-c0fabc02b36b None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:11.638402 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d48d29-e340-4b73-be8d-c0fabc02b36b None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:11.638500 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d48d29-e340-4b73-be8d-c0fabc02b36b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:11.657805 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-e4d48d29-e340-4b73-be8d-c0fabc02b36b None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:05:11.658941 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-e4d48d29-e340-4b73-be8d-c0fabc02b36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:05:11.718790 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1259/2521] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:05:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:05:11.728500 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921b769-6d39-42f9-ac8a-b5e378dd17c2 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:11.729938 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-2921b769-6d39-42f9-ac8a-b5e378dd17c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:05:11.787511 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921b769-6d39-42f9-ac8a-b5e378dd17c2 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:11.791315 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45120d2f-9765-46cf-8f23-4945ab37e28b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:11.791907 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45120d2f-9765-46cf-8f23-4945ab37e28b service neutron] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:11.792183 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45120d2f-9765-46cf-8f23-4945ab37e28b service neutron] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:11.792452 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45120d2f-9765-46cf-8f23-4945ab37e28b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:11.801375 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45120d2f-9765-46cf-8f23-4945ab37e28b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:11.802821 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45120d2f-9765-46cf-8f23-4945ab37e28b service neutron] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:11.812265 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1263/2522] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:05:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:05:12.249916 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d48d29-e340-4b73-be8d-c0fabc02b36b None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:12.251371 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-e4d48d29-e340-4b73-be8d-c0fabc02b36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:05:12.264036 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d48d29-e340-4b73-be8d-c0fabc02b36b None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:12.269226 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d27fd8-9b9a-4451-aabe-dc06d7ef046e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:12.270238 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d27fd8-9b9a-4451-aabe-dc06d7ef046e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:12.270603 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d27fd8-9b9a-4451-aabe-dc06d7ef046e admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:12.270875 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d27fd8-9b9a-4451-aabe-dc06d7ef046e admin admin] PATH_INFO: `/v3/projects/7cd960602e924a4f8a6def765711533c` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:12.272980 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d27fd8-9b9a-4451-aabe-dc06d7ef046e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cd960602e924a4f8a6def765711533c)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:12.275924 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d27fd8-9b9a-4451-aabe-dc06d7ef046e admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:12.278722 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:05:12.371251 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-e9d27fd8-9b9a-4451-aabe-dc06d7ef046e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cd960602e924a4f8a6def765711533c', 'request_id': 'req-e9d27fd8-9b9a-4451-aabe-dc06d7ef046e'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:12.494095 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-e9d27fd8-9b9a-4451-aabe-dc06d7ef046e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cd960602e924a4f8a6def765711533c', 'request_id': 'req-e9d27fd8-9b9a-4451-aabe-dc06d7ef046e'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:12.500094 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-e9d27fd8-9b9a-4451-aabe-dc06d7ef046e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cd960602e924a4f8a6def765711533c', 'request_id': 'req-e9d27fd8-9b9a-4451-aabe-dc06d7ef046e'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:12.511669 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-e9d27fd8-9b9a-4451-aabe-dc06d7ef046e admin admin] The token cache is being invalidate because project 7cd960602e924a4f8a6def765711533c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 20:05:12.511954 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-e9d27fd8-9b9a-4451-aabe-dc06d7ef046e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:12.512623 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-e9d27fd8-9b9a-4451-aabe-dc06d7ef046e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:12.514199 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1260/2523] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 20:05:12 2022] DELETE /identity/v3/projects/7cd960602e924a4f8a6def765711533c => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:05:12.519070 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf937f-3af5-47bf-a005-88bb346715b0 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:12.519544 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf937f-3af5-47bf-a005-88bb346715b0 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:12.519660 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf937f-3af5-47bf-a005-88bb346715b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:12.540081 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-d6cf937f-3af5-47bf-a005-88bb346715b0 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:05:12.541308 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-d6cf937f-3af5-47bf-a005-88bb346715b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:05:12.600706 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1264/2524] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:05:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:05:12.610396 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671aa124-fab3-4f42-9bb5-6bc9edf38517 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:12.610681 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671aa124-fab3-4f42-9bb5-6bc9edf38517 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:12.610956 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671aa124-fab3-4f42-9bb5-6bc9edf38517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:12.633789 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-671aa124-fab3-4f42-9bb5-6bc9edf38517 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:05:12.634678 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-671aa124-fab3-4f42-9bb5-6bc9edf38517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:05:12.643964 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1261/2525] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:05:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:05:12.649072 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf937f-3af5-47bf-a005-88bb346715b0 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:12.658804 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf937f-3af5-47bf-a005-88bb346715b0 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:12.663400 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd0d4e-9ddb-4971-8463-ba9f0ea055fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:12.664244 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd0d4e-9ddb-4971-8463-ba9f0ea055fa admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:12.664527 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd0d4e-9ddb-4971-8463-ba9f0ea055fa admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:12.664805 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd0d4e-9ddb-4971-8463-ba9f0ea055fa admin admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:12.665447 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd0d4e-9ddb-4971-8463-ba9f0ea055fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:05:12.665778 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd0d4e-9ddb-4971-8463-ba9f0ea055fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:12.667371 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd0d4e-9ddb-4971-8463-ba9f0ea055fa admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:12.679544 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1265/2526] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 20:05:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:05:12.683432 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671aa124-fab3-4f42-9bb5-6bc9edf38517 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:12.692713 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671aa124-fab3-4f42-9bb5-6bc9edf38517 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:12.698032 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4c0ce-784f-44b6-b46e-1d4f5853469f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:12.698623 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4c0ce-784f-44b6-b46e-1d4f5853469f admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:12.698898 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4c0ce-784f-44b6-b46e-1d4f5853469f admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:12.699164 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4c0ce-784f-44b6-b46e-1d4f5853469f admin admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:12.699784 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b4c0ce-784f-44b6-b46e-1d4f5853469f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:12.701942 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b4c0ce-784f-44b6-b46e-1d4f5853469f admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:12.812115 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1262/2527] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 20:05:12 2022] POST /identity/v3/projects => generated 403 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:05:12.816345 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd0d4e-9ddb-4971-8463-ba9f0ea055fa admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:12.827279 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd0d4e-9ddb-4971-8463-ba9f0ea055fa admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:12.836090 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:05:12.884581 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25a2b8b-496b-4af2-b9cc-bd0823a71bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:12.885204 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a2b8b-496b-4af2-b9cc-bd0823a71bcc admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:12.885481 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a2b8b-496b-4af2-b9cc-bd0823a71bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:12.885774 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a2b8b-496b-4af2-b9cc-bd0823a71bcc admin admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:12.886400 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25a2b8b-496b-4af2-b9cc-bd0823a71bcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:12.888376 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25a2b8b-496b-4af2-b9cc-bd0823a71bcc admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:13.045537 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1266/2528] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 20:05:12 2022] POST /identity/v3/users => generated 302 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:05:13.049565 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4c0ce-784f-44b6-b46e-1d4f5853469f admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:13.060632 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4c0ce-784f-44b6-b46e-1d4f5853469f admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:13.065367 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca596b2-f736-4049-bd1a-ec0ca9bc50c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:13.065945 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca596b2-f736-4049-bd1a-ec0ca9bc50c3 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:13.066227 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca596b2-f736-4049-bd1a-ec0ca9bc50c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:13.066511 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca596b2-f736-4049-bd1a-ec0ca9bc50c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:13.067151 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca596b2-f736-4049-bd1a-ec0ca9bc50c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:13.068744 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca596b2-f736-4049-bd1a-ec0ca9bc50c3 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:13.079639 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1263/2529] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:05:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:05:13.083624 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25a2b8b-496b-4af2-b9cc-bd0823a71bcc admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:13.094327 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25a2b8b-496b-4af2-b9cc-bd0823a71bcc admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:13.098963 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d828c33e-5b21-4207-8b80-029a545039b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:13.099621 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828c33e-5b21-4207-8b80-029a545039b9 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:13.099899 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828c33e-5b21-4207-8b80-029a545039b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:13.100168 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828c33e-5b21-4207-8b80-029a545039b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:13.100851 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d828c33e-5b21-4207-8b80-029a545039b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:13.102571 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d828c33e-5b21-4207-8b80-029a545039b9 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:13.113364 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1267/2530] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:05:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:05:13.118279 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca596b2-f736-4049-bd1a-ec0ca9bc50c3 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:13.128144 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca596b2-f736-4049-bd1a-ec0ca9bc50c3 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:13.133385 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb0b824-6951-4a1b-bd52-df369614259d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:13.134112 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0b824-6951-4a1b-bd52-df369614259d admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:13.134391 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0b824-6951-4a1b-bd52-df369614259d admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:13.134688 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0b824-6951-4a1b-bd52-df369614259d admin admin] PATH_INFO: `/v3/projects/ec1f3b8bf0974305baf6f76dc012d05f/users/bbb736926db24a06938389f71caf0477/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:13.150473 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb0b824-6951-4a1b-bd52-df369614259d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec1f3b8bf0974305baf6f76dc012d05f, user_id=bbb736926db24a06938389f71caf0477, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:13.156174 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb0b824-6951-4a1b-bd52-df369614259d admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:13.221464 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1264/2531] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 20:05:13 2022] PUT /identity/v3/projects/ec1f3b8bf0974305baf6f76dc012d05f/users/bbb736926db24a06938389f71caf0477/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:05:13.232528 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479aa91c-44c5-49ca-8c09-0eacc46355d1 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:13.232832 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479aa91c-44c5-49ca-8c09-0eacc46355d1 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:13.233129 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479aa91c-44c5-49ca-8c09-0eacc46355d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:13.261511 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-479aa91c-44c5-49ca-8c09-0eacc46355d1 None None] MFA Rules not processed for user `bbb736926db24a06938389f71caf0477`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:05:13.262725 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-479aa91c-44c5-49ca-8c09-0eacc46355d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:05:13.330080 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1268/2532] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:05:13 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:05:13.334541 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb0b824-6951-4a1b-bd52-df369614259d admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:13.397260 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb0b824-6951-4a1b-bd52-df369614259d admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:13.402018 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19566fc2-b634-4100-9ef2-6ccfd54d9a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:13.402651 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19566fc2-b634-4100-9ef2-6ccfd54d9a2f admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:13.402931 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19566fc2-b634-4100-9ef2-6ccfd54d9a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:13.403204 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19566fc2-b634-4100-9ef2-6ccfd54d9a2f admin admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:13.403837 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19566fc2-b634-4100-9ef2-6ccfd54d9a2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:13.405746 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19566fc2-b634-4100-9ef2-6ccfd54d9a2f admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:13.523214 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1265/2533] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 20:05:13 2022] POST /identity/v3/projects => generated 405 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:05:13.527761 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479aa91c-44c5-49ca-8c09-0eacc46355d1 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:13.538393 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479aa91c-44c5-49ca-8c09-0eacc46355d1 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:13.595113 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8c4cd6-21a1-4643-a254-c9e9950147be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:13.595640 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8c4cd6-21a1-4643-a254-c9e9950147be admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:13.595920 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8c4cd6-21a1-4643-a254-c9e9950147be admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:13.596189 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8c4cd6-21a1-4643-a254-c9e9950147be admin admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:13.596813 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8c4cd6-21a1-4643-a254-c9e9950147be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:13.598750 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8c4cd6-21a1-4643-a254-c9e9950147be admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:13.703059 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1269/2534] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 20:05:13 2022] POST /identity/v3/users => generated 309 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:05:13.707124 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19566fc2-b634-4100-9ef2-6ccfd54d9a2f admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:13.718662 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19566fc2-b634-4100-9ef2-6ccfd54d9a2f admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:13.723416 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad4a26-69a5-4e9d-80e4-7be116ca324e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:13.724016 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad4a26-69a5-4e9d-80e4-7be116ca324e admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:13.724298 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad4a26-69a5-4e9d-80e4-7be116ca324e admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:13.724573 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad4a26-69a5-4e9d-80e4-7be116ca324e admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:13.725213 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad4a26-69a5-4e9d-80e4-7be116ca324e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:13.727524 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad4a26-69a5-4e9d-80e4-7be116ca324e admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:13.738324 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1266/2535] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:05:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:05:13.742891 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8c4cd6-21a1-4643-a254-c9e9950147be admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:13.752784 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8c4cd6-21a1-4643-a254-c9e9950147be admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:13.757352 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d0d4a1-58a1-4810-9614-f50cde46d15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:13.758586 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0d4a1-58a1-4810-9614-f50cde46d15b admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:13.758897 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0d4a1-58a1-4810-9614-f50cde46d15b admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:13.759177 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0d4a1-58a1-4810-9614-f50cde46d15b admin admin] PATH_INFO: `/v3/projects/d2cddfca6cd94b9bbaefed65a1c7a700/users/a1805bd679714b44a8856a4446477246/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:13.767664 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:05:13.775099 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d0d4a1-58a1-4810-9614-f50cde46d15b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2cddfca6cd94b9bbaefed65a1c7a700, user_id=a1805bd679714b44a8856a4446477246, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:13.778699 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d0d4a1-58a1-4810-9614-f50cde46d15b admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:13.850483 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1270/2536] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 20:05:13 2022] PUT /identity/v3/projects/d2cddfca6cd94b9bbaefed65a1c7a700/users/a1805bd679714b44a8856a4446477246/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:05:13.855180 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad4a26-69a5-4e9d-80e4-7be116ca324e admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:13.860195 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:05:13.865981 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad4a26-69a5-4e9d-80e4-7be116ca324e admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:13.920998 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d560441-640c-4b95-96cb-452976e16fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:13.921685 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d560441-640c-4b95-96cb-452976e16fbe admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:13.921964 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d560441-640c-4b95-96cb-452976e16fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:13.922231 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d560441-640c-4b95-96cb-452976e16fbe admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:13.922859 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d560441-640c-4b95-96cb-452976e16fbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:13.924423 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d560441-640c-4b95-96cb-452976e16fbe admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:13.933936 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1267/2537] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:05:13 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:05:13.938088 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d0d4a1-58a1-4810-9614-f50cde46d15b admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:13.949618 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d0d4a1-58a1-4810-9614-f50cde46d15b admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:13.954581 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc1d8d1-26db-4293-8d7a-b0f770651c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:13.955232 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1d8d1-26db-4293-8d7a-b0f770651c7b admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:13.955510 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1d8d1-26db-4293-8d7a-b0f770651c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:13.955787 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1d8d1-26db-4293-8d7a-b0f770651c7b admin admin] PATH_INFO: `/v3/projects/d2cddfca6cd94b9bbaefed65a1c7a700/users/a1805bd679714b44a8856a4446477246/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:13.957785 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc1d8d1-26db-4293-8d7a-b0f770651c7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2cddfca6cd94b9bbaefed65a1c7a700, user_id=a1805bd679714b44a8856a4446477246, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:13.960414 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc1d8d1-26db-4293-8d7a-b0f770651c7b admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:13.971538 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1271/2538] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 20:05:13 2022] PUT /identity/v3/projects/d2cddfca6cd94b9bbaefed65a1c7a700/users/a1805bd679714b44a8856a4446477246/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:05:13.983162 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0f2b5-d1f0-4699-8a99-6446675da9a0 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:13.983476 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0f2b5-d1f0-4699-8a99-6446675da9a0 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:13.983896 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0f2b5-d1f0-4699-8a99-6446675da9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:14.013958 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-7ee0f2b5-d1f0-4699-8a99-6446675da9a0 None None] MFA Rules not processed for user `a1805bd679714b44a8856a4446477246`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:05:14.015180 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-7ee0f2b5-d1f0-4699-8a99-6446675da9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:05:14.090611 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1268/2539] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:05:13 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:05:14.100971 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc1d8d1-26db-4293-8d7a-b0f770651c7b admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:14.102907 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-6fc1d8d1-26db-4293-8d7a-b0f770651c7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:05:14.159990 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc1d8d1-26db-4293-8d7a-b0f770651c7b admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:14.164288 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db66e3-0c01-404e-81a4-ee5d043747bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:14.165010 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db66e3-0c01-404e-81a4-ee5d043747bd service cinder] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:14.165286 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db66e3-0c01-404e-81a4-ee5d043747bd service cinder] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:14.165589 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db66e3-0c01-404e-81a4-ee5d043747bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:14.174629 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3db66e3-0c01-404e-81a4-ee5d043747bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:14.176079 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3db66e3-0c01-404e-81a4-ee5d043747bd service cinder] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:14.186369 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1272/2540] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:05:14 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:05:14.338264 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee0f2b5-d1f0-4699-8a99-6446675da9a0 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:14.404622 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee0f2b5-d1f0-4699-8a99-6446675da9a0 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:14.409136 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b18c34e-ffa1-438c-8478-8a58a7b471ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:14.409789 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18c34e-ffa1-438c-8478-8a58a7b471ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:14.410068 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18c34e-ffa1-438c-8478-8a58a7b471ce admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:14.410336 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18c34e-ffa1-438c-8478-8a58a7b471ce admin admin] PATH_INFO: `/v3/users/bbb736926db24a06938389f71caf0477` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:14.411432 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b18c34e-ffa1-438c-8478-8a58a7b471ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbb736926db24a06938389f71caf0477)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:14.413356 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b18c34e-ffa1-438c-8478-8a58a7b471ce admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:14.514073 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:05:14.636052 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-0b18c34e-ffa1-438c-8478-8a58a7b471ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbb736926db24a06938389f71caf0477'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:14.693347 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-0b18c34e-ffa1-438c-8478-8a58a7b471ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbb736926db24a06938389f71caf0477'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:14.693999 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-0b18c34e-ffa1-438c-8478-8a58a7b471ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbb736926db24a06938389f71caf0477'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:14.708706 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-0b18c34e-ffa1-438c-8478-8a58a7b471ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbb736926db24a06938389f71caf0477'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:14.709362 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-0b18c34e-ffa1-438c-8478-8a58a7b471ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbb736926db24a06938389f71caf0477'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:14.723621 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1269/2541] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 20:05:14 2022] DELETE /identity/v3/users/bbb736926db24a06938389f71caf0477 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:05:14.728375 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f6f97-7798-499f-b16f-7b03ec8f6bda None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:14.728799 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f6f97-7798-499f-b16f-7b03ec8f6bda None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:14.728948 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f6f97-7798-499f-b16f-7b03ec8f6bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:14.748389 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-af1f6f97-7798-499f-b16f-7b03ec8f6bda None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:05:14.749646 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-af1f6f97-7798-499f-b16f-7b03ec8f6bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:05:14.808977 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1273/2542] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:05:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:05:14.819073 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b18c34e-ffa1-438c-8478-8a58a7b471ce admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:14.821352 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-0b18c34e-ffa1-438c-8478-8a58a7b471ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:05:14.879961 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b18c34e-ffa1-438c-8478-8a58a7b471ce admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:14.884290 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba43d4-c55d-4561-8800-f6a658646bda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:14.884892 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba43d4-c55d-4561-8800-f6a658646bda service neutron] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:14.885172 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba43d4-c55d-4561-8800-f6a658646bda service neutron] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:14.885445 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba43d4-c55d-4561-8800-f6a658646bda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:14.894654 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bba43d4-c55d-4561-8800-f6a658646bda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:14.896000 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bba43d4-c55d-4561-8800-f6a658646bda service neutron] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:14.906227 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1270/2543] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:05:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:05:15.341025 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f6f97-7798-499f-b16f-7b03ec8f6bda None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:15.342530 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-af1f6f97-7798-499f-b16f-7b03ec8f6bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:05:15.354642 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f6f97-7798-499f-b16f-7b03ec8f6bda None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:15.359231 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de7db8-170c-4ef4-a62e-29862ec792b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:15.360063 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de7db8-170c-4ef4-a62e-29862ec792b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:15.360288 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de7db8-170c-4ef4-a62e-29862ec792b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:15.360559 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de7db8-170c-4ef4-a62e-29862ec792b2 admin admin] PATH_INFO: `/v3/projects/ec1f3b8bf0974305baf6f76dc012d05f` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:15.362085 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2de7db8-170c-4ef4-a62e-29862ec792b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec1f3b8bf0974305baf6f76dc012d05f)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:15.364009 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2de7db8-170c-4ef4-a62e-29862ec792b2 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:15.593876 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-e2de7db8-170c-4ef4-a62e-29862ec792b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec1f3b8bf0974305baf6f76dc012d05f', 'request_id': 'req-e2de7db8-170c-4ef4-a62e-29862ec792b2'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:15.600293 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-e2de7db8-170c-4ef4-a62e-29862ec792b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec1f3b8bf0974305baf6f76dc012d05f', 'request_id': 'req-e2de7db8-170c-4ef4-a62e-29862ec792b2'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:15.665551 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-e2de7db8-170c-4ef4-a62e-29862ec792b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec1f3b8bf0974305baf6f76dc012d05f', 'request_id': 'req-e2de7db8-170c-4ef4-a62e-29862ec792b2'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:15.673385 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:05:15.677247 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-e2de7db8-170c-4ef4-a62e-29862ec792b2 admin admin] The token cache is being invalidate because project ec1f3b8bf0974305baf6f76dc012d05f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 20:05:15.677563 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-e2de7db8-170c-4ef4-a62e-29862ec792b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:15.678204 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-e2de7db8-170c-4ef4-a62e-29862ec792b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:15.680347 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1274/2544] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 20:05:15 2022] DELETE /identity/v3/projects/ec1f3b8bf0974305baf6f76dc012d05f => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:05:15.684434 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba43d4-c55d-4561-8800-f6a658646bda service neutron] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:15.694103 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba43d4-c55d-4561-8800-f6a658646bda service neutron] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:15.751243 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ad23b2-ad2b-4137-ba83-bc3fc9955086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:15.751882 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad23b2-ad2b-4137-ba83-bc3fc9955086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:15.752124 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad23b2-ad2b-4137-ba83-bc3fc9955086 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:15.752391 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad23b2-ad2b-4137-ba83-bc3fc9955086 admin admin] PATH_INFO: `/v3/users/a1805bd679714b44a8856a4446477246` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:15.753518 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ad23b2-ad2b-4137-ba83-bc3fc9955086 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1805bd679714b44a8856a4446477246)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:15.755406 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ad23b2-ad2b-4137-ba83-bc3fc9955086 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:15.929638 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-43ad23b2-ad2b-4137-ba83-bc3fc9955086 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1805bd679714b44a8856a4446477246'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:15.931160 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:05:16.013307 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-43ad23b2-ad2b-4137-ba83-bc3fc9955086 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1805bd679714b44a8856a4446477246'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:16.013969 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-43ad23b2-ad2b-4137-ba83-bc3fc9955086 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1805bd679714b44a8856a4446477246'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:16.026770 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-43ad23b2-ad2b-4137-ba83-bc3fc9955086 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1805bd679714b44a8856a4446477246'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:16.027403 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-43ad23b2-ad2b-4137-ba83-bc3fc9955086 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1805bd679714b44a8856a4446477246'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:16.040059 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1271/2545] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 20:05:15 2022] DELETE /identity/v3/users/a1805bd679714b44a8856a4446477246 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:05:16.434710 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de7db8-170c-4ef4-a62e-29862ec792b2 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:16.436217 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-e2de7db8-170c-4ef4-a62e-29862ec792b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:05:16.451820 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de7db8-170c-4ef4-a62e-29862ec792b2 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:16.509151 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a7116f-7068-42c8-9f7a-9b24c08a243b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:16.515068 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7116f-7068-42c8-9f7a-9b24c08a243b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:16.515068 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7116f-7068-42c8-9f7a-9b24c08a243b admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:16.515068 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7116f-7068-42c8-9f7a-9b24c08a243b admin admin] PATH_INFO: `/v3/projects/d2cddfca6cd94b9bbaefed65a1c7a700` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:16.515068 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a7116f-7068-42c8-9f7a-9b24c08a243b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2cddfca6cd94b9bbaefed65a1c7a700)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:16.515068 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a7116f-7068-42c8-9f7a-9b24c08a243b admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:16.630033 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-b6a7116f-7068-42c8-9f7a-9b24c08a243b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2cddfca6cd94b9bbaefed65a1c7a700', 'request_id': 'req-b6a7116f-7068-42c8-9f7a-9b24c08a243b'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:16.637666 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-b6a7116f-7068-42c8-9f7a-9b24c08a243b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2cddfca6cd94b9bbaefed65a1c7a700', 'request_id': 'req-b6a7116f-7068-42c8-9f7a-9b24c08a243b'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:16.713388 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-b6a7116f-7068-42c8-9f7a-9b24c08a243b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2cddfca6cd94b9bbaefed65a1c7a700', 'request_id': 'req-b6a7116f-7068-42c8-9f7a-9b24c08a243b'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:16.724547 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-b6a7116f-7068-42c8-9f7a-9b24c08a243b admin admin] The token cache is being invalidate because project d2cddfca6cd94b9bbaefed65a1c7a700 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 20:05:16.731184 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-b6a7116f-7068-42c8-9f7a-9b24c08a243b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:16.731184 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-b6a7116f-7068-42c8-9f7a-9b24c08a243b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:16.731184 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1275/2546] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 20:05:16 2022] DELETE /identity/v3/projects/d2cddfca6cd94b9bbaefed65a1c7a700 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:05:16.733382 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb833f4-74e9-41ee-ad4e-5359d0e54bf6 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:16.733696 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb833f4-74e9-41ee-ad4e-5359d0e54bf6 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:16.734000 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb833f4-74e9-41ee-ad4e-5359d0e54bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:16.753487 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-9eb833f4-74e9-41ee-ad4e-5359d0e54bf6 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:05:16.754723 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-9eb833f4-74e9-41ee-ad4e-5359d0e54bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:05:16.813570 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1272/2547] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:05:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:05:16.821313 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05b9ff-2351-4e19-81da-80ba6b862361 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:16.821688 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05b9ff-2351-4e19-81da-80ba6b862361 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:16.822029 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05b9ff-2351-4e19-81da-80ba6b862361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:16.842706 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-ae05b9ff-2351-4e19-81da-80ba6b862361 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:05:16.843982 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-ae05b9ff-2351-4e19-81da-80ba6b862361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:05:16.852414 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1276/2548] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:05:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:05:16.856539 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb833f4-74e9-41ee-ad4e-5359d0e54bf6 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:16.866237 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb833f4-74e9-41ee-ad4e-5359d0e54bf6 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:16.870874 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45feb9-d33c-41b6-99fc-1fb059aa43d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:16.871470 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45feb9-d33c-41b6-99fc-1fb059aa43d4 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:16.871750 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45feb9-d33c-41b6-99fc-1fb059aa43d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:16.872028 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45feb9-d33c-41b6-99fc-1fb059aa43d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:16.872711 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b45feb9-d33c-41b6-99fc-1fb059aa43d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:05:16.873026 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b45feb9-d33c-41b6-99fc-1fb059aa43d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:16.874626 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b45feb9-d33c-41b6-99fc-1fb059aa43d4 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:16.886486 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1273/2549] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 20:05:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:05:16.891265 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05b9ff-2351-4e19-81da-80ba6b862361 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:16.901237 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05b9ff-2351-4e19-81da-80ba6b862361 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:16.905881 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581cb93a-bee6-453a-8c17-8c26e20d6663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:16.906468 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581cb93a-bee6-453a-8c17-8c26e20d6663 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:16.906751 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581cb93a-bee6-453a-8c17-8c26e20d6663 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:16.907022 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581cb93a-bee6-453a-8c17-8c26e20d6663 admin admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:16.907639 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581cb93a-bee6-453a-8c17-8c26e20d6663 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:16.909537 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581cb93a-bee6-453a-8c17-8c26e20d6663 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:17.006007 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1277/2550] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 20:05:16 2022] POST /identity/v3/projects => generated 381 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:05:17.010733 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45feb9-d33c-41b6-99fc-1fb059aa43d4 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:17.020636 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45feb9-d33c-41b6-99fc-1fb059aa43d4 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:17.078701 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398bb620-2bff-4900-a422-64dd95bc99f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:17.079452 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398bb620-2bff-4900-a422-64dd95bc99f7 admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:17.079585 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398bb620-2bff-4900-a422-64dd95bc99f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:17.079849 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398bb620-2bff-4900-a422-64dd95bc99f7 admin admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:17.080483 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398bb620-2bff-4900-a422-64dd95bc99f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:17.082421 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398bb620-2bff-4900-a422-64dd95bc99f7 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:17.236835 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1274/2551] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 20:05:17 2022] POST /identity/v3/users => generated 291 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:05:17.242692 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581cb93a-bee6-453a-8c17-8c26e20d6663 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:17.251467 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581cb93a-bee6-453a-8c17-8c26e20d6663 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:17.256068 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e703ad5a-5d71-49eb-8357-f8adc9debaad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:17.256587 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703ad5a-5d71-49eb-8357-f8adc9debaad admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:17.257084 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703ad5a-5d71-49eb-8357-f8adc9debaad admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:17.257191 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703ad5a-5d71-49eb-8357-f8adc9debaad admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:17.258500 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e703ad5a-5d71-49eb-8357-f8adc9debaad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:17.260129 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e703ad5a-5d71-49eb-8357-f8adc9debaad admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:17.270178 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1278/2552] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:05:17.278266 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398bb620-2bff-4900-a422-64dd95bc99f7 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:17.290118 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398bb620-2bff-4900-a422-64dd95bc99f7 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:17.295888 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58474aad-3a26-4f84-8f7a-355c6a1eea93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:17.296488 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58474aad-3a26-4f84-8f7a-355c6a1eea93 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:17.296772 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58474aad-3a26-4f84-8f7a-355c6a1eea93 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:17.297087 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58474aad-3a26-4f84-8f7a-355c6a1eea93 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:17.297779 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58474aad-3a26-4f84-8f7a-355c6a1eea93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:17.299439 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58474aad-3a26-4f84-8f7a-355c6a1eea93 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:17.311019 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1275/2553] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:05:17.315560 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e703ad5a-5d71-49eb-8357-f8adc9debaad admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:17.326509 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e703ad5a-5d71-49eb-8357-f8adc9debaad admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:17.330894 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea66dd30-cf7e-4484-9052-72b389964a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:17.331528 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea66dd30-cf7e-4484-9052-72b389964a9c admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:17.331804 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea66dd30-cf7e-4484-9052-72b389964a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:17.332072 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea66dd30-cf7e-4484-9052-72b389964a9c admin admin] PATH_INFO: `/v3/projects/b75f33b30ad14a0897edc828dd124e5a/users/e2ef3210bb5a4856804eed96c0288a67/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:17.346351 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea66dd30-cf7e-4484-9052-72b389964a9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b75f33b30ad14a0897edc828dd124e5a, user_id=e2ef3210bb5a4856804eed96c0288a67, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:17.349016 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea66dd30-cf7e-4484-9052-72b389964a9c admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:17.431562 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1279/2554] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 20:05:17 2022] PUT /identity/v3/projects/b75f33b30ad14a0897edc828dd124e5a/users/e2ef3210bb5a4856804eed96c0288a67/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 20:05:17.441772 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59558e75-f645-4545-b6a1-6fa77f4340b8 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:17.442060 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59558e75-f645-4545-b6a1-6fa77f4340b8 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:17.442338 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59558e75-f645-4545-b6a1-6fa77f4340b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:17.470514 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-59558e75-f645-4545-b6a1-6fa77f4340b8 None None] MFA Rules not processed for user `e2ef3210bb5a4856804eed96c0288a67`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:05:17.471715 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-59558e75-f645-4545-b6a1-6fa77f4340b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:05:17.490412 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:05:17.538223 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1276/2555] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:05:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:05:17.543008 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea66dd30-cf7e-4484-9052-72b389964a9c admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:17.573811 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:05:17.604569 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea66dd30-cf7e-4484-9052-72b389964a9c admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:17.609070 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ab02b-a41f-4c43-8065-451f391bb38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:17.609946 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ab02b-a41f-4c43-8065-451f391bb38e admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:17.610246 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ab02b-a41f-4c43-8065-451f391bb38e admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:17.610693 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ab02b-a41f-4c43-8065-451f391bb38e admin admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:17.611697 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938ab02b-a41f-4c43-8065-451f391bb38e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:17.613643 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938ab02b-a41f-4c43-8065-451f391bb38e admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:17.720496 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1280/2556] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 20:05:17 2022] POST /identity/v3/projects => generated 379 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 20:05:17.724552 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59558e75-f645-4545-b6a1-6fa77f4340b8 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:17.735720 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59558e75-f645-4545-b6a1-6fa77f4340b8 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:17.794039 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a049228-7249-4d1c-a47a-ef7ace67f8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:17.794642 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a049228-7249-4d1c-a47a-ef7ace67f8de admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:17.794838 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a049228-7249-4d1c-a47a-ef7ace67f8de admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:17.795107 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a049228-7249-4d1c-a47a-ef7ace67f8de admin admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:17.795743 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a049228-7249-4d1c-a47a-ef7ace67f8de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:17.797660 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a049228-7249-4d1c-a47a-ef7ace67f8de admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:17.868485 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1277/2557] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 20:05:17 2022] POST /identity/v3/users => generated 296 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:05:17.872546 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ab02b-a41f-4c43-8065-451f391bb38e admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:17.882951 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ab02b-a41f-4c43-8065-451f391bb38e admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:17.887649 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490ffcf-0b58-42d4-bcc5-2637333b651c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:17.888233 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490ffcf-0b58-42d4-bcc5-2637333b651c admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:17.888510 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490ffcf-0b58-42d4-bcc5-2637333b651c admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:17.888776 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490ffcf-0b58-42d4-bcc5-2637333b651c admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:17.889401 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2490ffcf-0b58-42d4-bcc5-2637333b651c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:17.890995 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2490ffcf-0b58-42d4-bcc5-2637333b651c admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:17.900804 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1281/2558] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 20:05:17.904857 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a049228-7249-4d1c-a47a-ef7ace67f8de admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:17.915311 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a049228-7249-4d1c-a47a-ef7ace67f8de admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:17.919854 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ea2f0c-130c-45bf-9846-01b2bb9ff63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:17.920497 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea2f0c-130c-45bf-9846-01b2bb9ff63f admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:17.920777 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea2f0c-130c-45bf-9846-01b2bb9ff63f admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:17.921049 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea2f0c-130c-45bf-9846-01b2bb9ff63f admin admin] PATH_INFO: `/v3/projects/fcde27bf7c0146e0981d67f40df55eda/users/b1261da55f68408988f2de4311bd381d/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:17.936117 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ea2f0c-130c-45bf-9846-01b2bb9ff63f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcde27bf7c0146e0981d67f40df55eda, user_id=b1261da55f68408988f2de4311bd381d, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:17.938778 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ea2f0c-130c-45bf-9846-01b2bb9ff63f admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:17.999467 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1278/2559] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 20:05:17 2022] PUT /identity/v3/projects/fcde27bf7c0146e0981d67f40df55eda/users/b1261da55f68408988f2de4311bd381d/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:05:18.003393 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490ffcf-0b58-42d4-bcc5-2637333b651c admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:18.013791 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490ffcf-0b58-42d4-bcc5-2637333b651c admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:18.069127 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf65734-6220-4e8f-b5db-f15c976f3803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:18.069680 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf65734-6220-4e8f-b5db-f15c976f3803 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:18.069986 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf65734-6220-4e8f-b5db-f15c976f3803 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:18.070248 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf65734-6220-4e8f-b5db-f15c976f3803 admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:18.070879 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf65734-6220-4e8f-b5db-f15c976f3803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:18.072449 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf65734-6220-4e8f-b5db-f15c976f3803 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:18.082104 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1282/2560] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:05:18.086838 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ea2f0c-130c-45bf-9846-01b2bb9ff63f admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:18.097076 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ea2f0c-130c-45bf-9846-01b2bb9ff63f admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:18.102188 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df6cdc-f0f3-4f01-9680-319c6a53ea6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:18.102852 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df6cdc-f0f3-4f01-9680-319c6a53ea6d admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:18.103127 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df6cdc-f0f3-4f01-9680-319c6a53ea6d admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:18.103396 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df6cdc-f0f3-4f01-9680-319c6a53ea6d admin admin] PATH_INFO: `/v3/projects/fcde27bf7c0146e0981d67f40df55eda/users/b1261da55f68408988f2de4311bd381d/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:18.105278 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22df6cdc-f0f3-4f01-9680-319c6a53ea6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcde27bf7c0146e0981d67f40df55eda, user_id=b1261da55f68408988f2de4311bd381d, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:18.107925 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22df6cdc-f0f3-4f01-9680-319c6a53ea6d admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:18.118305 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1279/2561] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 20:05:18 2022] PUT /identity/v3/projects/fcde27bf7c0146e0981d67f40df55eda/users/b1261da55f68408988f2de4311bd381d/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:05:18.129344 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429fad98-bcd1-4a21-9f95-b2ba6d2bff81 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:18.129667 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429fad98-bcd1-4a21-9f95-b2ba6d2bff81 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:18.129937 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429fad98-bcd1-4a21-9f95-b2ba6d2bff81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:18.158258 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-429fad98-bcd1-4a21-9f95-b2ba6d2bff81 None None] MFA Rules not processed for user `b1261da55f68408988f2de4311bd381d`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:05:18.159448 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-429fad98-bcd1-4a21-9f95-b2ba6d2bff81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:05:18.227243 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1283/2562] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:05:18 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:05:18.239492 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df6cdc-f0f3-4f01-9680-319c6a53ea6d admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:18.241388 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-22df6cdc-f0f3-4f01-9680-319c6a53ea6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:05:18.299000 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df6cdc-f0f3-4f01-9680-319c6a53ea6d admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:18.302568 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b2654c-bc45-4d6b-8b7e-5be396e10a30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:18.303155 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2654c-bc45-4d6b-8b7e-5be396e10a30 service cinder] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:18.303429 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2654c-bc45-4d6b-8b7e-5be396e10a30 service cinder] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:18.303696 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2654c-bc45-4d6b-8b7e-5be396e10a30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:18.312690 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b2654c-bc45-4d6b-8b7e-5be396e10a30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:18.314146 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b2654c-bc45-4d6b-8b7e-5be396e10a30 service cinder] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:18.323635 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1280/2563] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:05:18 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:05:19.214009 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429fad98-bcd1-4a21-9f95-b2ba6d2bff81 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:19.222995 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429fad98-bcd1-4a21-9f95-b2ba6d2bff81 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:19.228379 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5587f06-c4c0-4c64-82ea-79febcd425be tempest-VolumeQuotaClassesTest-206920199 tempest-VolumeQuotaClassesTest-206920199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1261da55f68408988f2de4311bd381d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcde27bf7c0146e0981d67f40df55eda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:19.228968 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5587f06-c4c0-4c64-82ea-79febcd425be tempest-VolumeQuotaClassesTest-206920199 tempest-VolumeQuotaClassesTest-206920199-project-admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:19.229249 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5587f06-c4c0-4c64-82ea-79febcd425be tempest-VolumeQuotaClassesTest-206920199 tempest-VolumeQuotaClassesTest-206920199-project-admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:19.229539 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5587f06-c4c0-4c64-82ea-79febcd425be tempest-VolumeQuotaClassesTest-206920199 tempest-VolumeQuotaClassesTest-206920199-project-admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:19.230174 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5587f06-c4c0-4c64-82ea-79febcd425be tempest-VolumeQuotaClassesTest-206920199 tempest-VolumeQuotaClassesTest-206920199-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:05:19.230475 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5587f06-c4c0-4c64-82ea-79febcd425be tempest-VolumeQuotaClassesTest-206920199 tempest-VolumeQuotaClassesTest-206920199-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:19.232045 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5587f06-c4c0-4c64-82ea-79febcd425be tempest-VolumeQuotaClassesTest-206920199 tempest-VolumeQuotaClassesTest-206920199-project-admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:19.244099 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1284/2564] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 20:05:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:05:19.248327 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b2654c-bc45-4d6b-8b7e-5be396e10a30 service cinder] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:19.257488 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b2654c-bc45-4d6b-8b7e-5be396e10a30 service cinder] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:19.262181 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136efd77-af14-4499-b789-b9b21aef33d7 tempest-VolumeQuotaClassesTest-206920199 tempest-VolumeQuotaClassesTest-206920199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1261da55f68408988f2de4311bd381d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcde27bf7c0146e0981d67f40df55eda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:19.262775 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136efd77-af14-4499-b789-b9b21aef33d7 tempest-VolumeQuotaClassesTest-206920199 tempest-VolumeQuotaClassesTest-206920199-project-admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:19.263058 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136efd77-af14-4499-b789-b9b21aef33d7 tempest-VolumeQuotaClassesTest-206920199 tempest-VolumeQuotaClassesTest-206920199-project-admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:19.263339 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136efd77-af14-4499-b789-b9b21aef33d7 tempest-VolumeQuotaClassesTest-206920199 tempest-VolumeQuotaClassesTest-206920199-project-admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:19.263954 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136efd77-af14-4499-b789-b9b21aef33d7 tempest-VolumeQuotaClassesTest-206920199 tempest-VolumeQuotaClassesTest-206920199-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:19.265960 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136efd77-af14-4499-b789-b9b21aef33d7 tempest-VolumeQuotaClassesTest-206920199 tempest-VolumeQuotaClassesTest-206920199-project-admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:19.281344 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:05:19.336959 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1281/2565] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 20:05:19 2022] POST /identity/v3/projects => generated 355 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:05:19.340944 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5587f06-c4c0-4c64-82ea-79febcd425be tempest-VolumeQuotaClassesTest-206920199 tempest-VolumeQuotaClassesTest-206920199-project-admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:19.350813 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5587f06-c4c0-4c64-82ea-79febcd425be tempest-VolumeQuotaClassesTest-206920199 tempest-VolumeQuotaClassesTest-206920199-project-admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:19.355960 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:05:19.405657 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a962b-2a41-432d-8efa-223e6f8388e0 tempest-VolumeQuotaClassesTest-206920199 tempest-VolumeQuotaClassesTest-206920199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1261da55f68408988f2de4311bd381d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcde27bf7c0146e0981d67f40df55eda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:19.406258 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a962b-2a41-432d-8efa-223e6f8388e0 tempest-VolumeQuotaClassesTest-206920199 tempest-VolumeQuotaClassesTest-206920199-project-admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:19.406539 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a962b-2a41-432d-8efa-223e6f8388e0 tempest-VolumeQuotaClassesTest-206920199 tempest-VolumeQuotaClassesTest-206920199-project-admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:19.406810 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a962b-2a41-432d-8efa-223e6f8388e0 tempest-VolumeQuotaClassesTest-206920199 tempest-VolumeQuotaClassesTest-206920199-project-admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:19.407446 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a962b-2a41-432d-8efa-223e6f8388e0 tempest-VolumeQuotaClassesTest-206920199 tempest-VolumeQuotaClassesTest-206920199-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:05:19.407747 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a962b-2a41-432d-8efa-223e6f8388e0 tempest-VolumeQuotaClassesTest-206920199 tempest-VolumeQuotaClassesTest-206920199-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:19.409332 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a962b-2a41-432d-8efa-223e6f8388e0 tempest-VolumeQuotaClassesTest-206920199 tempest-VolumeQuotaClassesTest-206920199-project-admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:19.421770 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1285/2566] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 20:05:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:05:19.459255 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136efd77-af14-4499-b789-b9b21aef33d7 tempest-VolumeQuotaClassesTest-206920199 tempest-VolumeQuotaClassesTest-206920199-project-admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:19.469622 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136efd77-af14-4499-b789-b9b21aef33d7 tempest-VolumeQuotaClassesTest-206920199 tempest-VolumeQuotaClassesTest-206920199-project-admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:19.474327 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4816f7e3-95db-4643-86bf-ddf255959b2c tempest-VolumeQuotaClassesTest-206920199 tempest-VolumeQuotaClassesTest-206920199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1261da55f68408988f2de4311bd381d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcde27bf7c0146e0981d67f40df55eda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:19.474983 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816f7e3-95db-4643-86bf-ddf255959b2c tempest-VolumeQuotaClassesTest-206920199 tempest-VolumeQuotaClassesTest-206920199-project-admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:19.475264 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816f7e3-95db-4643-86bf-ddf255959b2c tempest-VolumeQuotaClassesTest-206920199 tempest-VolumeQuotaClassesTest-206920199-project-admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:19.475537 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816f7e3-95db-4643-86bf-ddf255959b2c tempest-VolumeQuotaClassesTest-206920199 tempest-VolumeQuotaClassesTest-206920199-project-admin] PATH_INFO: `/v3/projects/a720bce00988458dae7d974de831aaf8` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:19.476671 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4816f7e3-95db-4643-86bf-ddf255959b2c tempest-VolumeQuotaClassesTest-206920199 tempest-VolumeQuotaClassesTest-206920199-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a720bce00988458dae7d974de831aaf8)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:19.479387 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4816f7e3-95db-4643-86bf-ddf255959b2c tempest-VolumeQuotaClassesTest-206920199 tempest-VolumeQuotaClassesTest-206920199-project-admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:19.585256 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-4816f7e3-95db-4643-86bf-ddf255959b2c tempest-VolumeQuotaClassesTest-206920199 tempest-VolumeQuotaClassesTest-206920199-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a720bce00988458dae7d974de831aaf8', 'request_id': 'req-4816f7e3-95db-4643-86bf-ddf255959b2c'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:19.647774 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-4816f7e3-95db-4643-86bf-ddf255959b2c tempest-VolumeQuotaClassesTest-206920199 tempest-VolumeQuotaClassesTest-206920199-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a720bce00988458dae7d974de831aaf8', 'request_id': 'req-4816f7e3-95db-4643-86bf-ddf255959b2c'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:19.654018 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-4816f7e3-95db-4643-86bf-ddf255959b2c tempest-VolumeQuotaClassesTest-206920199 tempest-VolumeQuotaClassesTest-206920199-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a720bce00988458dae7d974de831aaf8', 'request_id': 'req-4816f7e3-95db-4643-86bf-ddf255959b2c'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:19.667121 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-4816f7e3-95db-4643-86bf-ddf255959b2c tempest-VolumeQuotaClassesTest-206920199 tempest-VolumeQuotaClassesTest-206920199-project-admin] The token cache is being invalidate because project a720bce00988458dae7d974de831aaf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 20:05:19.667398 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-4816f7e3-95db-4643-86bf-ddf255959b2c tempest-VolumeQuotaClassesTest-206920199 tempest-VolumeQuotaClassesTest-206920199-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:19.668056 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-4816f7e3-95db-4643-86bf-ddf255959b2c tempest-VolumeQuotaClassesTest-206920199 tempest-VolumeQuotaClassesTest-206920199-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:19.669572 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1282/2567] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 20:05:19 2022] DELETE /identity/v3/projects/a720bce00988458dae7d974de831aaf8 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:05:20.181121 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a962b-2a41-432d-8efa-223e6f8388e0 tempest-VolumeQuotaClassesTest-206920199 tempest-VolumeQuotaClassesTest-206920199-project-admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:20.182952 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-e64a962b-2a41-432d-8efa-223e6f8388e0 tempest-VolumeQuotaClassesTest-206920199 tempest-VolumeQuotaClassesTest-206920199-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:05:20.249135 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a962b-2a41-432d-8efa-223e6f8388e0 tempest-VolumeQuotaClassesTest-206920199 tempest-VolumeQuotaClassesTest-206920199-project-admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:20.305882 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f386a-3c03-4e48-94db-da55536048fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:20.306652 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f386a-3c03-4e48-94db-da55536048fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:20.306932 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f386a-3c03-4e48-94db-da55536048fa admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:20.307207 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f386a-3c03-4e48-94db-da55536048fa admin admin] PATH_INFO: `/v3/users/e2ef3210bb5a4856804eed96c0288a67` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:20.308365 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f386a-3c03-4e48-94db-da55536048fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2ef3210bb5a4856804eed96c0288a67)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:20.310326 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f386a-3c03-4e48-94db-da55536048fa admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:20.550016 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-6d5f386a-3c03-4e48-94db-da55536048fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2ef3210bb5a4856804eed96c0288a67'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:20.553693 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:05:20.672786 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-6d5f386a-3c03-4e48-94db-da55536048fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2ef3210bb5a4856804eed96c0288a67'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:20.673343 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-6d5f386a-3c03-4e48-94db-da55536048fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2ef3210bb5a4856804eed96c0288a67'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:20.674033 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-6d5f386a-3c03-4e48-94db-da55536048fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2ef3210bb5a4856804eed96c0288a67'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:20.693531 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-6d5f386a-3c03-4e48-94db-da55536048fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2ef3210bb5a4856804eed96c0288a67'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:20.701205 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1286/2568] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 20:05:20 2022] DELETE /identity/v3/users/e2ef3210bb5a4856804eed96c0288a67 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:05:20.705715 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b09e5c-1e35-432b-bb5a-d5160b7b04dc None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:20.706201 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b09e5c-1e35-432b-bb5a-d5160b7b04dc None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:20.706313 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b09e5c-1e35-432b-bb5a-d5160b7b04dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:20.725996 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-b4b09e5c-1e35-432b-bb5a-d5160b7b04dc None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:05:20.727226 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-b4b09e5c-1e35-432b-bb5a-d5160b7b04dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:05:20.787134 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1283/2569] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:05:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:05:20.797039 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f386a-3c03-4e48-94db-da55536048fa admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:20.798478 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-6d5f386a-3c03-4e48-94db-da55536048fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:05:20.856774 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f386a-3c03-4e48-94db-da55536048fa admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:20.860419 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50408a-8181-42ef-9bc1-4effb86fadae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:20.861016 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50408a-8181-42ef-9bc1-4effb86fadae service neutron] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:20.861294 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50408a-8181-42ef-9bc1-4effb86fadae service neutron] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:20.861591 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50408a-8181-42ef-9bc1-4effb86fadae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:20.870879 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f50408a-8181-42ef-9bc1-4effb86fadae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:20.872304 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f50408a-8181-42ef-9bc1-4effb86fadae service neutron] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:20.881686 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1287/2570] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:05:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:05:21.292636 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b09e5c-1e35-432b-bb5a-d5160b7b04dc None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:21.295178 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-b4b09e5c-1e35-432b-bb5a-d5160b7b04dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:05:21.306417 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b09e5c-1e35-432b-bb5a-d5160b7b04dc None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:21.311121 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90407122-2b84-4fdf-9c84-d69028d208e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:21.311778 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90407122-2b84-4fdf-9c84-d69028d208e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:21.312055 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90407122-2b84-4fdf-9c84-d69028d208e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:21.312332 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90407122-2b84-4fdf-9c84-d69028d208e8 admin admin] PATH_INFO: `/v3/projects/b75f33b30ad14a0897edc828dd124e5a` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:21.313444 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90407122-2b84-4fdf-9c84-d69028d208e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b75f33b30ad14a0897edc828dd124e5a)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:21.315371 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90407122-2b84-4fdf-9c84-d69028d208e8 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:21.433385 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-90407122-2b84-4fdf-9c84-d69028d208e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b75f33b30ad14a0897edc828dd124e5a', 'request_id': 'req-90407122-2b84-4fdf-9c84-d69028d208e8'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:21.504635 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-90407122-2b84-4fdf-9c84-d69028d208e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b75f33b30ad14a0897edc828dd124e5a', 'request_id': 'req-90407122-2b84-4fdf-9c84-d69028d208e8'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:21.511181 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-90407122-2b84-4fdf-9c84-d69028d208e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b75f33b30ad14a0897edc828dd124e5a', 'request_id': 'req-90407122-2b84-4fdf-9c84-d69028d208e8'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:21.518850 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:INSERT=3,keystone:SELECT=83,keystone:DELETE=14 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:05:21.522551 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-90407122-2b84-4fdf-9c84-d69028d208e8 admin admin] The token cache is being invalidate because project b75f33b30ad14a0897edc828dd124e5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 20:05:21.522832 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-90407122-2b84-4fdf-9c84-d69028d208e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:21.523454 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-90407122-2b84-4fdf-9c84-d69028d208e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:21.525691 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1284/2571] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 20:05:21 2022] DELETE /identity/v3/projects/b75f33b30ad14a0897edc828dd124e5a => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:05:21.529718 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50408a-8181-42ef-9bc1-4effb86fadae service neutron] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:21.539443 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50408a-8181-42ef-9bc1-4effb86fadae service neutron] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:21.595849 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51722cff-8fca-444a-b960-5012032b9442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:21.596474 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51722cff-8fca-444a-b960-5012032b9442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:21.596751 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51722cff-8fca-444a-b960-5012032b9442 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:21.597020 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51722cff-8fca-444a-b960-5012032b9442 admin admin] PATH_INFO: `/v3/users/b1261da55f68408988f2de4311bd381d` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:21.598147 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51722cff-8fca-444a-b960-5012032b9442 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1261da55f68408988f2de4311bd381d)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:21.600044 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51722cff-8fca-444a-b960-5012032b9442 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:21.838902 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-51722cff-8fca-444a-b960-5012032b9442 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1261da55f68408988f2de4311bd381d'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:21.910315 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-51722cff-8fca-444a-b960-5012032b9442 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1261da55f68408988f2de4311bd381d'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:21.910925 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-51722cff-8fca-444a-b960-5012032b9442 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1261da55f68408988f2de4311bd381d'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:21.911523 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-51722cff-8fca-444a-b960-5012032b9442 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1261da55f68408988f2de4311bd381d'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:21.923924 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-51722cff-8fca-444a-b960-5012032b9442 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1261da55f68408988f2de4311bd381d'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:21.925933 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:05:21.936927 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1288/2572] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 20:05:21 2022] DELETE /identity/v3/users/b1261da55f68408988f2de4311bd381d => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:05:22.372508 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90407122-2b84-4fdf-9c84-d69028d208e8 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:22.374042 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-90407122-2b84-4fdf-9c84-d69028d208e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:05:22.388608 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90407122-2b84-4fdf-9c84-d69028d208e8 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:22.445283 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d569e7ab-cfdd-46fa-bcaf-9d60a5dc255a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:22.446486 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569e7ab-cfdd-46fa-bcaf-9d60a5dc255a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:22.446761 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569e7ab-cfdd-46fa-bcaf-9d60a5dc255a admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:22.447029 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569e7ab-cfdd-46fa-bcaf-9d60a5dc255a admin admin] PATH_INFO: `/v3/projects/fcde27bf7c0146e0981d67f40df55eda` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:22.448352 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d569e7ab-cfdd-46fa-bcaf-9d60a5dc255a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcde27bf7c0146e0981d67f40df55eda)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:22.450272 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d569e7ab-cfdd-46fa-bcaf-9d60a5dc255a admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:22.552922 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-d569e7ab-cfdd-46fa-bcaf-9d60a5dc255a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcde27bf7c0146e0981d67f40df55eda', 'request_id': 'req-d569e7ab-cfdd-46fa-bcaf-9d60a5dc255a'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:22.615686 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-d569e7ab-cfdd-46fa-bcaf-9d60a5dc255a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcde27bf7c0146e0981d67f40df55eda', 'request_id': 'req-d569e7ab-cfdd-46fa-bcaf-9d60a5dc255a'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:22.622083 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-d569e7ab-cfdd-46fa-bcaf-9d60a5dc255a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcde27bf7c0146e0981d67f40df55eda', 'request_id': 'req-d569e7ab-cfdd-46fa-bcaf-9d60a5dc255a'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:22.632990 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-d569e7ab-cfdd-46fa-bcaf-9d60a5dc255a admin admin] The token cache is being invalidate because project fcde27bf7c0146e0981d67f40df55eda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 20:05:22.633917 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-d569e7ab-cfdd-46fa-bcaf-9d60a5dc255a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:22.634553 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-d569e7ab-cfdd-46fa-bcaf-9d60a5dc255a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:22.636030 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1285/2573] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 20:05:22 2022] DELETE /identity/v3/projects/fcde27bf7c0146e0981d67f40df55eda => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:05:22.640913 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83128c-a3ec-431f-8024-5e0f8b8f54a3 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:22.641395 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83128c-a3ec-431f-8024-5e0f8b8f54a3 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:22.641506 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83128c-a3ec-431f-8024-5e0f8b8f54a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:22.661004 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-dd83128c-a3ec-431f-8024-5e0f8b8f54a3 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:05:22.662261 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-dd83128c-a3ec-431f-8024-5e0f8b8f54a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:05:22.722520 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1289/2574] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:05:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:05:22.730531 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863905e-50f4-48bf-ba22-4fe700232184 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:22.730823 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863905e-50f4-48bf-ba22-4fe700232184 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:22.731102 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863905e-50f4-48bf-ba22-4fe700232184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:22.751149 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-e863905e-50f4-48bf-ba22-4fe700232184 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:05:22.752352 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-e863905e-50f4-48bf-ba22-4fe700232184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:05:22.761009 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1286/2575] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:05:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:05:22.765153 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83128c-a3ec-431f-8024-5e0f8b8f54a3 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:22.774823 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83128c-a3ec-431f-8024-5e0f8b8f54a3 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:22.780204 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db85b5b-4cfe-4c92-93f1-575eb1d8c920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:22.780795 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db85b5b-4cfe-4c92-93f1-575eb1d8c920 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:22.781074 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db85b5b-4cfe-4c92-93f1-575eb1d8c920 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:22.781344 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db85b5b-4cfe-4c92-93f1-575eb1d8c920 admin admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:22.782022 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db85b5b-4cfe-4c92-93f1-575eb1d8c920 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:05:22.782329 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db85b5b-4cfe-4c92-93f1-575eb1d8c920 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:22.783905 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db85b5b-4cfe-4c92-93f1-575eb1d8c920 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:22.795446 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1290/2576] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 20:05:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:05:22.799619 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e863905e-50f4-48bf-ba22-4fe700232184 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:22.809469 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e863905e-50f4-48bf-ba22-4fe700232184 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:22.814189 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e33f6ef-0c1b-4a10-9f62-a827993d129f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:22.814781 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33f6ef-0c1b-4a10-9f62-a827993d129f admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:22.815084 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33f6ef-0c1b-4a10-9f62-a827993d129f admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:22.815364 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33f6ef-0c1b-4a10-9f62-a827993d129f admin admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:22.816004 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e33f6ef-0c1b-4a10-9f62-a827993d129f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:22.817979 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e33f6ef-0c1b-4a10-9f62-a827993d129f admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:22.931436 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1287/2577] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 20:05:22 2022] POST /identity/v3/projects => generated 401 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:05:22.935783 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db85b5b-4cfe-4c92-93f1-575eb1d8c920 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:22.946416 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db85b5b-4cfe-4c92-93f1-575eb1d8c920 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:23.003962 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684be7e4-c8c7-4a9e-9b94-0cea2341e805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:23.004555 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684be7e4-c8c7-4a9e-9b94-0cea2341e805 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:23.004829 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684be7e4-c8c7-4a9e-9b94-0cea2341e805 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:23.005095 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684be7e4-c8c7-4a9e-9b94-0cea2341e805 admin admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:23.005746 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684be7e4-c8c7-4a9e-9b94-0cea2341e805 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:23.007622 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684be7e4-c8c7-4a9e-9b94-0cea2341e805 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:23.061806 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1291/2578] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 20:05:22 2022] POST /identity/v3/users => generated 301 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:05:23.066086 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e33f6ef-0c1b-4a10-9f62-a827993d129f admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:23.076809 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e33f6ef-0c1b-4a10-9f62-a827993d129f admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:23.081446 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03394c0-b021-4a48-a399-549120b03dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:23.082067 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03394c0-b021-4a48-a399-549120b03dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:23.082348 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03394c0-b021-4a48-a399-549120b03dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:23.082623 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03394c0-b021-4a48-a399-549120b03dd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:23.083264 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03394c0-b021-4a48-a399-549120b03dd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:23.084846 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03394c0-b021-4a48-a399-549120b03dd6 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:23.094847 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1288/2579] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:05:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:05:23.099021 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684be7e4-c8c7-4a9e-9b94-0cea2341e805 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:23.109622 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684be7e4-c8c7-4a9e-9b94-0cea2341e805 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:23.114165 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badb8017-e1f7-47bd-ade0-5688405050f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:23.114749 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb8017-e1f7-47bd-ade0-5688405050f3 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:23.115022 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb8017-e1f7-47bd-ade0-5688405050f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:23.115288 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb8017-e1f7-47bd-ade0-5688405050f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:23.115914 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badb8017-e1f7-47bd-ade0-5688405050f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:23.117543 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badb8017-e1f7-47bd-ade0-5688405050f3 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:23.127798 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1292/2580] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:05:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:05:23.131849 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03394c0-b021-4a48-a399-549120b03dd6 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:23.142580 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03394c0-b021-4a48-a399-549120b03dd6 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:23.147377 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f36896-00f5-4d27-abfe-17d23ee5a4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:23.148023 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f36896-00f5-4d27-abfe-17d23ee5a4db admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:23.148310 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f36896-00f5-4d27-abfe-17d23ee5a4db admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:23.148591 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f36896-00f5-4d27-abfe-17d23ee5a4db admin admin] PATH_INFO: `/v3/projects/7f55320e554742df8a3325ec93f04eca/users/8898f89fcdd8429fb65590c323907845/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:23.164343 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f36896-00f5-4d27-abfe-17d23ee5a4db admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f55320e554742df8a3325ec93f04eca, user_id=8898f89fcdd8429fb65590c323907845, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:23.167803 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f36896-00f5-4d27-abfe-17d23ee5a4db admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:23.238555 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1289/2581] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 20:05:23 2022] PUT /identity/v3/projects/7f55320e554742df8a3325ec93f04eca/users/8898f89fcdd8429fb65590c323907845/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:05:23.249661 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a9eb0-55fa-4352-afcb-7467b4db716d None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:23.285968 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a9eb0-55fa-4352-afcb-7467b4db716d None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:23.285968 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a9eb0-55fa-4352-afcb-7467b4db716d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:23.285968 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-6c1a9eb0-55fa-4352-afcb-7467b4db716d None None] MFA Rules not processed for user `8898f89fcdd8429fb65590c323907845`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:05:23.285968 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-6c1a9eb0-55fa-4352-afcb-7467b4db716d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:05:23.323607 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:05:23.345121 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1293/2582] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:05:23 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:05:23.349708 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f36896-00f5-4d27-abfe-17d23ee5a4db admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:23.379735 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:05:23.412974 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f36896-00f5-4d27-abfe-17d23ee5a4db admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:23.418443 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f92e4-efe8-4a16-93f4-d4d5306c61f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:23.419070 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f92e4-efe8-4a16-93f4-d4d5306c61f8 admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:23.419324 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f92e4-efe8-4a16-93f4-d4d5306c61f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:23.419624 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f92e4-efe8-4a16-93f4-d4d5306c61f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:23.420261 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f92e4-efe8-4a16-93f4-d4d5306c61f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:23.422223 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f92e4-efe8-4a16-93f4-d4d5306c61f8 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:23.513833 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1290/2583] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 20:05:23 2022] POST /identity/v3/projects => generated 401 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:05:23.517948 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a9eb0-55fa-4352-afcb-7467b4db716d None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:23.529591 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a9eb0-55fa-4352-afcb-7467b4db716d None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:23.584876 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9039ab9-96cc-48e3-8396-5b67fbef4a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:23.585470 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9039ab9-96cc-48e3-8396-5b67fbef4a66 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:23.585785 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9039ab9-96cc-48e3-8396-5b67fbef4a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:23.586053 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9039ab9-96cc-48e3-8396-5b67fbef4a66 admin admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:23.587384 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9039ab9-96cc-48e3-8396-5b67fbef4a66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:23.589402 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9039ab9-96cc-48e3-8396-5b67fbef4a66 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:23.684818 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1294/2584] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 20:05:23 2022] POST /identity/v3/users => generated 307 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 20:05:23.689002 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f92e4-efe8-4a16-93f4-d4d5306c61f8 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:23.699871 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f92e4-efe8-4a16-93f4-d4d5306c61f8 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:23.704740 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e45bc7-1b19-4f32-8174-2977263d344a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:23.705367 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e45bc7-1b19-4f32-8174-2977263d344a admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:23.705721 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e45bc7-1b19-4f32-8174-2977263d344a admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:23.705994 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e45bc7-1b19-4f32-8174-2977263d344a admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:23.706666 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e45bc7-1b19-4f32-8174-2977263d344a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:23.708235 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e45bc7-1b19-4f32-8174-2977263d344a admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:23.718773 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1291/2585] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:05:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:05:23.722815 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9039ab9-96cc-48e3-8396-5b67fbef4a66 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:23.737459 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9039ab9-96cc-48e3-8396-5b67fbef4a66 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:23.742538 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ae3331-8d81-49c3-918f-0275b63e15bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:23.743250 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae3331-8d81-49c3-918f-0275b63e15bd admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:23.743525 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae3331-8d81-49c3-918f-0275b63e15bd admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:23.743799 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae3331-8d81-49c3-918f-0275b63e15bd admin admin] PATH_INFO: `/v3/projects/48c80abea32d47df830f1f0db5db2f25/users/0dd38c747c10484183ee13fa13522036/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:23.759174 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ae3331-8d81-49c3-918f-0275b63e15bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=48c80abea32d47df830f1f0db5db2f25, user_id=0dd38c747c10484183ee13fa13522036, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:23.761826 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ae3331-8d81-49c3-918f-0275b63e15bd admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:23.936875 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1295/2586] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 20:05:23 2022] PUT /identity/v3/projects/48c80abea32d47df830f1f0db5db2f25/users/0dd38c747c10484183ee13fa13522036/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:05:23.940857 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e45bc7-1b19-4f32-8174-2977263d344a admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:23.951500 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e45bc7-1b19-4f32-8174-2977263d344a admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:24.006466 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287a99c-2394-4592-ba60-64e60844923b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:24.013752 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287a99c-2394-4592-ba60-64e60844923b admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:24.013752 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287a99c-2394-4592-ba60-64e60844923b admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:24.013752 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287a99c-2394-4592-ba60-64e60844923b admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:24.013752 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d287a99c-2394-4592-ba60-64e60844923b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:24.013752 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d287a99c-2394-4592-ba60-64e60844923b admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:24.019793 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1292/2587] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:05:23 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 20:05:24.024669 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ae3331-8d81-49c3-918f-0275b63e15bd admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:24.035110 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ae3331-8d81-49c3-918f-0275b63e15bd admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:24.039773 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e723c77-4421-4bf2-9819-d74073c3d684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:24.040436 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e723c77-4421-4bf2-9819-d74073c3d684 admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:24.040713 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e723c77-4421-4bf2-9819-d74073c3d684 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:24.040980 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e723c77-4421-4bf2-9819-d74073c3d684 admin admin] PATH_INFO: `/v3/projects/48c80abea32d47df830f1f0db5db2f25/users/0dd38c747c10484183ee13fa13522036/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:24.042904 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e723c77-4421-4bf2-9819-d74073c3d684 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48c80abea32d47df830f1f0db5db2f25, user_id=0dd38c747c10484183ee13fa13522036, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:24.045554 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e723c77-4421-4bf2-9819-d74073c3d684 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:24.056518 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1296/2588] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 20:05:24 2022] PUT /identity/v3/projects/48c80abea32d47df830f1f0db5db2f25/users/0dd38c747c10484183ee13fa13522036/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 20:05:24.067881 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf57064-b6ca-4c06-9be6-c350c2a8c6af None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:24.071596 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf57064-b6ca-4c06-9be6-c350c2a8c6af None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:24.071596 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf57064-b6ca-4c06-9be6-c350c2a8c6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:24.096822 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-1bf57064-b6ca-4c06-9be6-c350c2a8c6af None None] MFA Rules not processed for user `0dd38c747c10484183ee13fa13522036`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:05:24.098066 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-1bf57064-b6ca-4c06-9be6-c350c2a8c6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:05:24.165883 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1293/2589] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:05:24 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:05:24.177971 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e723c77-4421-4bf2-9819-d74073c3d684 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:24.179969 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-7e723c77-4421-4bf2-9819-d74073c3d684 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:05:24.237264 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e723c77-4421-4bf2-9819-d74073c3d684 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:24.240995 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb4dc4-64c5-4c52-b2f3-eae0a06a7258 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:24.241615 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb4dc4-64c5-4c52-b2f3-eae0a06a7258 service cinder] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:24.241892 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb4dc4-64c5-4c52-b2f3-eae0a06a7258 service cinder] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:24.242175 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb4dc4-64c5-4c52-b2f3-eae0a06a7258 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:24.250917 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbb4dc4-64c5-4c52-b2f3-eae0a06a7258 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:24.252355 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbb4dc4-64c5-4c52-b2f3-eae0a06a7258 service cinder] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:24.261756 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1297/2590] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:05:24 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:05:24.482093 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf57064-b6ca-4c06-9be6-c350c2a8c6af None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:24.492444 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf57064-b6ca-4c06-9be6-c350c2a8c6af None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:24.496831 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aba003c-ef82-4403-a8ad-c43adfa55154 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:24.497452 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba003c-ef82-4403-a8ad-c43adfa55154 service cinder] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:24.497758 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba003c-ef82-4403-a8ad-c43adfa55154 service cinder] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:24.498033 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba003c-ef82-4403-a8ad-c43adfa55154 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:24.516640 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:05:24.556431 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aba003c-ef82-4403-a8ad-c43adfa55154 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:24.557917 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aba003c-ef82-4403-a8ad-c43adfa55154 service cinder] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:24.567128 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1294/2591] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:05:24 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:05:29.791736 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb4dc4-64c5-4c52-b2f3-eae0a06a7258 service cinder] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:29.837864 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:05:29.855446 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb4dc4-64c5-4c52-b2f3-eae0a06a7258 service cinder] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:29.860012 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f8dd5-d6e9-4c11-98e7-bd1eeb256d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:29.860634 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f8dd5-d6e9-4c11-98e7-bd1eeb256d25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:29.860911 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f8dd5-d6e9-4c11-98e7-bd1eeb256d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:29.861181 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f8dd5-d6e9-4c11-98e7-bd1eeb256d25 admin admin] PATH_INFO: `/v3/users/8898f89fcdd8429fb65590c323907845` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:29.862337 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f8dd5-d6e9-4c11-98e7-bd1eeb256d25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8898f89fcdd8429fb65590c323907845)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:29.864240 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f8dd5-d6e9-4c11-98e7-bd1eeb256d25 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:30.013309 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-b20f8dd5-d6e9-4c11-98e7-bd1eeb256d25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8898f89fcdd8429fb65590c323907845'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:30.061033 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-b20f8dd5-d6e9-4c11-98e7-bd1eeb256d25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8898f89fcdd8429fb65590c323907845'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:30.061667 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-b20f8dd5-d6e9-4c11-98e7-bd1eeb256d25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8898f89fcdd8429fb65590c323907845'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:30.062262 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-b20f8dd5-d6e9-4c11-98e7-bd1eeb256d25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8898f89fcdd8429fb65590c323907845'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:30.076224 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-b20f8dd5-d6e9-4c11-98e7-bd1eeb256d25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8898f89fcdd8429fb65590c323907845'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:30.088359 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1298/2592] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 20:05:29 2022] DELETE /identity/v3/users/8898f89fcdd8429fb65590c323907845 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 20:05:30.093631 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4e569-60e4-4bd9-825f-2f7c98e64267 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:30.094133 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4e569-60e4-4bd9-825f-2f7c98e64267 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:30.094545 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4e569-60e4-4bd9-825f-2f7c98e64267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:30.115454 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-b2e4e569-60e4-4bd9-825f-2f7c98e64267 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:05:30.116659 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-b2e4e569-60e4-4bd9-825f-2f7c98e64267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:05:30.177002 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1295/2593] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:05:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:05:30.187438 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f8dd5-d6e9-4c11-98e7-bd1eeb256d25 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:30.189020 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-b20f8dd5-d6e9-4c11-98e7-bd1eeb256d25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:05:30.248117 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f8dd5-d6e9-4c11-98e7-bd1eeb256d25 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:30.251767 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f0f8e-c3cf-4c31-a6d9-2bd31b29dd5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:30.252373 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f0f8e-c3cf-4c31-a6d9-2bd31b29dd5c service neutron] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:30.252653 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f0f8e-c3cf-4c31-a6d9-2bd31b29dd5c service neutron] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:30.252926 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f0f8e-c3cf-4c31-a6d9-2bd31b29dd5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:30.263324 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3f0f8e-c3cf-4c31-a6d9-2bd31b29dd5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:30.264752 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3f0f8e-c3cf-4c31-a6d9-2bd31b29dd5c service neutron] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:30.275336 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1299/2594] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:05:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:05:30.715050 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e4e569-60e4-4bd9-825f-2f7c98e64267 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:30.716656 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-b2e4e569-60e4-4bd9-825f-2f7c98e64267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:05:30.730118 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e4e569-60e4-4bd9-825f-2f7c98e64267 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:30.737849 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f119a-fee0-4194-8eea-3c97df8233f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:30.739314 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f119a-fee0-4194-8eea-3c97df8233f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:30.739314 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f119a-fee0-4194-8eea-3c97df8233f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:30.739314 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f119a-fee0-4194-8eea-3c97df8233f5 admin admin] PATH_INFO: `/v3/projects/7f55320e554742df8a3325ec93f04eca` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:30.740410 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560f119a-fee0-4194-8eea-3c97df8233f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f55320e554742df8a3325ec93f04eca)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:30.742372 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560f119a-fee0-4194-8eea-3c97df8233f5 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:30.870887 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-560f119a-fee0-4194-8eea-3c97df8233f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f55320e554742df8a3325ec93f04eca', 'request_id': 'req-560f119a-fee0-4194-8eea-3c97df8233f5'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:30.935894 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-560f119a-fee0-4194-8eea-3c97df8233f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f55320e554742df8a3325ec93f04eca', 'request_id': 'req-560f119a-fee0-4194-8eea-3c97df8233f5'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:30.941974 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-560f119a-fee0-4194-8eea-3c97df8233f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f55320e554742df8a3325ec93f04eca', 'request_id': 'req-560f119a-fee0-4194-8eea-3c97df8233f5'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:30.953322 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-560f119a-fee0-4194-8eea-3c97df8233f5 admin admin] The token cache is being invalidate because project 7f55320e554742df8a3325ec93f04eca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 20:05:30.953640 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-560f119a-fee0-4194-8eea-3c97df8233f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:30.954249 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-560f119a-fee0-4194-8eea-3c97df8233f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:30.955733 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1296/2595] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 20:05:30 2022] DELETE /identity/v3/projects/7f55320e554742df8a3325ec93f04eca => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:05:30.959949 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f0f8e-c3cf-4c31-a6d9-2bd31b29dd5c service neutron] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:30.970853 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f0f8e-c3cf-4c31-a6d9-2bd31b29dd5c service neutron] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:31.026820 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f2e5c2-6173-4e33-a0dd-2a2286ed514c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:31.027449 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2e5c2-6173-4e33-a0dd-2a2286ed514c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:31.027729 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2e5c2-6173-4e33-a0dd-2a2286ed514c admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:31.028003 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2e5c2-6173-4e33-a0dd-2a2286ed514c admin admin] PATH_INFO: `/v3/users/0dd38c747c10484183ee13fa13522036` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:31.029141 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f2e5c2-6173-4e33-a0dd-2a2286ed514c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dd38c747c10484183ee13fa13522036)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:31.031077 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f2e5c2-6173-4e33-a0dd-2a2286ed514c admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:31.035792 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:05:31.256513 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-c8f2e5c2-6173-4e33-a0dd-2a2286ed514c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dd38c747c10484183ee13fa13522036'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:31.341104 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-c8f2e5c2-6173-4e33-a0dd-2a2286ed514c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dd38c747c10484183ee13fa13522036'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:31.341760 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-c8f2e5c2-6173-4e33-a0dd-2a2286ed514c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dd38c747c10484183ee13fa13522036'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:31.342367 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-c8f2e5c2-6173-4e33-a0dd-2a2286ed514c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dd38c747c10484183ee13fa13522036'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:31.355540 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-c8f2e5c2-6173-4e33-a0dd-2a2286ed514c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dd38c747c10484183ee13fa13522036'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:31.368130 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1300/2596] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 20:05:30 2022] DELETE /identity/v3/users/0dd38c747c10484183ee13fa13522036 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:05:31.771359 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f119a-fee0-4194-8eea-3c97df8233f5 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:31.772819 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-560f119a-fee0-4194-8eea-3c97df8233f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:05:31.789159 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f119a-fee0-4194-8eea-3c97df8233f5 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:31.832377 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:05:31.847038 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e09ee2b-e47d-4e82-8e55-5a5d2ddf227c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:31.847669 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09ee2b-e47d-4e82-8e55-5a5d2ddf227c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:31.847946 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09ee2b-e47d-4e82-8e55-5a5d2ddf227c admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:31.848214 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09ee2b-e47d-4e82-8e55-5a5d2ddf227c admin admin] PATH_INFO: `/v3/projects/48c80abea32d47df830f1f0db5db2f25` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:31.849306 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e09ee2b-e47d-4e82-8e55-5a5d2ddf227c admin admin] RBAC: Authorizing `identity:delete_project(project_id=48c80abea32d47df830f1f0db5db2f25)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:31.851346 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e09ee2b-e47d-4e82-8e55-5a5d2ddf227c admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:31.964770 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-2e09ee2b-e47d-4e82-8e55-5a5d2ddf227c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48c80abea32d47df830f1f0db5db2f25', 'request_id': 'req-2e09ee2b-e47d-4e82-8e55-5a5d2ddf227c'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:32.042168 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-2e09ee2b-e47d-4e82-8e55-5a5d2ddf227c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48c80abea32d47df830f1f0db5db2f25', 'request_id': 'req-2e09ee2b-e47d-4e82-8e55-5a5d2ddf227c'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:32.048819 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-2e09ee2b-e47d-4e82-8e55-5a5d2ddf227c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48c80abea32d47df830f1f0db5db2f25', 'request_id': 'req-2e09ee2b-e47d-4e82-8e55-5a5d2ddf227c'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:32.061267 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-2e09ee2b-e47d-4e82-8e55-5a5d2ddf227c admin admin] The token cache is being invalidate because project 48c80abea32d47df830f1f0db5db2f25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 20:05:32.061516 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-2e09ee2b-e47d-4e82-8e55-5a5d2ddf227c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:32.062158 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-2e09ee2b-e47d-4e82-8e55-5a5d2ddf227c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:32.063662 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1297/2597] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 20:05:31 2022] DELETE /identity/v3/projects/48c80abea32d47df830f1f0db5db2f25 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:05:32.068668 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ecc296-a917-45b0-ae48-9cb00e029099 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:32.069141 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ecc296-a917-45b0-ae48-9cb00e029099 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:32.069244 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ecc296-a917-45b0-ae48-9cb00e029099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:32.090177 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-b7ecc296-a917-45b0-ae48-9cb00e029099 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:05:32.091358 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-b7ecc296-a917-45b0-ae48-9cb00e029099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:05:32.153182 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1301/2598] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:05:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:05:32.160889 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd5b71-f906-468a-a430-0d546ea6daff None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:32.161684 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd5b71-f906-468a-a430-0d546ea6daff None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:32.161684 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd5b71-f906-468a-a430-0d546ea6daff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:32.183182 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-05fd5b71-f906-468a-a430-0d546ea6daff None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:05:32.184440 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-05fd5b71-f906-468a-a430-0d546ea6daff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:05:32.192587 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1298/2599] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:05:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:05:32.196923 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ecc296-a917-45b0-ae48-9cb00e029099 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:32.206961 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ecc296-a917-45b0-ae48-9cb00e029099 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:32.211995 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0468901-846f-4985-b0c5-482d5335be16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:32.212644 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0468901-846f-4985-b0c5-482d5335be16 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:32.212946 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0468901-846f-4985-b0c5-482d5335be16 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:32.213252 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0468901-846f-4985-b0c5-482d5335be16 admin admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:32.219105 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0468901-846f-4985-b0c5-482d5335be16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:05:32.219105 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0468901-846f-4985-b0c5-482d5335be16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:32.219105 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0468901-846f-4985-b0c5-482d5335be16 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:32.235576 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1302/2600] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 20:05:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:05:32.239996 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd5b71-f906-468a-a430-0d546ea6daff None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:32.249855 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd5b71-f906-468a-a430-0d546ea6daff None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:32.254400 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e634b5a7-d0c3-4f85-b2c3-5eeb417a061e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:32.254998 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634b5a7-d0c3-4f85-b2c3-5eeb417a061e admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:32.255275 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634b5a7-d0c3-4f85-b2c3-5eeb417a061e admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:32.255543 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634b5a7-d0c3-4f85-b2c3-5eeb417a061e admin admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:32.256169 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e634b5a7-d0c3-4f85-b2c3-5eeb417a061e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:32.258108 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e634b5a7-d0c3-4f85-b2c3-5eeb417a061e admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:32.370128 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1299/2601] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 20:05:32 2022] POST /identity/v3/projects => generated 359 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 20:05:32.374525 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0468901-846f-4985-b0c5-482d5335be16 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:32.384379 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0468901-846f-4985-b0c5-482d5335be16 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:32.441052 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da16a095-0133-4bef-9a0d-8099bacd792d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:32.441737 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da16a095-0133-4bef-9a0d-8099bacd792d admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:32.442016 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da16a095-0133-4bef-9a0d-8099bacd792d admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:32.442286 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da16a095-0133-4bef-9a0d-8099bacd792d admin admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:32.442919 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da16a095-0133-4bef-9a0d-8099bacd792d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:32.444807 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da16a095-0133-4bef-9a0d-8099bacd792d admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:32.543350 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:05:32.549038 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1303/2602] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 20:05:32 2022] POST /identity/v3/users => generated 280 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 20:05:32.564644 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e634b5a7-d0c3-4f85-b2c3-5eeb417a061e admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:32.575750 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e634b5a7-d0c3-4f85-b2c3-5eeb417a061e admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:32.580305 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d0ad9-3dfb-4590-8f89-b18b901dee9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:32.580847 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d0ad9-3dfb-4590-8f89-b18b901dee9d admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:32.581123 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d0ad9-3dfb-4590-8f89-b18b901dee9d admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:32.581615 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d0ad9-3dfb-4590-8f89-b18b901dee9d admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:32.582067 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62d0ad9-3dfb-4590-8f89-b18b901dee9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:32.583638 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62d0ad9-3dfb-4590-8f89-b18b901dee9d admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:32.609417 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1300/2603] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:05:32.612119 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da16a095-0133-4bef-9a0d-8099bacd792d admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:32.622116 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da16a095-0133-4bef-9a0d-8099bacd792d admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:32.627017 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca45896-9c83-4b20-8a35-1cf9a3055420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:32.627642 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca45896-9c83-4b20-8a35-1cf9a3055420 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:32.627923 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca45896-9c83-4b20-8a35-1cf9a3055420 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:32.628191 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca45896-9c83-4b20-8a35-1cf9a3055420 admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:32.628830 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca45896-9c83-4b20-8a35-1cf9a3055420 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:32.630537 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca45896-9c83-4b20-8a35-1cf9a3055420 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:32.641672 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1304/2604] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:05:32.646001 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d0ad9-3dfb-4590-8f89-b18b901dee9d admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:32.656459 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d0ad9-3dfb-4590-8f89-b18b901dee9d admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:32.663060 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98fa19a-2e1a-4fbd-9be5-28f05b573147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:32.663060 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98fa19a-2e1a-4fbd-9be5-28f05b573147 admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:32.663060 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98fa19a-2e1a-4fbd-9be5-28f05b573147 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:32.663060 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98fa19a-2e1a-4fbd-9be5-28f05b573147 admin admin] PATH_INFO: `/v3/projects/149b20f6963841cd838afb77f2c09b66/users/5117c078e9b148aa895d17ce90d7f7a0/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:32.680623 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98fa19a-2e1a-4fbd-9be5-28f05b573147 admin admin] RBAC: Authorizing `identity:create_grant(project_id=149b20f6963841cd838afb77f2c09b66, user_id=5117c078e9b148aa895d17ce90d7f7a0, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:32.683318 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98fa19a-2e1a-4fbd-9be5-28f05b573147 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:32.752730 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1301/2605] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 20:05:32 2022] PUT /identity/v3/projects/149b20f6963841cd838afb77f2c09b66/users/5117c078e9b148aa895d17ce90d7f7a0/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 20:05:32.765098 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd32c8f-e8ee-45b3-866e-021ae0a765f9 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:32.765378 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd32c8f-e8ee-45b3-866e-021ae0a765f9 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:32.765695 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd32c8f-e8ee-45b3-866e-021ae0a765f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:32.794114 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-3cd32c8f-e8ee-45b3-866e-021ae0a765f9 None None] MFA Rules not processed for user `5117c078e9b148aa895d17ce90d7f7a0`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:05:32.795313 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-3cd32c8f-e8ee-45b3-866e-021ae0a765f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:05:32.862639 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1305/2606] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:05:32 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:05:32.897812 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98fa19a-2e1a-4fbd-9be5-28f05b573147 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:32.900328 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-d98fa19a-2e1a-4fbd-9be5-28f05b573147 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:05:32.956849 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98fa19a-2e1a-4fbd-9be5-28f05b573147 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:32.960518 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83637efd-64dd-4db5-b084-515a3864171c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:32.961120 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83637efd-64dd-4db5-b084-515a3864171c service cinder] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:32.962075 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83637efd-64dd-4db5-b084-515a3864171c service cinder] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:32.962356 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83637efd-64dd-4db5-b084-515a3864171c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:32.970666 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83637efd-64dd-4db5-b084-515a3864171c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:32.972091 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83637efd-64dd-4db5-b084-515a3864171c service cinder] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:32.981062 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1302/2607] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:05:32 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:05:32.996784 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd32c8f-e8ee-45b3-866e-021ae0a765f9 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:33.058524 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd32c8f-e8ee-45b3-866e-021ae0a765f9 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:33.063086 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd05152-774d-431e-a3a1-6094709aaf8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:33.063709 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd05152-774d-431e-a3a1-6094709aaf8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:33.063993 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd05152-774d-431e-a3a1-6094709aaf8d admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:33.064261 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd05152-774d-431e-a3a1-6094709aaf8d admin admin] PATH_INFO: `/v3/users/5117c078e9b148aa895d17ce90d7f7a0` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:33.065381 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd05152-774d-431e-a3a1-6094709aaf8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5117c078e9b148aa895d17ce90d7f7a0)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:33.067316 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd05152-774d-431e-a3a1-6094709aaf8d admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:33.246713 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-fcd05152-774d-431e-a3a1-6094709aaf8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5117c078e9b148aa895d17ce90d7f7a0'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:33.289759 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-fcd05152-774d-431e-a3a1-6094709aaf8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5117c078e9b148aa895d17ce90d7f7a0'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:33.290400 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-fcd05152-774d-431e-a3a1-6094709aaf8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5117c078e9b148aa895d17ce90d7f7a0'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:33.291061 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-fcd05152-774d-431e-a3a1-6094709aaf8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5117c078e9b148aa895d17ce90d7f7a0'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:33.303850 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-fcd05152-774d-431e-a3a1-6094709aaf8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5117c078e9b148aa895d17ce90d7f7a0'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:33.312106 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:05:33.317197 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1306/2608] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 20:05:32 2022] DELETE /identity/v3/users/5117c078e9b148aa895d17ce90d7f7a0 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:05:33.322867 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4358d0-e7c0-4c01-9f35-1f34599e950f None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:33.323248 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4358d0-e7c0-4c01-9f35-1f34599e950f None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:33.323594 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4358d0-e7c0-4c01-9f35-1f34599e950f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:33.343198 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-dd4358d0-e7c0-4c01-9f35-1f34599e950f None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:05:33.344397 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-dd4358d0-e7c0-4c01-9f35-1f34599e950f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:05:33.352882 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:05:33.404004 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1303/2609] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:05:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:05:33.413847 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd05152-774d-431e-a3a1-6094709aaf8d admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:33.415850 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-fcd05152-774d-431e-a3a1-6094709aaf8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:05:33.472239 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd05152-774d-431e-a3a1-6094709aaf8d admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:33.476012 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2032b47-265e-4ea5-bf16-bd8688d86f58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:33.476615 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2032b47-265e-4ea5-bf16-bd8688d86f58 service neutron] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:33.476951 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2032b47-265e-4ea5-bf16-bd8688d86f58 service neutron] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:33.477776 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2032b47-265e-4ea5-bf16-bd8688d86f58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:33.486767 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2032b47-265e-4ea5-bf16-bd8688d86f58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:33.488315 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2032b47-265e-4ea5-bf16-bd8688d86f58 service neutron] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:33.498404 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1307/2610] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:05:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:05:33.920623 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4358d0-e7c0-4c01-9f35-1f34599e950f None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:33.922395 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-dd4358d0-e7c0-4c01-9f35-1f34599e950f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:05:33.936449 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4358d0-e7c0-4c01-9f35-1f34599e950f None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:33.941613 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829a6b9b-6093-48a5-92d4-fcfa17ba35c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:33.942276 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a6b9b-6093-48a5-92d4-fcfa17ba35c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:33.942551 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a6b9b-6093-48a5-92d4-fcfa17ba35c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:33.942823 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a6b9b-6093-48a5-92d4-fcfa17ba35c1 admin admin] PATH_INFO: `/v3/projects/149b20f6963841cd838afb77f2c09b66` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:33.943949 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829a6b9b-6093-48a5-92d4-fcfa17ba35c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=149b20f6963841cd838afb77f2c09b66)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:33.945964 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829a6b9b-6093-48a5-92d4-fcfa17ba35c1 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:34.071607 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-829a6b9b-6093-48a5-92d4-fcfa17ba35c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '149b20f6963841cd838afb77f2c09b66', 'request_id': 'req-829a6b9b-6093-48a5-92d4-fcfa17ba35c1'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:34.167447 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-829a6b9b-6093-48a5-92d4-fcfa17ba35c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '149b20f6963841cd838afb77f2c09b66', 'request_id': 'req-829a6b9b-6093-48a5-92d4-fcfa17ba35c1'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:34.173661 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-829a6b9b-6093-48a5-92d4-fcfa17ba35c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '149b20f6963841cd838afb77f2c09b66', 'request_id': 'req-829a6b9b-6093-48a5-92d4-fcfa17ba35c1'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:34.185133 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-829a6b9b-6093-48a5-92d4-fcfa17ba35c1 admin admin] The token cache is being invalidate because project 149b20f6963841cd838afb77f2c09b66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 20:05:34.185414 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-829a6b9b-6093-48a5-92d4-fcfa17ba35c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:34.186161 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-829a6b9b-6093-48a5-92d4-fcfa17ba35c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:34.187879 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1304/2611] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 20:05:33 2022] DELETE /identity/v3/projects/149b20f6963841cd838afb77f2c09b66 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:05:34.192775 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c535a7fc-3c56-4393-a60a-b83798210e40 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:34.193064 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c535a7fc-3c56-4393-a60a-b83798210e40 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:34.193339 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c535a7fc-3c56-4393-a60a-b83798210e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:34.215192 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-c535a7fc-3c56-4393-a60a-b83798210e40 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:05:34.216378 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-c535a7fc-3c56-4393-a60a-b83798210e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:05:34.276369 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1308/2612] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:05:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:05:34.339017 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef60408-75a9-412d-a30a-7eae2aed6fea None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:34.339211 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef60408-75a9-412d-a30a-7eae2aed6fea None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:34.339478 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef60408-75a9-412d-a30a-7eae2aed6fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:34.359263 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-eef60408-75a9-412d-a30a-7eae2aed6fea None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:05:34.360470 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-eef60408-75a9-412d-a30a-7eae2aed6fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:05:34.368549 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1305/2613] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:05:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:05:34.372795 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c535a7fc-3c56-4393-a60a-b83798210e40 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:34.382468 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c535a7fc-3c56-4393-a60a-b83798210e40 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:34.387667 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e679e4-92fe-4e4f-af97-58c0ade73327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:34.391536 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e679e4-92fe-4e4f-af97-58c0ade73327 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:34.391536 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e679e4-92fe-4e4f-af97-58c0ade73327 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:34.391536 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e679e4-92fe-4e4f-af97-58c0ade73327 admin admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:34.391536 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e679e4-92fe-4e4f-af97-58c0ade73327 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:05:34.391536 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e679e4-92fe-4e4f-af97-58c0ade73327 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:34.391536 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e679e4-92fe-4e4f-af97-58c0ade73327 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:34.403834 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1309/2614] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 20:05:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:05:34.408250 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef60408-75a9-412d-a30a-7eae2aed6fea None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:34.417787 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef60408-75a9-412d-a30a-7eae2aed6fea None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:34.422446 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1113420f-9209-405b-a0ac-fc4bac6c15a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:34.423035 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113420f-9209-405b-a0ac-fc4bac6c15a2 admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:34.423315 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113420f-9209-405b-a0ac-fc4bac6c15a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:34.423586 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113420f-9209-405b-a0ac-fc4bac6c15a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:34.424221 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1113420f-9209-405b-a0ac-fc4bac6c15a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:34.426179 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1113420f-9209-405b-a0ac-fc4bac6c15a2 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:34.547382 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1306/2615] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 20:05:34 2022] POST /identity/v3/projects => generated 375 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:05:34.553604 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e679e4-92fe-4e4f-af97-58c0ade73327 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:34.566008 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e679e4-92fe-4e4f-af97-58c0ade73327 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:34.623605 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce0ad00-0d7c-4d99-9232-eec9a77dc8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:34.624217 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0ad00-0d7c-4d99-9232-eec9a77dc8ac admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:34.624498 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0ad00-0d7c-4d99-9232-eec9a77dc8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:34.624767 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0ad00-0d7c-4d99-9232-eec9a77dc8ac admin admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:34.625410 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce0ad00-0d7c-4d99-9232-eec9a77dc8ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:34.627344 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce0ad00-0d7c-4d99-9232-eec9a77dc8ac admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:34.741180 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1310/2616] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 20:05:34 2022] POST /identity/v3/users => generated 288 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:05:34.746167 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1113420f-9209-405b-a0ac-fc4bac6c15a2 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:34.756631 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1113420f-9209-405b-a0ac-fc4bac6c15a2 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:34.761936 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8078dc-af8d-4d36-8d15-71c4b24101f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:34.762563 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8078dc-af8d-4d36-8d15-71c4b24101f3 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:34.770698 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8078dc-af8d-4d36-8d15-71c4b24101f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:34.770698 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8078dc-af8d-4d36-8d15-71c4b24101f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:34.770698 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8078dc-af8d-4d36-8d15-71c4b24101f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:34.770698 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8078dc-af8d-4d36-8d15-71c4b24101f3 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:34.776217 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1307/2617] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:05:34.780244 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce0ad00-0d7c-4d99-9232-eec9a77dc8ac admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:34.790568 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce0ad00-0d7c-4d99-9232-eec9a77dc8ac admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:34.795197 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d017b-a463-4e38-b992-b8558fe93921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:34.796717 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d017b-a463-4e38-b992-b8558fe93921 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:34.796717 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d017b-a463-4e38-b992-b8558fe93921 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:34.796717 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d017b-a463-4e38-b992-b8558fe93921 admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:34.796970 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3d017b-a463-4e38-b992-b8558fe93921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:34.798493 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3d017b-a463-4e38-b992-b8558fe93921 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:34.810346 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1311/2618] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:05:34.814471 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8078dc-af8d-4d36-8d15-71c4b24101f3 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:34.825217 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8078dc-af8d-4d36-8d15-71c4b24101f3 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:34.830151 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe05ec9-f6d0-4f89-8e3a-111729160358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:34.830794 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe05ec9-f6d0-4f89-8e3a-111729160358 admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:34.831075 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe05ec9-f6d0-4f89-8e3a-111729160358 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:34.831349 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe05ec9-f6d0-4f89-8e3a-111729160358 admin admin] PATH_INFO: `/v3/projects/412a8ecb64d640a5ae8ebb521c4db0b8/users/18a71ec0dfaf4a819afc7c3d79fc2a6c/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:34.845878 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe05ec9-f6d0-4f89-8e3a-111729160358 admin admin] RBAC: Authorizing `identity:create_grant(project_id=412a8ecb64d640a5ae8ebb521c4db0b8, user_id=18a71ec0dfaf4a819afc7c3d79fc2a6c, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:34.848498 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe05ec9-f6d0-4f89-8e3a-111729160358 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:34.951051 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1308/2619] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 20:05:34 2022] PUT /identity/v3/projects/412a8ecb64d640a5ae8ebb521c4db0b8/users/18a71ec0dfaf4a819afc7c3d79fc2a6c/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:05:34.961246 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12663c39-577e-4f16-a1d4-3c5d4084dac7 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:34.961697 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12663c39-577e-4f16-a1d4-3c5d4084dac7 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:34.962119 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12663c39-577e-4f16-a1d4-3c5d4084dac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:34.975483 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:05:34.990651 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-12663c39-577e-4f16-a1d4-3c5d4084dac7 None None] MFA Rules not processed for user `18a71ec0dfaf4a819afc7c3d79fc2a6c`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:05:34.991856 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-12663c39-577e-4f16-a1d4-3c5d4084dac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:05:35.056747 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1312/2620] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:05:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:05:35.067542 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe05ec9-f6d0-4f89-8e3a-111729160358 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:35.069273 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-9fe05ec9-f6d0-4f89-8e3a-111729160358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:05:35.106080 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:05:35.127930 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe05ec9-f6d0-4f89-8e3a-111729160358 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:35.131618 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b8c1df-8e36-473a-9a0b-099bc20581c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:35.132216 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8c1df-8e36-473a-9a0b-099bc20581c4 service cinder] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:35.132497 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8c1df-8e36-473a-9a0b-099bc20581c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:35.132767 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8c1df-8e36-473a-9a0b-099bc20581c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:35.141046 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b8c1df-8e36-473a-9a0b-099bc20581c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:35.142499 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b8c1df-8e36-473a-9a0b-099bc20581c4 service cinder] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:35.151332 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1309/2621] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:05:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:05:45.098903 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=29 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:05:45.247486 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=11 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:05:47.885574 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12663c39-577e-4f16-a1d4-3c5d4084dac7 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:47.949255 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12663c39-577e-4f16-a1d4-3c5d4084dac7 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:47.954589 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180f9b6-e9b1-4beb-979f-264924b8392a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:47.955234 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180f9b6-e9b1-4beb-979f-264924b8392a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:47.955510 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180f9b6-e9b1-4beb-979f-264924b8392a admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:47.955782 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180f9b6-e9b1-4beb-979f-264924b8392a admin admin] PATH_INFO: `/v3/users/18a71ec0dfaf4a819afc7c3d79fc2a6c` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:47.956950 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8180f9b6-e9b1-4beb-979f-264924b8392a admin admin] RBAC: Authorizing `identity:delete_user(user_id=18a71ec0dfaf4a819afc7c3d79fc2a6c)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:47.959047 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8180f9b6-e9b1-4beb-979f-264924b8392a admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:48.051966 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65970d2-45eb-4ce0-90a9-36fd791363f2 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:48.052496 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65970d2-45eb-4ce0-90a9-36fd791363f2 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:48.052496 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65970d2-45eb-4ce0-90a9-36fd791363f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:48.072096 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-e65970d2-45eb-4ce0-90a9-36fd791363f2 None None] MFA Rules not processed for user `d2c1ded5aad545148d3e30f6ce994004`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:05:48.073394 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-e65970d2-45eb-4ce0-90a9-36fd791363f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:05:48.132143 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1310/2622] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:05:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 20:05:48.164994 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-8180f9b6-e9b1-4beb-979f-264924b8392a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18a71ec0dfaf4a819afc7c3d79fc2a6c'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:48.278120 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-8180f9b6-e9b1-4beb-979f-264924b8392a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18a71ec0dfaf4a819afc7c3d79fc2a6c'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:48.278742 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-8180f9b6-e9b1-4beb-979f-264924b8392a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18a71ec0dfaf4a819afc7c3d79fc2a6c'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:48.279346 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-8180f9b6-e9b1-4beb-979f-264924b8392a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18a71ec0dfaf4a819afc7c3d79fc2a6c'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:48.292696 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-8180f9b6-e9b1-4beb-979f-264924b8392a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18a71ec0dfaf4a819afc7c3d79fc2a6c'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:48.305198 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1313/2623] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 20:05:47 2022] DELETE /identity/v3/users/18a71ec0dfaf4a819afc7c3d79fc2a6c => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:05:48.309913 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504a0f1-763c-463e-9219-28663581473a None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:48.310201 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504a0f1-763c-463e-9219-28663581473a None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:48.310476 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504a0f1-763c-463e-9219-28663581473a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:48.330315 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-e504a0f1-763c-463e-9219-28663581473a None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:05:48.331527 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-e504a0f1-763c-463e-9219-28663581473a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:05:48.394471 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1311/2624] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:05:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:05:48.405173 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180f9b6-e9b1-4beb-979f-264924b8392a admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:48.405173 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-8180f9b6-e9b1-4beb-979f-264924b8392a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:05:48.466758 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180f9b6-e9b1-4beb-979f-264924b8392a admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:48.470307 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fdd837-d743-4f69-8f35-20717727f637 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:48.470904 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fdd837-d743-4f69-8f35-20717727f637 service neutron] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:48.471175 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fdd837-d743-4f69-8f35-20717727f637 service neutron] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:48.471440 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fdd837-d743-4f69-8f35-20717727f637 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:48.481265 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fdd837-d743-4f69-8f35-20717727f637 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:48.482750 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fdd837-d743-4f69-8f35-20717727f637 service neutron] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:48.492162 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1314/2625] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:05:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:05:48.920234 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e504a0f1-763c-463e-9219-28663581473a None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:48.921694 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-e504a0f1-763c-463e-9219-28663581473a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:05:48.934028 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e504a0f1-763c-463e-9219-28663581473a None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:48.939055 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756716a-218a-4586-b77a-345479703948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:48.939700 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756716a-218a-4586-b77a-345479703948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:48.939974 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756716a-218a-4586-b77a-345479703948 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:48.940244 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756716a-218a-4586-b77a-345479703948 admin admin] PATH_INFO: `/v3/projects/412a8ecb64d640a5ae8ebb521c4db0b8` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:48.941409 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2756716a-218a-4586-b77a-345479703948 admin admin] RBAC: Authorizing `identity:delete_project(project_id=412a8ecb64d640a5ae8ebb521c4db0b8)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:48.943352 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2756716a-218a-4586-b77a-345479703948 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:49.054502 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-2756716a-218a-4586-b77a-345479703948 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '412a8ecb64d640a5ae8ebb521c4db0b8', 'request_id': 'req-2756716a-218a-4586-b77a-345479703948'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:49.127579 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-2756716a-218a-4586-b77a-345479703948 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '412a8ecb64d640a5ae8ebb521c4db0b8', 'request_id': 'req-2756716a-218a-4586-b77a-345479703948'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:49.133914 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-2756716a-218a-4586-b77a-345479703948 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '412a8ecb64d640a5ae8ebb521c4db0b8', 'request_id': 'req-2756716a-218a-4586-b77a-345479703948'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:49.148045 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-2756716a-218a-4586-b77a-345479703948 admin admin] The token cache is being invalidate because project 412a8ecb64d640a5ae8ebb521c4db0b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 20:05:49.148329 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-2756716a-218a-4586-b77a-345479703948 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:49.148981 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-2756716a-218a-4586-b77a-345479703948 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:05:49.151077 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1312/2626] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 20:05:48 2022] DELETE /identity/v3/projects/412a8ecb64d640a5ae8ebb521c4db0b8 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:05:49.156228 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31aed4c-9227-4b71-8387-c033ec3bf1ad None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:49.156685 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31aed4c-9227-4b71-8387-c033ec3bf1ad None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:49.156802 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31aed4c-9227-4b71-8387-c033ec3bf1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:49.176695 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-f31aed4c-9227-4b71-8387-c033ec3bf1ad None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:05:49.177918 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-f31aed4c-9227-4b71-8387-c033ec3bf1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:05:49.194454 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:05:49.237389 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1315/2627] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:05:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:05:49.246780 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcaf62-142e-4691-a673-e7d06cadf8e5 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:49.247063 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcaf62-142e-4691-a673-e7d06cadf8e5 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:49.247334 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcaf62-142e-4691-a673-e7d06cadf8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:49.268540 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-b4fcaf62-142e-4691-a673-e7d06cadf8e5 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:05:49.269770 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-b4fcaf62-142e-4691-a673-e7d06cadf8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:05:49.278872 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1313/2628] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:05:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:05:49.283156 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31aed4c-9227-4b71-8387-c033ec3bf1ad None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:49.292741 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31aed4c-9227-4b71-8387-c033ec3bf1ad None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:49.297469 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec331e-a925-4764-a757-38b6fd00f1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:49.298134 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec331e-a925-4764-a757-38b6fd00f1c0 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:49.298410 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec331e-a925-4764-a757-38b6fd00f1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:49.298674 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec331e-a925-4764-a757-38b6fd00f1c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:49.299307 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddec331e-a925-4764-a757-38b6fd00f1c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:05:49.299607 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddec331e-a925-4764-a757-38b6fd00f1c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:49.301231 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddec331e-a925-4764-a757-38b6fd00f1c0 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:49.312536 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1316/2629] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 20:05:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:05:49.316804 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fcaf62-142e-4691-a673-e7d06cadf8e5 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:49.327217 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fcaf62-142e-4691-a673-e7d06cadf8e5 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:49.332067 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc10b806-c641-40a1-9e13-6cc565f0d716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:49.332657 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc10b806-c641-40a1-9e13-6cc565f0d716 admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:49.332938 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc10b806-c641-40a1-9e13-6cc565f0d716 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:49.333211 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc10b806-c641-40a1-9e13-6cc565f0d716 admin admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:49.333915 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc10b806-c641-40a1-9e13-6cc565f0d716 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:49.335795 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc10b806-c641-40a1-9e13-6cc565f0d716 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:49.404772 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:05:49.411017 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1314/2630] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 20:05:49 2022] POST /identity/v3/projects => generated 373 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 20:05:49.415082 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec331e-a925-4764-a757-38b6fd00f1c0 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:49.426500 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec331e-a925-4764-a757-38b6fd00f1c0 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:49.482477 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb75983c-62a8-4a42-882a-b201dd01c53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:49.483083 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb75983c-62a8-4a42-882a-b201dd01c53f admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:49.483359 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb75983c-62a8-4a42-882a-b201dd01c53f admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:49.483649 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb75983c-62a8-4a42-882a-b201dd01c53f admin admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:49.484289 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb75983c-62a8-4a42-882a-b201dd01c53f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:49.486258 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb75983c-62a8-4a42-882a-b201dd01c53f admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:49.585860 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1317/2631] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 20:05:49 2022] POST /identity/v3/users => generated 287 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:05:49.590379 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc10b806-c641-40a1-9e13-6cc565f0d716 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:49.600633 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc10b806-c641-40a1-9e13-6cc565f0d716 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:49.605457 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a280be71-866a-418d-b96a-29e1f40ecb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:49.606083 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280be71-866a-418d-b96a-29e1f40ecb26 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:49.606364 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280be71-866a-418d-b96a-29e1f40ecb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:49.606636 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280be71-866a-418d-b96a-29e1f40ecb26 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:49.607271 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a280be71-866a-418d-b96a-29e1f40ecb26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:49.608891 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a280be71-866a-418d-b96a-29e1f40ecb26 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:49.618671 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1315/2632] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:05:49.623053 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb75983c-62a8-4a42-882a-b201dd01c53f admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:49.633085 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb75983c-62a8-4a42-882a-b201dd01c53f admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:49.638547 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee4c54f-b695-4997-9cb6-663afd246b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:49.641622 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4c54f-b695-4997-9cb6-663afd246b51 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:49.641622 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4c54f-b695-4997-9cb6-663afd246b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:49.641622 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4c54f-b695-4997-9cb6-663afd246b51 admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:49.641622 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee4c54f-b695-4997-9cb6-663afd246b51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:49.641999 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee4c54f-b695-4997-9cb6-663afd246b51 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:49.653272 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1318/2633] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:05:49.657074 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a280be71-866a-418d-b96a-29e1f40ecb26 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:49.668620 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a280be71-866a-418d-b96a-29e1f40ecb26 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:49.673379 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25170df6-6320-418b-8f35-6c6e1ee338e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:49.674065 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25170df6-6320-418b-8f35-6c6e1ee338e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:49.674348 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25170df6-6320-418b-8f35-6c6e1ee338e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:49.674621 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25170df6-6320-418b-8f35-6c6e1ee338e8 admin admin] PATH_INFO: `/v3/projects/8b6a1878e4784ccaaa8277ec36c5844f/users/dc2e0fb703704a4d8d07e900a40fda09/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:49.691007 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25170df6-6320-418b-8f35-6c6e1ee338e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b6a1878e4784ccaaa8277ec36c5844f, user_id=dc2e0fb703704a4d8d07e900a40fda09, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:49.693704 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25170df6-6320-418b-8f35-6c6e1ee338e8 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:49.761738 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1316/2634] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 20:05:49 2022] PUT /identity/v3/projects/8b6a1878e4784ccaaa8277ec36c5844f/users/dc2e0fb703704a4d8d07e900a40fda09/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:05:49.772203 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b399d9-ae4d-49f0-82f5-b9186595d38f None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:49.772558 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b399d9-ae4d-49f0-82f5-b9186595d38f None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:49.772903 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b399d9-ae4d-49f0-82f5-b9186595d38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:49.807164 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-b3b399d9-ae4d-49f0-82f5-b9186595d38f None None] MFA Rules not processed for user `dc2e0fb703704a4d8d07e900a40fda09`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:05:49.808357 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-b3b399d9-ae4d-49f0-82f5-b9186595d38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:05:49.873416 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1319/2635] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:05:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:05:49.885037 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25170df6-6320-418b-8f35-6c6e1ee338e8 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:05:49.886877 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-25170df6-6320-418b-8f35-6c6e1ee338e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:05:49.948244 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25170df6-6320-418b-8f35-6c6e1ee338e8 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:05:49.953102 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c3b0c-1e7c-4c5c-b797-56a4470fdbb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:05:49.953102 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c3b0c-1e7c-4c5c-b797-56a4470fdbb4 service cinder] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:49.953102 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c3b0c-1e7c-4c5c-b797-56a4470fdbb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:49.953472 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c3b0c-1e7c-4c5c-b797-56a4470fdbb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:49.962146 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89c3b0c-1e7c-4c5c-b797-56a4470fdbb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:05:49.964307 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89c3b0c-1e7c-4c5c-b797-56a4470fdbb4 service cinder] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:05:49.973673 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1317/2636] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:05:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:05:51.812157 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a902877-9672-4461-b8a8-a8850445452c None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:05:51.812705 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a902877-9672-4461-b8a8-a8850445452c None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:05:51.812705 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a902877-9672-4461-b8a8-a8850445452c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:05:51.832989 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-0a902877-9672-4461-b8a8-a8850445452c None None] MFA Rules not processed for user `dc2e0fb703704a4d8d07e900a40fda09`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:05:51.834240 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-0a902877-9672-4461-b8a8-a8850445452c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:05:51.842797 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1320/2637] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:05:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 20:05:59.969330 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=41,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:06:01.826482 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=92,keystone:INSERT=3 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:06:12.058504 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c3b0c-1e7c-4c5c-b797-56a4470fdbb4 service cinder] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:06:12.059935 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-f89c3b0c-1e7c-4c5c-b797-56a4470fdbb4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:06:12.199012 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c3b0c-1e7c-4c5c-b797-56a4470fdbb4 service cinder] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:06:12.205801 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e8d39-c078-41ad-984e-4fdaf2997d37 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f19f1385114fa5a921999747a6666b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:06:12.206403 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e8d39-c078-41ad-984e-4fdaf2997d37 service placement] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:06:12.206682 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e8d39-c078-41ad-984e-4fdaf2997d37 service placement] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:06:12.206990 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e8d39-c078-41ad-984e-4fdaf2997d37 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:06:12.208675 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-f43e8d39-c078-41ad-984e-4fdaf2997d37 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:06:12.220565 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e8d39-c078-41ad-984e-4fdaf2997d37 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:06:12.222158 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e8d39-c078-41ad-984e-4fdaf2997d37 service placement] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:06:12.232453 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1318/2638] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:06:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:06:14.145462 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992730a-db49-48db-a788-4e898ed2a6c3 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:06:14.146028 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992730a-db49-48db-a788-4e898ed2a6c3 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:06:14.146131 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992730a-db49-48db-a788-4e898ed2a6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:06:14.177690 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-3992730a-db49-48db-a788-4e898ed2a6c3 None None] MFA Rules not processed for user `fd597f74abdf49288ea0d92642c6a5a2`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:06:14.178922 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-3992730a-db49-48db-a788-4e898ed2a6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:06:14.248243 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1321/2639] 10.222.0.60 () {58 vars in 1009 bytes} [Sat Sep 24 20:06:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 20:06:14.400905 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e8d39-c078-41ad-984e-4fdaf2997d37 service placement] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:06:14.402343 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-f43e8d39-c078-41ad-984e-4fdaf2997d37 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:06:14.469718 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e8d39-c078-41ad-984e-4fdaf2997d37 service placement] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:06:14.474562 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa8ad3-5135-4121-98dc-f557ce5ef6d8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd94cd16acc45e6ac2997204297fb75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:06:14.475159 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa8ad3-5135-4121-98dc-f557ce5ef6d8 service swift] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:06:14.475435 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa8ad3-5135-4121-98dc-f557ce5ef6d8 service swift] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:06:14.475706 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa8ad3-5135-4121-98dc-f557ce5ef6d8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:06:14.483636 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfa8ad3-5135-4121-98dc-f557ce5ef6d8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:06:14.485181 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfa8ad3-5135-4121-98dc-f557ce5ef6d8 service swift] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:06:14.493163 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1319/2640] 10.222.0.60 () {60 vars in 1384 bytes} [Sat Sep 24 20:06:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 24 20:06:15.244862 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc1b75-3f17-458d-aef0-655d6bc5a789 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:06:15.245330 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc1b75-3f17-458d-aef0-655d6bc5a789 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:06:15.245435 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc1b75-3f17-458d-aef0-655d6bc5a789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:06:15.265150 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-37fc1b75-3f17-458d-aef0-655d6bc5a789 None None] MFA Rules not processed for user `fd597f74abdf49288ea0d92642c6a5a2`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:06:15.266437 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-37fc1b75-3f17-458d-aef0-655d6bc5a789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:06:15.273459 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1322/2641] 10.222.0.60 () {58 vars in 967 bytes} [Sat Sep 24 20:06:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:06:15.286530 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa8ad3-5135-4121-98dc-f557ce5ef6d8 service swift] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:06:15.298082 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa8ad3-5135-4121-98dc-f557ce5ef6d8 service swift] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:06:15.303253 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804afebf-6f81-48bf-b8f8-277bec1ead7d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd94cd16acc45e6ac2997204297fb75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:06:15.303938 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804afebf-6f81-48bf-b8f8-277bec1ead7d service swift] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:06:15.304119 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804afebf-6f81-48bf-b8f8-277bec1ead7d service swift] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:06:15.304389 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804afebf-6f81-48bf-b8f8-277bec1ead7d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:06:15.313141 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804afebf-6f81-48bf-b8f8-277bec1ead7d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:06:15.314780 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804afebf-6f81-48bf-b8f8-277bec1ead7d service swift] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:06:15.318650 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=100 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:06:15.323843 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1320/2642] 10.222.0.60 () {60 vars in 1384 bytes} [Sat Sep 24 20:06:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 24 20:06:15.951450 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50470372-7e75-4c77-85a9-e0ee936f91c9 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:06:15.952030 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50470372-7e75-4c77-85a9-e0ee936f91c9 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:06:15.952404 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50470372-7e75-4c77-85a9-e0ee936f91c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:06:15.972025 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-50470372-7e75-4c77-85a9-e0ee936f91c9 None None] MFA Rules not processed for user `fd597f74abdf49288ea0d92642c6a5a2`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:06:15.973247 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-50470372-7e75-4c77-85a9-e0ee936f91c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:06:15.980363 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1323/2643] 10.222.0.60 () {58 vars in 1009 bytes} [Sat Sep 24 20:06:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:06:15.992437 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804afebf-6f81-48bf-b8f8-277bec1ead7d service swift] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:06:16.003411 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804afebf-6f81-48bf-b8f8-277bec1ead7d service swift] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:06:16.008322 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc69465-8bff-414d-8375-0043c011cb99 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd94cd16acc45e6ac2997204297fb75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:06:16.008937 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc69465-8bff-414d-8375-0043c011cb99 service swift] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:06:16.009213 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc69465-8bff-414d-8375-0043c011cb99 service swift] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:06:16.009484 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc69465-8bff-414d-8375-0043c011cb99 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:06:16.018013 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc69465-8bff-414d-8375-0043c011cb99 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:06:16.019559 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc69465-8bff-414d-8375-0043c011cb99 service swift] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:06:16.027410 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1321/2644] 10.222.0.60 () {60 vars in 1384 bytes} [Sat Sep 24 20:06:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 24 20:06:16.678466 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d055399-58da-4b25-b012-38d98388342a None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:06:16.678946 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d055399-58da-4b25-b012-38d98388342a None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:06:16.679065 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d055399-58da-4b25-b012-38d98388342a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:06:16.698973 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-1d055399-58da-4b25-b012-38d98388342a None None] MFA Rules not processed for user `fd597f74abdf49288ea0d92642c6a5a2`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:06:16.701260 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-1d055399-58da-4b25-b012-38d98388342a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:06:16.708476 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1324/2645] 10.222.0.60 () {58 vars in 967 bytes} [Sat Sep 24 20:06:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:06:16.720904 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc69465-8bff-414d-8375-0043c011cb99 service swift] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:06:16.731273 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc69465-8bff-414d-8375-0043c011cb99 service swift] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:06:16.736242 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c025e761-99dc-4332-b9dd-82226c7b2879 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd94cd16acc45e6ac2997204297fb75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:06:16.736838 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025e761-99dc-4332-b9dd-82226c7b2879 service swift] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:06:16.737119 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025e761-99dc-4332-b9dd-82226c7b2879 service swift] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:06:16.737393 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025e761-99dc-4332-b9dd-82226c7b2879 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:06:16.745319 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c025e761-99dc-4332-b9dd-82226c7b2879 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:06:16.746921 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c025e761-99dc-4332-b9dd-82226c7b2879 service swift] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:06:16.755420 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1322/2646] 10.222.0.60 () {60 vars in 1384 bytes} [Sat Sep 24 20:06:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 24 20:06:19.349371 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d055399-58da-4b25-b012-38d98388342a None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:06:19.428389 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d055399-58da-4b25-b012-38d98388342a None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:06:19.432833 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a2b43-f91d-4907-aa6b-d763046e61be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:06:19.433448 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a2b43-f91d-4907-aa6b-d763046e61be admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:06:19.433755 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a2b43-f91d-4907-aa6b-d763046e61be admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:06:19.434023 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a2b43-f91d-4907-aa6b-d763046e61be admin admin] PATH_INFO: `/v3/users/dc2e0fb703704a4d8d07e900a40fda09` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:06:19.435146 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a2b43-f91d-4907-aa6b-d763046e61be admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc2e0fb703704a4d8d07e900a40fda09)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:06:19.437151 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a2b43-f91d-4907-aa6b-d763046e61be admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:06:19.603227 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-368a2b43-f91d-4907-aa6b-d763046e61be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc2e0fb703704a4d8d07e900a40fda09'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:06:19.682551 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-368a2b43-f91d-4907-aa6b-d763046e61be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc2e0fb703704a4d8d07e900a40fda09'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:06:19.683169 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-368a2b43-f91d-4907-aa6b-d763046e61be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc2e0fb703704a4d8d07e900a40fda09'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:06:19.683761 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-368a2b43-f91d-4907-aa6b-d763046e61be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc2e0fb703704a4d8d07e900a40fda09'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:06:19.685124 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:06:19.697488 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-368a2b43-f91d-4907-aa6b-d763046e61be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc2e0fb703704a4d8d07e900a40fda09'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:06:19.709994 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1325/2647] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 20:06:19 2022] DELETE /identity/v3/users/dc2e0fb703704a4d8d07e900a40fda09 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:06:19.714639 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6172136-4bf1-4a44-867d-e51878de287c None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:06:19.715100 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6172136-4bf1-4a44-867d-e51878de287c None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:06:19.715252 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6172136-4bf1-4a44-867d-e51878de287c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:06:19.756380 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-e6172136-4bf1-4a44-867d-e51878de287c None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:06:19.757683 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-e6172136-4bf1-4a44-867d-e51878de287c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:06:19.815592 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1323/2648] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:06:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:06:19.825682 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a2b43-f91d-4907-aa6b-d763046e61be admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:06:19.827411 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-368a2b43-f91d-4907-aa6b-d763046e61be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:06:19.903330 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a2b43-f91d-4907-aa6b-d763046e61be admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:06:19.906853 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e37967-b38e-488f-afe8-9e072e268430 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:06:19.907542 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e37967-b38e-488f-afe8-9e072e268430 service neutron] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:06:19.907943 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e37967-b38e-488f-afe8-9e072e268430 service neutron] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:06:19.908365 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e37967-b38e-488f-afe8-9e072e268430 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:06:19.917029 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e37967-b38e-488f-afe8-9e072e268430 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:06:19.918486 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e37967-b38e-488f-afe8-9e072e268430 service neutron] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:06:19.928164 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1326/2649] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:06:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:06:20.158213 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6172136-4bf1-4a44-867d-e51878de287c None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:06:20.159916 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-e6172136-4bf1-4a44-867d-e51878de287c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:06:20.175331 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6172136-4bf1-4a44-867d-e51878de287c None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:06:20.180041 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e126e5-b2a6-4cd5-a7a7-e1bfb31f2b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:06:20.180671 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e126e5-b2a6-4cd5-a7a7-e1bfb31f2b4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:06:20.180946 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e126e5-b2a6-4cd5-a7a7-e1bfb31f2b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:06:20.181212 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e126e5-b2a6-4cd5-a7a7-e1bfb31f2b4b admin admin] PATH_INFO: `/v3/projects/8b6a1878e4784ccaaa8277ec36c5844f` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:06:20.182347 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e126e5-b2a6-4cd5-a7a7-e1bfb31f2b4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b6a1878e4784ccaaa8277ec36c5844f)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:06:20.185028 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e126e5-b2a6-4cd5-a7a7-e1bfb31f2b4b admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:06:20.305317 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-95e126e5-b2a6-4cd5-a7a7-e1bfb31f2b4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b6a1878e4784ccaaa8277ec36c5844f', 'request_id': 'req-95e126e5-b2a6-4cd5-a7a7-e1bfb31f2b4b'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:06:20.389545 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-95e126e5-b2a6-4cd5-a7a7-e1bfb31f2b4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b6a1878e4784ccaaa8277ec36c5844f', 'request_id': 'req-95e126e5-b2a6-4cd5-a7a7-e1bfb31f2b4b'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:06:20.395551 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-95e126e5-b2a6-4cd5-a7a7-e1bfb31f2b4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b6a1878e4784ccaaa8277ec36c5844f', 'request_id': 'req-95e126e5-b2a6-4cd5-a7a7-e1bfb31f2b4b'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:06:20.406754 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-95e126e5-b2a6-4cd5-a7a7-e1bfb31f2b4b admin admin] The token cache is being invalidate because project 8b6a1878e4784ccaaa8277ec36c5844f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 20:06:20.406986 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-95e126e5-b2a6-4cd5-a7a7-e1bfb31f2b4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:06:20.408333 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-95e126e5-b2a6-4cd5-a7a7-e1bfb31f2b4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:06:20.409885 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1324/2650] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 20:06:20 2022] DELETE /identity/v3/projects/8b6a1878e4784ccaaa8277ec36c5844f => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:06:28.993273 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9796f-901a-45ec-a2e0-611bb5213fd7 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:06:28.993859 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9796f-901a-45ec-a2e0-611bb5213fd7 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:06:28.994102 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9796f-901a-45ec-a2e0-611bb5213fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:06:29.014350 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-4ff9796f-901a-45ec-a2e0-611bb5213fd7 None None] MFA Rules not processed for user `fd597f74abdf49288ea0d92642c6a5a2`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:06:29.015550 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-4ff9796f-901a-45ec-a2e0-611bb5213fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:06:29.072043 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1327/2651] 10.222.0.60 () {58 vars in 1009 bytes} [Sat Sep 24 20:06:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:06:29.084516 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e126e5-b2a6-4cd5-a7a7-e1bfb31f2b4b admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:06:29.085916 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-95e126e5-b2a6-4cd5-a7a7-e1bfb31f2b4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:06:29.129322 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:06:29.155600 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e126e5-b2a6-4cd5-a7a7-e1bfb31f2b4b admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:06:29.163076 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ccfd2-f06c-433c-acd5-dad8537381c5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd94cd16acc45e6ac2997204297fb75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:06:29.163679 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ccfd2-f06c-433c-acd5-dad8537381c5 service swift] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:06:29.163956 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ccfd2-f06c-433c-acd5-dad8537381c5 service swift] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:06:29.164223 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ccfd2-f06c-433c-acd5-dad8537381c5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:06:29.172597 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856ccfd2-f06c-433c-acd5-dad8537381c5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:06:29.174218 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856ccfd2-f06c-433c-acd5-dad8537381c5 service swift] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:06:29.182865 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1325/2652] 10.222.0.60 () {60 vars in 1384 bytes} [Sat Sep 24 20:06:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 24 20:06:39.064275 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=71,keystone:DELETE=2 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:06:39.253606 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=15 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:06:51.274578 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6294b3-15bb-47cc-81f6-b6db5025338e None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:06:51.275039 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6294b3-15bb-47cc-81f6-b6db5025338e None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:06:51.275157 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6294b3-15bb-47cc-81f6-b6db5025338e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:06:51.294333 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-7f6294b3-15bb-47cc-81f6-b6db5025338e None None] MFA Rules not processed for user `fd597f74abdf49288ea0d92642c6a5a2`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:06:51.295516 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-7f6294b3-15bb-47cc-81f6-b6db5025338e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:06:51.302972 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1328/2653] 10.222.0.60 () {58 vars in 1009 bytes} [Sat Sep 24 20:06:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:06:51.317117 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ccfd2-f06c-433c-acd5-dad8537381c5 service swift] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:06:51.328450 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ccfd2-f06c-433c-acd5-dad8537381c5 service swift] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:06:51.333819 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4c5c2-7a47-4c3a-a5a2-708888dbba6b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd94cd16acc45e6ac2997204297fb75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:06:51.334414 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4c5c2-7a47-4c3a-a5a2-708888dbba6b service swift] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:06:51.334695 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4c5c2-7a47-4c3a-a5a2-708888dbba6b service swift] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:06:51.334969 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4c5c2-7a47-4c3a-a5a2-708888dbba6b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:06:51.343058 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c4c5c2-7a47-4c3a-a5a2-708888dbba6b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:06:51.344639 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c4c5c2-7a47-4c3a-a5a2-708888dbba6b service swift] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:06:51.352633 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1326/2654] 10.222.0.60 () {60 vars in 1384 bytes} [Sat Sep 24 20:06:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 24 20:07:01.288652 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=3 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:07:01.350112 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=6 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:07:12.477701 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968a78a-4896-40ca-a973-f0173ddaf43b None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:07:12.478817 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968a78a-4896-40ca-a973-f0173ddaf43b None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:07:12.478817 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968a78a-4896-40ca-a973-f0173ddaf43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:07:12.499886 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-8968a78a-4896-40ca-a973-f0173ddaf43b None None] MFA Rules not processed for user `fd597f74abdf49288ea0d92642c6a5a2`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:07:12.501092 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-8968a78a-4896-40ca-a973-f0173ddaf43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:07:12.508281 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1329/2655] 10.222.0.60 () {58 vars in 967 bytes} [Sat Sep 24 20:07:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:07:12.520931 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4c5c2-7a47-4c3a-a5a2-708888dbba6b service swift] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:07:12.532171 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4c5c2-7a47-4c3a-a5a2-708888dbba6b service swift] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:07:12.537139 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7266f4e8-b833-4630-876a-ffc222eca79b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd94cd16acc45e6ac2997204297fb75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:07:12.537771 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266f4e8-b833-4630-876a-ffc222eca79b service swift] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:07:12.538675 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266f4e8-b833-4630-876a-ffc222eca79b service swift] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:07:12.538958 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266f4e8-b833-4630-876a-ffc222eca79b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:07:12.547152 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7266f4e8-b833-4630-876a-ffc222eca79b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:07:12.548746 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7266f4e8-b833-4630-876a-ffc222eca79b service swift] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:07:12.559371 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1327/2656] 10.222.0.60 () {60 vars in 1384 bytes} [Sat Sep 24 20:07:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 24 20:07:22.493507 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=3 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:07:22.553481 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=6 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:07:50.294882 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8968a78a-4896-40ca-a973-f0173ddaf43b None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:07:50.296269 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-8968a78a-4896-40ca-a973-f0173ddaf43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:07:50.352080 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8968a78a-4896-40ca-a973-f0173ddaf43b None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:07:50.356017 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff1304e-84ad-410e-941b-3375a86c82fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:07:50.356613 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff1304e-84ad-410e-941b-3375a86c82fe service neutron] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:07:50.356889 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff1304e-84ad-410e-941b-3375a86c82fe service neutron] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:07:50.357153 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff1304e-84ad-410e-941b-3375a86c82fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:07:50.358871 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-8ff1304e-84ad-410e-941b-3375a86c82fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:07:50.419340 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff1304e-84ad-410e-941b-3375a86c82fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:07:50.420766 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff1304e-84ad-410e-941b-3375a86c82fe service neutron] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:07:50.430355 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1330/2657] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:07:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:07:53.894248 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7266f4e8-b833-4630-876a-ffc222eca79b service swift] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:07:53.895645 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-7266f4e8-b833-4630-876a-ffc222eca79b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:07:53.966367 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7266f4e8-b833-4630-876a-ffc222eca79b service swift] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:07:53.971291 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc33c99f-6ef5-4dca-8fc2-dbbf6d851ffc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f19f1385114fa5a921999747a6666b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:07:53.971889 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33c99f-6ef5-4dca-8fc2-dbbf6d851ffc service placement] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:07:53.972168 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33c99f-6ef5-4dca-8fc2-dbbf6d851ffc service placement] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:07:53.972440 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33c99f-6ef5-4dca-8fc2-dbbf6d851ffc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:07:53.974146 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-cc33c99f-6ef5-4dca-8fc2-dbbf6d851ffc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:07:53.986005 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc33c99f-6ef5-4dca-8fc2-dbbf6d851ffc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:07:53.987587 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc33c99f-6ef5-4dca-8fc2-dbbf6d851ffc service placement] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:07:53.997829 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1328/2658] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:07:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:07:54.029215 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff1304e-84ad-410e-941b-3375a86c82fe service neutron] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:07:54.035783 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-8ff1304e-84ad-410e-941b-3375a86c82fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:07:54.045641 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff1304e-84ad-410e-941b-3375a86c82fe service neutron] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:07:54.050445 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786baaff-5677-4e11-ad08-12c46dab68d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:07:54.051072 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786baaff-5677-4e11-ad08-12c46dab68d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:07:54.051372 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786baaff-5677-4e11-ad08-12c46dab68d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:07:54.051636 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786baaff-5677-4e11-ad08-12c46dab68d9 admin admin] PATH_INFO: `/v3/users/d2c1ded5aad545148d3e30f6ce994004` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:07:54.052765 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786baaff-5677-4e11-ad08-12c46dab68d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2c1ded5aad545148d3e30f6ce994004)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:07:54.054687 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786baaff-5677-4e11-ad08-12c46dab68d9 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:07:54.231029 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-786baaff-5677-4e11-ad08-12c46dab68d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2c1ded5aad545148d3e30f6ce994004'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:07:54.302403 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-786baaff-5677-4e11-ad08-12c46dab68d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2c1ded5aad545148d3e30f6ce994004'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:07:54.303046 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-786baaff-5677-4e11-ad08-12c46dab68d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2c1ded5aad545148d3e30f6ce994004'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:07:54.303653 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-786baaff-5677-4e11-ad08-12c46dab68d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2c1ded5aad545148d3e30f6ce994004'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:07:54.316152 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-786baaff-5677-4e11-ad08-12c46dab68d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2c1ded5aad545148d3e30f6ce994004'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:07:54.328535 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1331/2659] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 20:07:54 2022] DELETE /identity/v3/users/d2c1ded5aad545148d3e30f6ce994004 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:07:54.619339 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc33c99f-6ef5-4dca-8fc2-dbbf6d851ffc service placement] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:07:54.630894 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc33c99f-6ef5-4dca-8fc2-dbbf6d851ffc service placement] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:07:54.693080 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647022a9-a887-4a93-b1dd-125ab1453cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:07:54.693735 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647022a9-a887-4a93-b1dd-125ab1453cf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:07:54.699889 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647022a9-a887-4a93-b1dd-125ab1453cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:07:54.699889 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647022a9-a887-4a93-b1dd-125ab1453cf9 admin admin] PATH_INFO: `/v3/projects/3bd64cad3bba453c85a9ccfba9b6c6f4` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:07:54.699889 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647022a9-a887-4a93-b1dd-125ab1453cf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bd64cad3bba453c85a9ccfba9b6c6f4)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:07:54.699889 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647022a9-a887-4a93-b1dd-125ab1453cf9 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:07:54.875323 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-647022a9-a887-4a93-b1dd-125ab1453cf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bd64cad3bba453c85a9ccfba9b6c6f4', 'request_id': 'req-647022a9-a887-4a93-b1dd-125ab1453cf9'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:07:54.942753 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-647022a9-a887-4a93-b1dd-125ab1453cf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bd64cad3bba453c85a9ccfba9b6c6f4', 'request_id': 'req-647022a9-a887-4a93-b1dd-125ab1453cf9'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:07:54.949278 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-647022a9-a887-4a93-b1dd-125ab1453cf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bd64cad3bba453c85a9ccfba9b6c6f4', 'request_id': 'req-647022a9-a887-4a93-b1dd-125ab1453cf9'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:07:54.961213 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-647022a9-a887-4a93-b1dd-125ab1453cf9 admin admin] The token cache is being invalidate because project 3bd64cad3bba453c85a9ccfba9b6c6f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 20:07:54.961519 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-647022a9-a887-4a93-b1dd-125ab1453cf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:07:54.962151 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-647022a9-a887-4a93-b1dd-125ab1453cf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:07:54.963645 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1329/2660] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 20:07:54 2022] DELETE /identity/v3/projects/3bd64cad3bba453c85a9ccfba9b6c6f4 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:07:54.969589 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273172e0-6ec5-4ed2-902e-e43b0d67c28f None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:07:54.969896 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273172e0-6ec5-4ed2-902e-e43b0d67c28f None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:07:54.970197 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273172e0-6ec5-4ed2-902e-e43b0d67c28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:07:54.998340 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:07:55.019805 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-273172e0-6ec5-4ed2-902e-e43b0d67c28f None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:07:55.021160 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-273172e0-6ec5-4ed2-902e-e43b0d67c28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:07:55.082794 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1332/2661] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:07:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:07:55.090547 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687050e5-c2d6-44b5-99b5-62972d000628 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:07:55.090873 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687050e5-c2d6-44b5-99b5-62972d000628 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:07:55.091149 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687050e5-c2d6-44b5-99b5-62972d000628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:07:55.110651 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-687050e5-c2d6-44b5-99b5-62972d000628 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:07:55.112491 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-687050e5-c2d6-44b5-99b5-62972d000628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:07:55.119544 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1330/2662] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:07:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:07:55.124564 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273172e0-6ec5-4ed2-902e-e43b0d67c28f None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:07:55.134426 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273172e0-6ec5-4ed2-902e-e43b0d67c28f None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:07:55.139692 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0150fc-12e1-4a16-8d60-a9772cbf6086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:07:55.140292 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0150fc-12e1-4a16-8d60-a9772cbf6086 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:07:55.140695 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0150fc-12e1-4a16-8d60-a9772cbf6086 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:07:55.140995 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0150fc-12e1-4a16-8d60-a9772cbf6086 admin admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:07:55.141668 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0150fc-12e1-4a16-8d60-a9772cbf6086 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:07:55.141966 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0150fc-12e1-4a16-8d60-a9772cbf6086 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:07:55.143559 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0150fc-12e1-4a16-8d60-a9772cbf6086 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:07:55.155749 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1333/2663] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 20:07:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:07:55.159806 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687050e5-c2d6-44b5-99b5-62972d000628 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:07:55.168835 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687050e5-c2d6-44b5-99b5-62972d000628 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:07:55.173410 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42131044-0e86-45c6-b928-97f883acdd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:07:55.174033 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42131044-0e86-45c6-b928-97f883acdd0d admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:07:55.174334 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42131044-0e86-45c6-b928-97f883acdd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:07:55.174605 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42131044-0e86-45c6-b928-97f883acdd0d admin admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:07:55.175221 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42131044-0e86-45c6-b928-97f883acdd0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:07:55.177088 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42131044-0e86-45c6-b928-97f883acdd0d admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:07:55.188686 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:07:55.270801 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1331/2664] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 20:07:55 2022] POST /identity/v3/projects => generated 379 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:07:55.274953 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0150fc-12e1-4a16-8d60-a9772cbf6086 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:07:55.285204 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0150fc-12e1-4a16-8d60-a9772cbf6086 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:07:55.341865 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2671cdc5-373d-469d-a6ab-f48161a0e971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:07:55.342471 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671cdc5-373d-469d-a6ab-f48161a0e971 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:07:55.342748 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671cdc5-373d-469d-a6ab-f48161a0e971 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:07:55.343017 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671cdc5-373d-469d-a6ab-f48161a0e971 admin admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:07:55.343647 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2671cdc5-373d-469d-a6ab-f48161a0e971 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:07:55.345568 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2671cdc5-373d-469d-a6ab-f48161a0e971 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:07:55.416258 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1334/2665] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 20:07:55 2022] POST /identity/v3/users => generated 290 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 20:07:55.420844 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42131044-0e86-45c6-b928-97f883acdd0d admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:07:55.431163 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42131044-0e86-45c6-b928-97f883acdd0d admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:07:55.436395 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67180e78-0840-43aa-ba09-c84db4122d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:07:55.436989 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67180e78-0840-43aa-ba09-c84db4122d81 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:07:55.437269 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67180e78-0840-43aa-ba09-c84db4122d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:07:55.437598 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67180e78-0840-43aa-ba09-c84db4122d81 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:07:55.438259 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67180e78-0840-43aa-ba09-c84db4122d81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:07:55.439841 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67180e78-0840-43aa-ba09-c84db4122d81 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:07:55.449877 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1332/2666] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:07:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:07:55.453963 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2671cdc5-373d-469d-a6ab-f48161a0e971 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:07:55.463835 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2671cdc5-373d-469d-a6ab-f48161a0e971 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:07:55.468696 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6951c-2805-49d6-aaea-6804822277db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:07:55.469285 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6951c-2805-49d6-aaea-6804822277db admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:07:55.469598 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6951c-2805-49d6-aaea-6804822277db admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:07:55.469871 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6951c-2805-49d6-aaea-6804822277db admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:07:55.470534 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf6951c-2805-49d6-aaea-6804822277db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:07:55.472101 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf6951c-2805-49d6-aaea-6804822277db admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:07:55.483089 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1335/2667] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:07:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 20:07:55.487113 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67180e78-0840-43aa-ba09-c84db4122d81 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:07:55.497576 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67180e78-0840-43aa-ba09-c84db4122d81 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:07:55.502206 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02358912-3b95-4d29-a862-862424c7529e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:07:55.502845 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02358912-3b95-4d29-a862-862424c7529e admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:07:55.503123 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02358912-3b95-4d29-a862-862424c7529e admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:07:55.503395 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02358912-3b95-4d29-a862-862424c7529e admin admin] PATH_INFO: `/v3/projects/65bd772749a74851a0a8cbaf4a7f2630/users/8b73432c89f34533a390b511de5f7047/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:07:55.517471 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02358912-3b95-4d29-a862-862424c7529e admin admin] RBAC: Authorizing `identity:create_grant(project_id=65bd772749a74851a0a8cbaf4a7f2630, user_id=8b73432c89f34533a390b511de5f7047, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:07:55.520127 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02358912-3b95-4d29-a862-862424c7529e admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:07:55.570877 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1333/2668] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 20:07:55 2022] PUT /identity/v3/projects/65bd772749a74851a0a8cbaf4a7f2630/users/8b73432c89f34533a390b511de5f7047/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:07:55.587011 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca9676-2048-4adb-b2d4-d27e018009ac None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:07:55.587293 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca9676-2048-4adb-b2d4-d27e018009ac None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:07:55.587564 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca9676-2048-4adb-b2d4-d27e018009ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:07:55.615632 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-37ca9676-2048-4adb-b2d4-d27e018009ac None None] MFA Rules not processed for user `8b73432c89f34533a390b511de5f7047`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:07:55.616827 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-37ca9676-2048-4adb-b2d4-d27e018009ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:07:55.670909 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:07:55.681382 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1336/2669] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:07:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:07:55.688760 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02358912-3b95-4d29-a862-862424c7529e admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:07:55.751637 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02358912-3b95-4d29-a862-862424c7529e admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:07:55.756363 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714862eb-a101-4874-a81a-51d066511801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:07:55.756984 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714862eb-a101-4874-a81a-51d066511801 admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:07:55.757263 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714862eb-a101-4874-a81a-51d066511801 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:07:55.757559 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714862eb-a101-4874-a81a-51d066511801 admin admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:07:55.758229 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714862eb-a101-4874-a81a-51d066511801 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:07:55.760108 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714862eb-a101-4874-a81a-51d066511801 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:07:55.870094 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1334/2670] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 20:07:55 2022] POST /identity/v3/projects => generated 381 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:07:55.874043 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca9676-2048-4adb-b2d4-d27e018009ac None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:07:55.884529 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca9676-2048-4adb-b2d4-d27e018009ac None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:07:55.940035 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeec772-362f-420d-9f81-6edc07db7bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:07:55.940639 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeec772-362f-420d-9f81-6edc07db7bf7 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:07:55.940919 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeec772-362f-420d-9f81-6edc07db7bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:07:55.941190 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeec772-362f-420d-9f81-6edc07db7bf7 admin admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:07:55.941849 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeec772-362f-420d-9f81-6edc07db7bf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:07:55.943761 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeec772-362f-420d-9f81-6edc07db7bf7 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:07:56.034541 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1337/2671] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 20:07:55 2022] POST /identity/v3/users => generated 297 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:07:56.038667 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714862eb-a101-4874-a81a-51d066511801 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:07:56.049889 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714862eb-a101-4874-a81a-51d066511801 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:07:56.054737 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11acac7-1216-41ad-8121-f088b5afbfec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:07:56.055465 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11acac7-1216-41ad-8121-f088b5afbfec admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:07:56.055950 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11acac7-1216-41ad-8121-f088b5afbfec admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:07:56.056299 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11acac7-1216-41ad-8121-f088b5afbfec admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:07:56.057042 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11acac7-1216-41ad-8121-f088b5afbfec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:07:56.058888 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11acac7-1216-41ad-8121-f088b5afbfec admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:07:56.070755 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1335/2672] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:07:56.075827 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeec772-362f-420d-9f81-6edc07db7bf7 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:07:56.085780 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeec772-362f-420d-9f81-6edc07db7bf7 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:07:56.090260 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c07a5-a822-47a9-9a54-3cdc886b824e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:07:56.091625 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c07a5-a822-47a9-9a54-3cdc886b824e admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:07:56.091905 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c07a5-a822-47a9-9a54-3cdc886b824e admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:07:56.092173 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c07a5-a822-47a9-9a54-3cdc886b824e admin admin] PATH_INFO: `/v3/projects/c29c2342910d48648e9660c8e3cc5113/users/366a0e6ffd6a49d9b2c59ca72023b5a2/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:07:56.107899 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c07a5-a822-47a9-9a54-3cdc886b824e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c29c2342910d48648e9660c8e3cc5113, user_id=366a0e6ffd6a49d9b2c59ca72023b5a2, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:07:56.110547 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c07a5-a822-47a9-9a54-3cdc886b824e admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:07:56.188698 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1338/2673] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 20:07:56 2022] PUT /identity/v3/projects/c29c2342910d48648e9660c8e3cc5113/users/366a0e6ffd6a49d9b2c59ca72023b5a2/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:07:56.192604 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11acac7-1216-41ad-8121-f088b5afbfec admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:07:56.203607 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11acac7-1216-41ad-8121-f088b5afbfec admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:07:56.260464 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e08a8-6e2c-47ba-aaf0-3b85f984b48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:07:56.261061 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e08a8-6e2c-47ba-aaf0-3b85f984b48c admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:07:56.261337 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e08a8-6e2c-47ba-aaf0-3b85f984b48c admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:07:56.261634 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e08a8-6e2c-47ba-aaf0-3b85f984b48c admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:07:56.262265 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364e08a8-6e2c-47ba-aaf0-3b85f984b48c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:07:56.264456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364e08a8-6e2c-47ba-aaf0-3b85f984b48c admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:07:56.273870 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1336/2674] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:07:56.278656 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c07a5-a822-47a9-9a54-3cdc886b824e admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:07:56.288826 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c07a5-a822-47a9-9a54-3cdc886b824e admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:07:56.293375 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b341b5-7874-4958-916d-57d1d73f7122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:07:56.294314 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b341b5-7874-4958-916d-57d1d73f7122 admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:07:56.294595 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b341b5-7874-4958-916d-57d1d73f7122 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:07:56.294866 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b341b5-7874-4958-916d-57d1d73f7122 admin admin] PATH_INFO: `/v3/projects/c29c2342910d48648e9660c8e3cc5113/users/366a0e6ffd6a49d9b2c59ca72023b5a2/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:07:56.296760 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b341b5-7874-4958-916d-57d1d73f7122 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c29c2342910d48648e9660c8e3cc5113, user_id=366a0e6ffd6a49d9b2c59ca72023b5a2, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:07:56.299386 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b341b5-7874-4958-916d-57d1d73f7122 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:07:56.309334 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1339/2675] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 20:07:56 2022] PUT /identity/v3/projects/c29c2342910d48648e9660c8e3cc5113/users/366a0e6ffd6a49d9b2c59ca72023b5a2/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:07:56.320511 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503980d-277b-4dcb-b3f6-44d7babb8260 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:07:56.320798 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503980d-277b-4dcb-b3f6-44d7babb8260 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:07:56.321076 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503980d-277b-4dcb-b3f6-44d7babb8260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:07:56.349551 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-a503980d-277b-4dcb-b3f6-44d7babb8260 None None] MFA Rules not processed for user `366a0e6ffd6a49d9b2c59ca72023b5a2`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:07:56.350765 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-a503980d-277b-4dcb-b3f6-44d7babb8260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:07:56.363067 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:07:56.418061 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1337/2676] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:07:56 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:07:56.429718 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b341b5-7874-4958-916d-57d1d73f7122 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:07:56.431409 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-49b341b5-7874-4958-916d-57d1d73f7122 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:07:56.510032 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b341b5-7874-4958-916d-57d1d73f7122 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:07:56.514467 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a621159-9df9-4a67-bd9d-d4e8c8d2c784 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:07:56.515072 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a621159-9df9-4a67-bd9d-d4e8c8d2c784 service cinder] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:07:56.515345 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a621159-9df9-4a67-bd9d-d4e8c8d2c784 service cinder] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:07:56.515610 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a621159-9df9-4a67-bd9d-d4e8c8d2c784 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:07:56.524301 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a621159-9df9-4a67-bd9d-d4e8c8d2c784 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:07:56.525752 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a621159-9df9-4a67-bd9d-d4e8c8d2c784 service cinder] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:07:56.535208 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1340/2677] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:07:56 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:07:56.739684 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a503980d-277b-4dcb-b3f6-44d7babb8260 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:07:56.750247 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a503980d-277b-4dcb-b3f6-44d7babb8260 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:07:56.754056 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dacb62-099f-43c1-81cd-b5e4c923a3b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:07:56.754659 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dacb62-099f-43c1-81cd-b5e4c923a3b6 service cinder] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:07:56.754940 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dacb62-099f-43c1-81cd-b5e4c923a3b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:07:56.755213 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dacb62-099f-43c1-81cd-b5e4c923a3b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:07:56.814401 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dacb62-099f-43c1-81cd-b5e4c923a3b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:07:56.815835 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dacb62-099f-43c1-81cd-b5e4c923a3b6 service cinder] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:07:56.825332 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1338/2678] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:07:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:08:05.551506 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a621159-9df9-4a67-bd9d-d4e8c8d2c784 service cinder] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:05.581440 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:08:05.613562 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a621159-9df9-4a67-bd9d-d4e8c8d2c784 service cinder] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:05.618869 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0bf655-dd10-4acb-943e-093d14e8fb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:05.619496 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0bf655-dd10-4acb-943e-093d14e8fb25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:05.619777 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0bf655-dd10-4acb-943e-093d14e8fb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:05.620055 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0bf655-dd10-4acb-943e-093d14e8fb25 admin admin] PATH_INFO: `/v3/users/8b73432c89f34533a390b511de5f7047` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:05.621173 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0bf655-dd10-4acb-943e-093d14e8fb25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b73432c89f34533a390b511de5f7047)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:05.623691 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0bf655-dd10-4acb-943e-093d14e8fb25 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:05.876320 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-3c0bf655-dd10-4acb-943e-093d14e8fb25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b73432c89f34533a390b511de5f7047'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:05.959661 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-3c0bf655-dd10-4acb-943e-093d14e8fb25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b73432c89f34533a390b511de5f7047'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:05.960254 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-3c0bf655-dd10-4acb-943e-093d14e8fb25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b73432c89f34533a390b511de5f7047'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:05.960848 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-3c0bf655-dd10-4acb-943e-093d14e8fb25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b73432c89f34533a390b511de5f7047'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:05.973967 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-3c0bf655-dd10-4acb-943e-093d14e8fb25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b73432c89f34533a390b511de5f7047'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:05.986677 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1341/2679] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 20:08:05 2022] DELETE /identity/v3/users/8b73432c89f34533a390b511de5f7047 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:08:05.991176 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda39970-2c95-4c15-8a8a-f3451471560c None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:05.991690 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda39970-2c95-4c15-8a8a-f3451471560c None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:05.991810 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda39970-2c95-4c15-8a8a-f3451471560c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:06.010861 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-bda39970-2c95-4c15-8a8a-f3451471560c None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:08:06.012043 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-bda39970-2c95-4c15-8a8a-f3451471560c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:06.072481 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1339/2680] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:08:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:08:06.082849 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0bf655-dd10-4acb-943e-093d14e8fb25 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:06.084227 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-3c0bf655-dd10-4acb-943e-093d14e8fb25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:06.140479 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0bf655-dd10-4acb-943e-093d14e8fb25 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:06.143967 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf70646-9a4b-4f4f-9014-57115988eed4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:06.144563 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf70646-9a4b-4f4f-9014-57115988eed4 service neutron] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:06.144841 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf70646-9a4b-4f4f-9014-57115988eed4 service neutron] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:06.145111 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf70646-9a4b-4f4f-9014-57115988eed4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:06.153970 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf70646-9a4b-4f4f-9014-57115988eed4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:06.156130 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf70646-9a4b-4f4f-9014-57115988eed4 service neutron] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:06.165409 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1342/2681] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:08:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:08:06.612746 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda39970-2c95-4c15-8a8a-f3451471560c None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:06.617897 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-bda39970-2c95-4c15-8a8a-f3451471560c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:06.627123 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda39970-2c95-4c15-8a8a-f3451471560c None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:06.631835 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebccd4e-1368-47a0-8a00-18707caae2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:06.632475 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebccd4e-1368-47a0-8a00-18707caae2e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:06.632758 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebccd4e-1368-47a0-8a00-18707caae2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:06.633065 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebccd4e-1368-47a0-8a00-18707caae2e6 admin admin] PATH_INFO: `/v3/projects/65bd772749a74851a0a8cbaf4a7f2630` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:06.634300 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebccd4e-1368-47a0-8a00-18707caae2e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65bd772749a74851a0a8cbaf4a7f2630)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:06.636375 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebccd4e-1368-47a0-8a00-18707caae2e6 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:06.723130 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:08:06.725717 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-8ebccd4e-1368-47a0-8a00-18707caae2e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65bd772749a74851a0a8cbaf4a7f2630', 'request_id': 'req-8ebccd4e-1368-47a0-8a00-18707caae2e6'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:06.799729 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-8ebccd4e-1368-47a0-8a00-18707caae2e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65bd772749a74851a0a8cbaf4a7f2630', 'request_id': 'req-8ebccd4e-1368-47a0-8a00-18707caae2e6'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:06.805553 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-8ebccd4e-1368-47a0-8a00-18707caae2e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65bd772749a74851a0a8cbaf4a7f2630', 'request_id': 'req-8ebccd4e-1368-47a0-8a00-18707caae2e6'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:06.817301 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-8ebccd4e-1368-47a0-8a00-18707caae2e6 admin admin] The token cache is being invalidate because project 65bd772749a74851a0a8cbaf4a7f2630 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 20:08:06.817620 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-8ebccd4e-1368-47a0-8a00-18707caae2e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:06.818254 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-8ebccd4e-1368-47a0-8a00-18707caae2e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:06.819729 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1340/2682] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 20:08:06 2022] DELETE /identity/v3/projects/65bd772749a74851a0a8cbaf4a7f2630 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:08:06.823951 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf70646-9a4b-4f4f-9014-57115988eed4 service neutron] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:06.834169 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf70646-9a4b-4f4f-9014-57115988eed4 service neutron] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:06.881588 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:08:06.891004 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c62ac-68b5-4c7c-aedb-d215bd418566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:06.891631 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c62ac-68b5-4c7c-aedb-d215bd418566 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:06.891923 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c62ac-68b5-4c7c-aedb-d215bd418566 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:06.892171 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c62ac-68b5-4c7c-aedb-d215bd418566 admin admin] PATH_INFO: `/v3/users/366a0e6ffd6a49d9b2c59ca72023b5a2` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:06.893337 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8c62ac-68b5-4c7c-aedb-d215bd418566 admin admin] RBAC: Authorizing `identity:delete_user(user_id=366a0e6ffd6a49d9b2c59ca72023b5a2)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:06.895587 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8c62ac-68b5-4c7c-aedb-d215bd418566 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:07.059222 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-cc8c62ac-68b5-4c7c-aedb-d215bd418566 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '366a0e6ffd6a49d9b2c59ca72023b5a2'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:07.130576 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-cc8c62ac-68b5-4c7c-aedb-d215bd418566 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '366a0e6ffd6a49d9b2c59ca72023b5a2'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:07.131188 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-cc8c62ac-68b5-4c7c-aedb-d215bd418566 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '366a0e6ffd6a49d9b2c59ca72023b5a2'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:07.131790 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-cc8c62ac-68b5-4c7c-aedb-d215bd418566 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '366a0e6ffd6a49d9b2c59ca72023b5a2'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:07.144216 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-cc8c62ac-68b5-4c7c-aedb-d215bd418566 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '366a0e6ffd6a49d9b2c59ca72023b5a2'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:07.156725 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1343/2683] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 20:08:06 2022] DELETE /identity/v3/users/366a0e6ffd6a49d9b2c59ca72023b5a2 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:08:07.526884 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebccd4e-1368-47a0-8a00-18707caae2e6 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:07.528308 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-8ebccd4e-1368-47a0-8a00-18707caae2e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:07.544365 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebccd4e-1368-47a0-8a00-18707caae2e6 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:07.602192 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b502f1-0878-4ccd-9a74-edf6f8862223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:07.602748 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b502f1-0878-4ccd-9a74-edf6f8862223 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:07.603029 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b502f1-0878-4ccd-9a74-edf6f8862223 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:07.603456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b502f1-0878-4ccd-9a74-edf6f8862223 admin admin] PATH_INFO: `/v3/projects/c29c2342910d48648e9660c8e3cc5113` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:07.604564 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b502f1-0878-4ccd-9a74-edf6f8862223 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c29c2342910d48648e9660c8e3cc5113)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:07.606515 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b502f1-0878-4ccd-9a74-edf6f8862223 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:07.715454 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-78b502f1-0878-4ccd-9a74-edf6f8862223 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c29c2342910d48648e9660c8e3cc5113', 'request_id': 'req-78b502f1-0878-4ccd-9a74-edf6f8862223'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:07.782240 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-78b502f1-0878-4ccd-9a74-edf6f8862223 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c29c2342910d48648e9660c8e3cc5113', 'request_id': 'req-78b502f1-0878-4ccd-9a74-edf6f8862223'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:07.788125 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-78b502f1-0878-4ccd-9a74-edf6f8862223 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c29c2342910d48648e9660c8e3cc5113', 'request_id': 'req-78b502f1-0878-4ccd-9a74-edf6f8862223'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:07.799406 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-78b502f1-0878-4ccd-9a74-edf6f8862223 admin admin] The token cache is being invalidate because project c29c2342910d48648e9660c8e3cc5113 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 20:08:07.799713 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-78b502f1-0878-4ccd-9a74-edf6f8862223 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:07.800345 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-78b502f1-0878-4ccd-9a74-edf6f8862223 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:07.801874 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1341/2684] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 20:08:07 2022] DELETE /identity/v3/projects/c29c2342910d48648e9660c8e3cc5113 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:08:07.806839 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f4d159-92c1-4aaf-b79f-bb1b99245e74 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:07.807161 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f4d159-92c1-4aaf-b79f-bb1b99245e74 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:07.807442 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f4d159-92c1-4aaf-b79f-bb1b99245e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:07.828650 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-e9f4d159-92c1-4aaf-b79f-bb1b99245e74 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:08:07.829870 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-e9f4d159-92c1-4aaf-b79f-bb1b99245e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:07.888447 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1344/2685] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:08:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 20:08:07.895997 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e24110-62c0-4b21-8754-ae2ea5a8011a None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:07.896287 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e24110-62c0-4b21-8754-ae2ea5a8011a None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:07.896564 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e24110-62c0-4b21-8754-ae2ea5a8011a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:07.916366 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-69e24110-62c0-4b21-8754-ae2ea5a8011a None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:08:07.917606 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-69e24110-62c0-4b21-8754-ae2ea5a8011a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:07.925398 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1342/2686] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:08:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 20:08:07.929483 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f4d159-92c1-4aaf-b79f-bb1b99245e74 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:07.939626 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f4d159-92c1-4aaf-b79f-bb1b99245e74 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:07.944190 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c14280-d09a-4129-90d3-e51c92e87629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:07.944785 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c14280-d09a-4129-90d3-e51c92e87629 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:07.945067 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c14280-d09a-4129-90d3-e51c92e87629 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:07.945338 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c14280-d09a-4129-90d3-e51c92e87629 admin admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:07.946034 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c14280-d09a-4129-90d3-e51c92e87629 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:08:07.946333 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c14280-d09a-4129-90d3-e51c92e87629 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:07.948174 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c14280-d09a-4129-90d3-e51c92e87629 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:07.960141 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1345/2687] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 20:08:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:08:07.964420 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e24110-62c0-4b21-8754-ae2ea5a8011a None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:07.973934 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e24110-62c0-4b21-8754-ae2ea5a8011a None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:07.978643 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510fdb4c-dc41-4ded-9eaf-3359d6881d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:07.979233 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510fdb4c-dc41-4ded-9eaf-3359d6881d15 admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:07.979516 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510fdb4c-dc41-4ded-9eaf-3359d6881d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:07.979792 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510fdb4c-dc41-4ded-9eaf-3359d6881d15 admin admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:07.980437 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510fdb4c-dc41-4ded-9eaf-3359d6881d15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:07.982367 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510fdb4c-dc41-4ded-9eaf-3359d6881d15 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:08.075292 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1343/2688] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 20:08:07 2022] POST /identity/v3/projects => generated 371 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:08:08.079816 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c14280-d09a-4129-90d3-e51c92e87629 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:08.089867 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c14280-d09a-4129-90d3-e51c92e87629 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:08.141125 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:08:08.147036 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e8dd8f-8f04-4951-8fbe-7b52bac07b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:08.147651 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8dd8f-8f04-4951-8fbe-7b52bac07b1a admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:08.149573 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8dd8f-8f04-4951-8fbe-7b52bac07b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:08.149573 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8dd8f-8f04-4951-8fbe-7b52bac07b1a admin admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:08.149573 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e8dd8f-8f04-4951-8fbe-7b52bac07b1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:08.150794 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e8dd8f-8f04-4951-8fbe-7b52bac07b1a admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:08.227995 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1346/2689] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 20:08:08 2022] POST /identity/v3/users => generated 286 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:08:08.232299 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510fdb4c-dc41-4ded-9eaf-3359d6881d15 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:08.243904 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510fdb4c-dc41-4ded-9eaf-3359d6881d15 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:08.249979 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128017db-da4d-4364-bcd8-9d59a2fab61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:08.250719 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128017db-da4d-4364-bcd8-9d59a2fab61f admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:08.251009 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128017db-da4d-4364-bcd8-9d59a2fab61f admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:08.251283 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128017db-da4d-4364-bcd8-9d59a2fab61f admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:08.251925 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128017db-da4d-4364-bcd8-9d59a2fab61f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:08.253535 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128017db-da4d-4364-bcd8-9d59a2fab61f admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:08.263708 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1344/2690] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:08:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:08:08.267570 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e8dd8f-8f04-4951-8fbe-7b52bac07b1a admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:08.277368 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e8dd8f-8f04-4951-8fbe-7b52bac07b1a admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:08.282343 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd98235-4af9-419e-9670-ad3c5f149556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:08.286302 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd98235-4af9-419e-9670-ad3c5f149556 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:08.286302 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd98235-4af9-419e-9670-ad3c5f149556 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:08.286302 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd98235-4af9-419e-9670-ad3c5f149556 admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:08.286302 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd98235-4af9-419e-9670-ad3c5f149556 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:08.286302 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd98235-4af9-419e-9670-ad3c5f149556 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:08.297320 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1347/2691] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:08:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:08:08.301033 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128017db-da4d-4364-bcd8-9d59a2fab61f admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:08.311982 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128017db-da4d-4364-bcd8-9d59a2fab61f admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:08.316698 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba7971-5c8c-4899-8226-9681df411c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:08.317340 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba7971-5c8c-4899-8226-9681df411c7a admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:08.317660 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba7971-5c8c-4899-8226-9681df411c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:08.317937 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba7971-5c8c-4899-8226-9681df411c7a admin admin] PATH_INFO: `/v3/projects/26129a034d664da9ab4ef3e02358d8c0/users/da7849f082c14376b0541e8849cff69f/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:08.331730 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:08:08.334629 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ba7971-5c8c-4899-8226-9681df411c7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=26129a034d664da9ab4ef3e02358d8c0, user_id=da7849f082c14376b0541e8849cff69f, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:08.337275 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ba7971-5c8c-4899-8226-9681df411c7a admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:08.393449 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1345/2692] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 20:08:08 2022] PUT /identity/v3/projects/26129a034d664da9ab4ef3e02358d8c0/users/da7849f082c14376b0541e8849cff69f/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:08:08.404622 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39746472-8090-431a-9450-3ad35f2c64aa None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:08.406726 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39746472-8090-431a-9450-3ad35f2c64aa None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:08.406726 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39746472-8090-431a-9450-3ad35f2c64aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:08.434755 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-39746472-8090-431a-9450-3ad35f2c64aa None None] MFA Rules not processed for user `da7849f082c14376b0541e8849cff69f`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:08:08.435984 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-39746472-8090-431a-9450-3ad35f2c64aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:08.503244 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1348/2693] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:08:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:08:08.507757 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba7971-5c8c-4899-8226-9681df411c7a admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:08.568349 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba7971-5c8c-4899-8226-9681df411c7a admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:08.573453 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117404f-5a4b-4552-b0a6-089f1fe7cb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:08.574107 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117404f-5a4b-4552-b0a6-089f1fe7cb6b admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:08.574385 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117404f-5a4b-4552-b0a6-089f1fe7cb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:08.574656 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117404f-5a4b-4552-b0a6-089f1fe7cb6b admin admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:08.575354 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4117404f-5a4b-4552-b0a6-089f1fe7cb6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:08.577775 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4117404f-5a4b-4552-b0a6-089f1fe7cb6b admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:08.676359 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1346/2694] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 20:08:08 2022] POST /identity/v3/projects => generated 373 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:08:08.680431 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39746472-8090-431a-9450-3ad35f2c64aa None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:08.691478 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39746472-8090-431a-9450-3ad35f2c64aa None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:08.749023 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33c0de0-92b5-4276-ad15-5889615922b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:08.749783 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c0de0-92b5-4276-ad15-5889615922b8 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:08.750088 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c0de0-92b5-4276-ad15-5889615922b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:08.750353 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c0de0-92b5-4276-ad15-5889615922b8 admin admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:08.750985 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33c0de0-92b5-4276-ad15-5889615922b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:08.752908 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33c0de0-92b5-4276-ad15-5889615922b8 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:08.828502 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1349/2695] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 20:08:08 2022] POST /identity/v3/users => generated 293 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 20:08:08.832658 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117404f-5a4b-4552-b0a6-089f1fe7cb6b admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:08.842934 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117404f-5a4b-4552-b0a6-089f1fe7cb6b admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:08.848469 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7427d02f-0f5f-40ad-b630-2c1e2fa459a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:08.850393 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7427d02f-0f5f-40ad-b630-2c1e2fa459a7 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:08.850393 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7427d02f-0f5f-40ad-b630-2c1e2fa459a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:08.850393 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7427d02f-0f5f-40ad-b630-2c1e2fa459a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:08.850393 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7427d02f-0f5f-40ad-b630-2c1e2fa459a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:08.851919 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7427d02f-0f5f-40ad-b630-2c1e2fa459a7 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:08.863222 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1347/2696] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:08:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:08:08.867348 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33c0de0-92b5-4276-ad15-5889615922b8 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:08.878245 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33c0de0-92b5-4276-ad15-5889615922b8 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:08.882868 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65917e8e-53b7-48c8-8ddf-e371b4264913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:08.883520 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65917e8e-53b7-48c8-8ddf-e371b4264913 admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:08.883797 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65917e8e-53b7-48c8-8ddf-e371b4264913 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:08.884071 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65917e8e-53b7-48c8-8ddf-e371b4264913 admin admin] PATH_INFO: `/v3/projects/6b4382bf0ca048c5939ec54d72db12df/users/707f4ce7a9744d4d872112fe735b97ff/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:08.899465 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65917e8e-53b7-48c8-8ddf-e371b4264913 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b4382bf0ca048c5939ec54d72db12df, user_id=707f4ce7a9744d4d872112fe735b97ff, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:08.902262 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65917e8e-53b7-48c8-8ddf-e371b4264913 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:08.965333 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1350/2697] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 20:08:08 2022] PUT /identity/v3/projects/6b4382bf0ca048c5939ec54d72db12df/users/707f4ce7a9744d4d872112fe735b97ff/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:08:08.969394 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7427d02f-0f5f-40ad-b630-2c1e2fa459a7 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:08.979443 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7427d02f-0f5f-40ad-b630-2c1e2fa459a7 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:09.035530 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd483c4d-ad26-4403-ad2b-34d5e0d78c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:09.036126 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd483c4d-ad26-4403-ad2b-34d5e0d78c1a admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:09.036408 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd483c4d-ad26-4403-ad2b-34d5e0d78c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:09.036682 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd483c4d-ad26-4403-ad2b-34d5e0d78c1a admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:09.037316 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd483c4d-ad26-4403-ad2b-34d5e0d78c1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:09.038953 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd483c4d-ad26-4403-ad2b-34d5e0d78c1a admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:09.048810 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1348/2698] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:08:08 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:08:09.052917 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65917e8e-53b7-48c8-8ddf-e371b4264913 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:09.063892 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65917e8e-53b7-48c8-8ddf-e371b4264913 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:09.068474 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6c86e-15ec-4d7e-909d-40758476922a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:09.069116 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6c86e-15ec-4d7e-909d-40758476922a admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:09.069391 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6c86e-15ec-4d7e-909d-40758476922a admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:09.069692 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6c86e-15ec-4d7e-909d-40758476922a admin admin] PATH_INFO: `/v3/projects/6b4382bf0ca048c5939ec54d72db12df/users/707f4ce7a9744d4d872112fe735b97ff/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:09.071890 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f6c86e-15ec-4d7e-909d-40758476922a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b4382bf0ca048c5939ec54d72db12df, user_id=707f4ce7a9744d4d872112fe735b97ff, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:09.074532 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f6c86e-15ec-4d7e-909d-40758476922a admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:09.085071 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1351/2699] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 20:08:09 2022] PUT /identity/v3/projects/6b4382bf0ca048c5939ec54d72db12df/users/707f4ce7a9744d4d872112fe735b97ff/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:08:09.095032 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab40d5-b504-4386-a40b-c77d22175759 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:09.095316 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab40d5-b504-4386-a40b-c77d22175759 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:09.095589 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab40d5-b504-4386-a40b-c77d22175759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:09.122803 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-03ab40d5-b504-4386-a40b-c77d22175759 None None] MFA Rules not processed for user `707f4ce7a9744d4d872112fe735b97ff`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:08:09.124751 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-03ab40d5-b504-4386-a40b-c77d22175759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:09.171277 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:08:09.190819 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1349/2700] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:08:09 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:08:09.203161 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6c86e-15ec-4d7e-909d-40758476922a admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:09.204879 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-04f6c86e-15ec-4d7e-909d-40758476922a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:09.226418 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:08:09.264281 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6c86e-15ec-4d7e-909d-40758476922a admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:09.268243 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e597cb7f-792d-4f6c-9d5b-c636c094cf44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:09.269030 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e597cb7f-792d-4f6c-9d5b-c636c094cf44 service cinder] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:09.269359 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e597cb7f-792d-4f6c-9d5b-c636c094cf44 service cinder] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:09.269939 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e597cb7f-792d-4f6c-9d5b-c636c094cf44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:09.278907 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e597cb7f-792d-4f6c-9d5b-c636c094cf44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:09.281069 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e597cb7f-792d-4f6c-9d5b-c636c094cf44 service cinder] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:09.290685 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1352/2701] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:08:09 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:08:10.136458 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab40d5-b504-4386-a40b-c77d22175759 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:10.198752 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab40d5-b504-4386-a40b-c77d22175759 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:10.203296 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fbe0f5-b516-4094-857e-5d277d871d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:10.203914 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fbe0f5-b516-4094-857e-5d277d871d3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:10.204195 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fbe0f5-b516-4094-857e-5d277d871d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:10.204465 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fbe0f5-b516-4094-857e-5d277d871d3f admin admin] PATH_INFO: `/v3/users/da7849f082c14376b0541e8849cff69f` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:10.205588 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fbe0f5-b516-4094-857e-5d277d871d3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=da7849f082c14376b0541e8849cff69f)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:10.207484 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fbe0f5-b516-4094-857e-5d277d871d3f admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:10.345170 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-16fbe0f5-b516-4094-857e-5d277d871d3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da7849f082c14376b0541e8849cff69f'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:10.410925 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-16fbe0f5-b516-4094-857e-5d277d871d3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da7849f082c14376b0541e8849cff69f'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:10.411553 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-16fbe0f5-b516-4094-857e-5d277d871d3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da7849f082c14376b0541e8849cff69f'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:10.423685 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-16fbe0f5-b516-4094-857e-5d277d871d3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da7849f082c14376b0541e8849cff69f'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:10.424311 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-16fbe0f5-b516-4094-857e-5d277d871d3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da7849f082c14376b0541e8849cff69f'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:10.436920 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1350/2702] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 20:08:10 2022] DELETE /identity/v3/users/da7849f082c14376b0541e8849cff69f => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:08:10.441366 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edad256-f92b-4c78-8460-5f82ca37a259 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:10.441892 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edad256-f92b-4c78-8460-5f82ca37a259 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:10.442026 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edad256-f92b-4c78-8460-5f82ca37a259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:10.461512 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-7edad256-f92b-4c78-8460-5f82ca37a259 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:08:10.462716 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-7edad256-f92b-4c78-8460-5f82ca37a259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:10.520710 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1353/2703] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:08:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:08:10.531274 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fbe0f5-b516-4094-857e-5d277d871d3f admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:10.532692 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-16fbe0f5-b516-4094-857e-5d277d871d3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:10.603745 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fbe0f5-b516-4094-857e-5d277d871d3f admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:10.607531 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe60c5-d419-4345-95be-90369082631c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:10.608191 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe60c5-d419-4345-95be-90369082631c service neutron] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:10.608472 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe60c5-d419-4345-95be-90369082631c service neutron] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:10.608768 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe60c5-d419-4345-95be-90369082631c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:10.618678 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfe60c5-d419-4345-95be-90369082631c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:10.620157 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfe60c5-d419-4345-95be-90369082631c service neutron] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:10.631394 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1351/2704] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:08:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:08:11.190571 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edad256-f92b-4c78-8460-5f82ca37a259 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:11.192127 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-7edad256-f92b-4c78-8460-5f82ca37a259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:11.206129 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edad256-f92b-4c78-8460-5f82ca37a259 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:11.206472 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe60c5-d419-4345-95be-90369082631c service neutron] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:11.211245 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f8a96-4c4c-47c9-99ca-6ce13f63a4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:11.212698 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f8a96-4c4c-47c9-99ca-6ce13f63a4d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:11.212987 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f8a96-4c4c-47c9-99ca-6ce13f63a4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:11.213261 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f8a96-4c4c-47c9-99ca-6ce13f63a4d4 admin admin] PATH_INFO: `/v3/projects/26129a034d664da9ab4ef3e02358d8c0` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:11.214446 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0f8a96-4c4c-47c9-99ca-6ce13f63a4d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26129a034d664da9ab4ef3e02358d8c0)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:11.215636 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe60c5-d419-4345-95be-90369082631c service neutron] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:11.216439 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0f8a96-4c4c-47c9-99ca-6ce13f63a4d4 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:11.227166 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7e064-0d5d-446f-9cf1-298f48f1d09d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:11.227798 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7e064-0d5d-446f-9cf1-298f48f1d09d service neutron] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:11.228268 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7e064-0d5d-446f-9cf1-298f48f1d09d service neutron] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:11.228544 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7e064-0d5d-446f-9cf1-298f48f1d09d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:11.230695 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-69d7e064-0d5d-446f-9cf1-298f48f1d09d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:11.235396 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:08:11.321095 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d7e064-0d5d-446f-9cf1-298f48f1d09d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:11.322989 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d7e064-0d5d-446f-9cf1-298f48f1d09d service neutron] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:11.344628 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1352/2705] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:08:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 20:08:11.350311 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-dd0f8a96-4c4c-47c9-99ca-6ce13f63a4d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26129a034d664da9ab4ef3e02358d8c0', 'request_id': 'req-dd0f8a96-4c4c-47c9-99ca-6ce13f63a4d4'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:11.356990 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-dd0f8a96-4c4c-47c9-99ca-6ce13f63a4d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26129a034d664da9ab4ef3e02358d8c0', 'request_id': 'req-dd0f8a96-4c4c-47c9-99ca-6ce13f63a4d4'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:11.416245 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-dd0f8a96-4c4c-47c9-99ca-6ce13f63a4d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26129a034d664da9ab4ef3e02358d8c0', 'request_id': 'req-dd0f8a96-4c4c-47c9-99ca-6ce13f63a4d4'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:11.427942 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-dd0f8a96-4c4c-47c9-99ca-6ce13f63a4d4 admin admin] The token cache is being invalidate because project 26129a034d664da9ab4ef3e02358d8c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 20:08:11.432625 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-dd0f8a96-4c4c-47c9-99ca-6ce13f63a4d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:11.432625 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-dd0f8a96-4c4c-47c9-99ca-6ce13f63a4d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:11.432625 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1354/2706] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 20:08:11 2022] DELETE /identity/v3/projects/26129a034d664da9ab4ef3e02358d8c0 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:08:11.434536 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7e064-0d5d-446f-9cf1-298f48f1d09d service neutron] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:11.447204 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7e064-0d5d-446f-9cf1-298f48f1d09d service neutron] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:11.509063 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b7a368-8a42-40e4-9b59-34a00296791a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:11.509734 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b7a368-8a42-40e4-9b59-34a00296791a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:11.510018 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b7a368-8a42-40e4-9b59-34a00296791a admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:11.510294 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b7a368-8a42-40e4-9b59-34a00296791a admin admin] PATH_INFO: `/v3/users/707f4ce7a9744d4d872112fe735b97ff` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:11.512315 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b7a368-8a42-40e4-9b59-34a00296791a admin admin] RBAC: Authorizing `identity:delete_user(user_id=707f4ce7a9744d4d872112fe735b97ff)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:11.514390 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b7a368-8a42-40e4-9b59-34a00296791a admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:11.739898 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-f3b7a368-8a42-40e4-9b59-34a00296791a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '707f4ce7a9744d4d872112fe735b97ff'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:11.805425 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-f3b7a368-8a42-40e4-9b59-34a00296791a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '707f4ce7a9744d4d872112fe735b97ff'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:11.806068 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-f3b7a368-8a42-40e4-9b59-34a00296791a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '707f4ce7a9744d4d872112fe735b97ff'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:11.820578 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-f3b7a368-8a42-40e4-9b59-34a00296791a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '707f4ce7a9744d4d872112fe735b97ff'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:11.821614 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-f3b7a368-8a42-40e4-9b59-34a00296791a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '707f4ce7a9744d4d872112fe735b97ff'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:11.828090 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:08:11.837831 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1353/2707] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 20:08:11 2022] DELETE /identity/v3/users/707f4ce7a9744d4d872112fe735b97ff => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:08:12.230298 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f8a96-4c4c-47c9-99ca-6ce13f63a4d4 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:12.231891 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-dd0f8a96-4c4c-47c9-99ca-6ce13f63a4d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:12.247485 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f8a96-4c4c-47c9-99ca-6ce13f63a4d4 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:12.290239 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:08:12.305209 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63fbd16-c76b-4e5f-9eeb-ba2653bcf280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:12.308032 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63fbd16-c76b-4e5f-9eeb-ba2653bcf280 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:12.308032 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63fbd16-c76b-4e5f-9eeb-ba2653bcf280 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:12.308032 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63fbd16-c76b-4e5f-9eeb-ba2653bcf280 admin admin] PATH_INFO: `/v3/projects/6b4382bf0ca048c5939ec54d72db12df` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:12.308032 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63fbd16-c76b-4e5f-9eeb-ba2653bcf280 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b4382bf0ca048c5939ec54d72db12df)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:12.309601 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63fbd16-c76b-4e5f-9eeb-ba2653bcf280 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:12.441009 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-e63fbd16-c76b-4e5f-9eeb-ba2653bcf280 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b4382bf0ca048c5939ec54d72db12df', 'request_id': 'req-e63fbd16-c76b-4e5f-9eeb-ba2653bcf280'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:12.447692 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-e63fbd16-c76b-4e5f-9eeb-ba2653bcf280 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b4382bf0ca048c5939ec54d72db12df', 'request_id': 'req-e63fbd16-c76b-4e5f-9eeb-ba2653bcf280'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:12.577347 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-e63fbd16-c76b-4e5f-9eeb-ba2653bcf280 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b4382bf0ca048c5939ec54d72db12df', 'request_id': 'req-e63fbd16-c76b-4e5f-9eeb-ba2653bcf280'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:12.588836 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-e63fbd16-c76b-4e5f-9eeb-ba2653bcf280 admin admin] The token cache is being invalidate because project 6b4382bf0ca048c5939ec54d72db12df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 20:08:12.589093 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-e63fbd16-c76b-4e5f-9eeb-ba2653bcf280 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:12.589773 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-e63fbd16-c76b-4e5f-9eeb-ba2653bcf280 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:12.591290 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1355/2708] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 20:08:12 2022] DELETE /identity/v3/projects/6b4382bf0ca048c5939ec54d72db12df => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 20:08:12.597888 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97aa3af-6438-4684-a6cc-19ddc48f1792 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:12.598404 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97aa3af-6438-4684-a6cc-19ddc48f1792 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:12.598502 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97aa3af-6438-4684-a6cc-19ddc48f1792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:12.618795 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-f97aa3af-6438-4684-a6cc-19ddc48f1792 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:08:12.620004 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-f97aa3af-6438-4684-a6cc-19ddc48f1792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:12.686513 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1354/2709] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:08:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:08:12.694068 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27678f51-40eb-4885-b0d5-5e297122cbf1 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:12.698321 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27678f51-40eb-4885-b0d5-5e297122cbf1 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:12.698321 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27678f51-40eb-4885-b0d5-5e297122cbf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:12.715280 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-27678f51-40eb-4885-b0d5-5e297122cbf1 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:08:12.716463 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-27678f51-40eb-4885-b0d5-5e297122cbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:12.724636 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1356/2710] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:08:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:08:12.728852 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97aa3af-6438-4684-a6cc-19ddc48f1792 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:12.739176 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97aa3af-6438-4684-a6cc-19ddc48f1792 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:12.743800 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd5d5b-e653-4c35-92f1-4a9960a8ad31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:12.744394 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd5d5b-e653-4c35-92f1-4a9960a8ad31 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:12.744672 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd5d5b-e653-4c35-92f1-4a9960a8ad31 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:12.744944 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd5d5b-e653-4c35-92f1-4a9960a8ad31 admin admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:12.745609 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd5d5b-e653-4c35-92f1-4a9960a8ad31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:08:12.745915 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd5d5b-e653-4c35-92f1-4a9960a8ad31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:12.747490 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd5d5b-e653-4c35-92f1-4a9960a8ad31 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:12.759568 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1355/2711] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 20:08:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:08:12.763872 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27678f51-40eb-4885-b0d5-5e297122cbf1 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:12.774087 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27678f51-40eb-4885-b0d5-5e297122cbf1 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:12.778948 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e2265-de80-4f05-ae83-f284fc348e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:12.779844 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e2265-de80-4f05-ae83-f284fc348e1e admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:12.780657 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e2265-de80-4f05-ae83-f284fc348e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:12.780786 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e2265-de80-4f05-ae83-f284fc348e1e admin admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:12.781585 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1e2265-de80-4f05-ae83-f284fc348e1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:12.783566 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1e2265-de80-4f05-ae83-f284fc348e1e admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:12.869839 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1357/2712] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 20:08:12 2022] POST /identity/v3/projects => generated 367 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:08:12.874717 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd5d5b-e653-4c35-92f1-4a9960a8ad31 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:12.884868 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd5d5b-e653-4c35-92f1-4a9960a8ad31 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:12.944126 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef543d-e4ff-4903-8749-352ff7560081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:12.944746 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef543d-e4ff-4903-8749-352ff7560081 admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:12.945024 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef543d-e4ff-4903-8749-352ff7560081 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:12.945279 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef543d-e4ff-4903-8749-352ff7560081 admin admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:12.945953 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfef543d-e4ff-4903-8749-352ff7560081 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:12.948127 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfef543d-e4ff-4903-8749-352ff7560081 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:13.028514 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1356/2713] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 20:08:12 2022] POST /identity/v3/users => generated 284 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:08:13.033453 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e2265-de80-4f05-ae83-f284fc348e1e admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:13.043841 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e2265-de80-4f05-ae83-f284fc348e1e admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:13.049614 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c39cc0-b69a-4567-ac92-fad5af34106b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:13.050222 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c39cc0-b69a-4567-ac92-fad5af34106b admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:13.050497 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c39cc0-b69a-4567-ac92-fad5af34106b admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:13.050763 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c39cc0-b69a-4567-ac92-fad5af34106b admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:13.051397 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c39cc0-b69a-4567-ac92-fad5af34106b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:13.053088 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c39cc0-b69a-4567-ac92-fad5af34106b admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:13.063784 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1358/2714] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:08:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:08:13.069127 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef543d-e4ff-4903-8749-352ff7560081 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:13.078821 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef543d-e4ff-4903-8749-352ff7560081 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:13.083621 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef41cc-3100-4e52-a0b8-6c6651bf1358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:13.084281 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef41cc-3100-4e52-a0b8-6c6651bf1358 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:13.084564 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef41cc-3100-4e52-a0b8-6c6651bf1358 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:13.084839 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef41cc-3100-4e52-a0b8-6c6651bf1358 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:13.085488 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bef41cc-3100-4e52-a0b8-6c6651bf1358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:13.087104 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bef41cc-3100-4e52-a0b8-6c6651bf1358 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:13.098870 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1357/2715] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:08:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:08:13.106489 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c39cc0-b69a-4567-ac92-fad5af34106b admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:13.117312 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c39cc0-b69a-4567-ac92-fad5af34106b admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:13.122925 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627904b-13d2-425f-9be6-22d31e7513d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:13.123679 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627904b-13d2-425f-9be6-22d31e7513d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:13.123957 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627904b-13d2-425f-9be6-22d31e7513d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:13.124398 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627904b-13d2-425f-9be6-22d31e7513d1 admin admin] PATH_INFO: `/v3/projects/3fadfb7b965d438bb5d5959c698f590e/users/66dd7a55cbc14036bf67f474fb9e99b9/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:13.140082 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8627904b-13d2-425f-9be6-22d31e7513d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fadfb7b965d438bb5d5959c698f590e, user_id=66dd7a55cbc14036bf67f474fb9e99b9, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:13.142892 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8627904b-13d2-425f-9be6-22d31e7513d1 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:13.228761 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1359/2716] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 20:08:13 2022] PUT /identity/v3/projects/3fadfb7b965d438bb5d5959c698f590e/users/66dd7a55cbc14036bf67f474fb9e99b9/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 20:08:13.240877 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b42901-a7b4-4631-adaf-bd00a9d7bfe8 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:13.241251 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b42901-a7b4-4631-adaf-bd00a9d7bfe8 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:13.241639 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b42901-a7b4-4631-adaf-bd00a9d7bfe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:13.270845 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-69b42901-a7b4-4631-adaf-bd00a9d7bfe8 None None] MFA Rules not processed for user `66dd7a55cbc14036bf67f474fb9e99b9`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:08:13.272119 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-69b42901-a7b4-4631-adaf-bd00a9d7bfe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:13.322241 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:08:13.339972 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1358/2717] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:08:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:08:13.345251 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627904b-13d2-425f-9be6-22d31e7513d1 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:13.409430 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627904b-13d2-425f-9be6-22d31e7513d1 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:13.414546 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05184e65-4f8a-4e97-ad02-8a9998b44e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:13.415597 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05184e65-4f8a-4e97-ad02-8a9998b44e9a admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:13.416628 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05184e65-4f8a-4e97-ad02-8a9998b44e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:13.416628 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05184e65-4f8a-4e97-ad02-8a9998b44e9a admin admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:13.417040 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05184e65-4f8a-4e97-ad02-8a9998b44e9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:13.419421 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05184e65-4f8a-4e97-ad02-8a9998b44e9a admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:13.440325 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:08:13.533011 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1360/2718] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 20:08:13 2022] POST /identity/v3/projects => generated 367 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 20:08:13.537329 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b42901-a7b4-4631-adaf-bd00a9d7bfe8 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:13.548195 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b42901-a7b4-4631-adaf-bd00a9d7bfe8 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:13.605755 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a9f898-3a2e-492e-a7fe-9f49577442d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:13.606451 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9f898-3a2e-492e-a7fe-9f49577442d4 admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:13.606647 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9f898-3a2e-492e-a7fe-9f49577442d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:13.606923 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9f898-3a2e-492e-a7fe-9f49577442d4 admin admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:13.607560 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a9f898-3a2e-492e-a7fe-9f49577442d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:13.609643 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a9f898-3a2e-492e-a7fe-9f49577442d4 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:13.729051 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1359/2719] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 20:08:13 2022] POST /identity/v3/users => generated 290 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:08:13.730566 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05184e65-4f8a-4e97-ad02-8a9998b44e9a admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:13.742244 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05184e65-4f8a-4e97-ad02-8a9998b44e9a admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:13.752003 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c4f49-fb93-483a-a5a9-253f808dec16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:13.752639 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c4f49-fb93-483a-a5a9-253f808dec16 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:13.752913 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c4f49-fb93-483a-a5a9-253f808dec16 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:13.753184 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c4f49-fb93-483a-a5a9-253f808dec16 admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:13.754344 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133c4f49-fb93-483a-a5a9-253f808dec16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:13.755851 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133c4f49-fb93-483a-a5a9-253f808dec16 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:13.769570 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1361/2720] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:08:13 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:08:13.773905 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a9f898-3a2e-492e-a7fe-9f49577442d4 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:13.790412 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a9f898-3a2e-492e-a7fe-9f49577442d4 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:13.813637 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc9c18-0e20-4cdf-bd5a-0d5054071a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:13.815257 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc9c18-0e20-4cdf-bd5a-0d5054071a94 admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:13.815830 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc9c18-0e20-4cdf-bd5a-0d5054071a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:13.816256 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc9c18-0e20-4cdf-bd5a-0d5054071a94 admin admin] PATH_INFO: `/v3/projects/0e6aaa0e7d1f4133b41aba1b390a8306/users/ae322f31d59f4cdca1d987f363dee26f/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:13.849364 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecc9c18-0e20-4cdf-bd5a-0d5054071a94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e6aaa0e7d1f4133b41aba1b390a8306, user_id=ae322f31d59f4cdca1d987f363dee26f, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:13.852953 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecc9c18-0e20-4cdf-bd5a-0d5054071a94 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:13.977242 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1360/2721] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 20:08:13 2022] PUT /identity/v3/projects/0e6aaa0e7d1f4133b41aba1b390a8306/users/ae322f31d59f4cdca1d987f363dee26f/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:08:13.981081 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c4f49-fb93-483a-a5a9-253f808dec16 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:13.991309 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c4f49-fb93-483a-a5a9-253f808dec16 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:14.049188 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2809f420-107e-41cc-b9a8-f93dbac239f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:14.049958 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809f420-107e-41cc-b9a8-f93dbac239f0 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:14.050231 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809f420-107e-41cc-b9a8-f93dbac239f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:14.051314 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809f420-107e-41cc-b9a8-f93dbac239f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:14.052013 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2809f420-107e-41cc-b9a8-f93dbac239f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:14.054110 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2809f420-107e-41cc-b9a8-f93dbac239f0 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:14.065592 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1362/2722] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:08:13 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:08:14.070041 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc9c18-0e20-4cdf-bd5a-0d5054071a94 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:14.083515 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc9c18-0e20-4cdf-bd5a-0d5054071a94 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:14.088823 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd65c7d-3ed3-49ab-b37a-eb9b565da833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:14.089597 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd65c7d-3ed3-49ab-b37a-eb9b565da833 admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:14.089891 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd65c7d-3ed3-49ab-b37a-eb9b565da833 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:14.090154 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd65c7d-3ed3-49ab-b37a-eb9b565da833 admin admin] PATH_INFO: `/v3/projects/0e6aaa0e7d1f4133b41aba1b390a8306/users/ae322f31d59f4cdca1d987f363dee26f/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:14.092197 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd65c7d-3ed3-49ab-b37a-eb9b565da833 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e6aaa0e7d1f4133b41aba1b390a8306, user_id=ae322f31d59f4cdca1d987f363dee26f, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:14.094909 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd65c7d-3ed3-49ab-b37a-eb9b565da833 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:14.106218 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1361/2723] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 20:08:14 2022] PUT /identity/v3/projects/0e6aaa0e7d1f4133b41aba1b390a8306/users/ae322f31d59f4cdca1d987f363dee26f/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:08:14.117004 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a1215-ee46-4239-80fe-a9be06228f06 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:14.117292 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a1215-ee46-4239-80fe-a9be06228f06 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:14.117605 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a1215-ee46-4239-80fe-a9be06228f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:14.147143 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-d43a1215-ee46-4239-80fe-a9be06228f06 None None] MFA Rules not processed for user `ae322f31d59f4cdca1d987f363dee26f`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:08:14.148357 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-d43a1215-ee46-4239-80fe-a9be06228f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:14.226392 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1363/2724] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:08:14 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:08:14.237759 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd65c7d-3ed3-49ab-b37a-eb9b565da833 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:14.239662 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-ebd65c7d-3ed3-49ab-b37a-eb9b565da833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:14.299351 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd65c7d-3ed3-49ab-b37a-eb9b565da833 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:14.303256 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b53d9-1209-4222-bc45-862c862f3497 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:14.303898 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b53d9-1209-4222-bc45-862c862f3497 service cinder] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:14.304186 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b53d9-1209-4222-bc45-862c862f3497 service cinder] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:14.304460 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b53d9-1209-4222-bc45-862c862f3497 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:14.314009 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16b53d9-1209-4222-bc45-862c862f3497 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:14.315476 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16b53d9-1209-4222-bc45-862c862f3497 service cinder] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:14.325723 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1362/2725] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:08:14 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:08:17.240938 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a1215-ee46-4239-80fe-a9be06228f06 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:17.303739 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a1215-ee46-4239-80fe-a9be06228f06 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:17.308282 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874aa6f7-4a58-4766-849e-fb06ca30ea2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:17.308905 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874aa6f7-4a58-4766-849e-fb06ca30ea2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:17.309182 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874aa6f7-4a58-4766-849e-fb06ca30ea2c admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:17.309452 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874aa6f7-4a58-4766-849e-fb06ca30ea2c admin admin] PATH_INFO: `/v3/users/66dd7a55cbc14036bf67f474fb9e99b9` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:17.310615 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874aa6f7-4a58-4766-849e-fb06ca30ea2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=66dd7a55cbc14036bf67f474fb9e99b9)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:17.312813 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874aa6f7-4a58-4766-849e-fb06ca30ea2c admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:17.318396 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=100 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:08:17.522729 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-874aa6f7-4a58-4766-849e-fb06ca30ea2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66dd7a55cbc14036bf67f474fb9e99b9'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:17.662254 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-874aa6f7-4a58-4766-849e-fb06ca30ea2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66dd7a55cbc14036bf67f474fb9e99b9'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:17.662869 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-874aa6f7-4a58-4766-849e-fb06ca30ea2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66dd7a55cbc14036bf67f474fb9e99b9'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:17.663656 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-874aa6f7-4a58-4766-849e-fb06ca30ea2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66dd7a55cbc14036bf67f474fb9e99b9'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:17.678113 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-874aa6f7-4a58-4766-849e-fb06ca30ea2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66dd7a55cbc14036bf67f474fb9e99b9'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:17.692391 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1364/2726] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 20:08:17 2022] DELETE /identity/v3/users/66dd7a55cbc14036bf67f474fb9e99b9 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:08:17.697155 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d329d5-dd53-4abe-9411-835ecb876e66 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:17.697640 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d329d5-dd53-4abe-9411-835ecb876e66 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:17.697739 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d329d5-dd53-4abe-9411-835ecb876e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:17.717643 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-b7d329d5-dd53-4abe-9411-835ecb876e66 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:08:17.719075 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-b7d329d5-dd53-4abe-9411-835ecb876e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:17.758307 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:08:17.777455 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1363/2727] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:08:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:08:17.787925 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874aa6f7-4a58-4766-849e-fb06ca30ea2c admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:17.789237 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-874aa6f7-4a58-4766-849e-fb06ca30ea2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:17.849428 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874aa6f7-4a58-4766-849e-fb06ca30ea2c admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:17.853263 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce20271-9e3f-4ea6-b337-dc6512b5633a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:17.853934 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce20271-9e3f-4ea6-b337-dc6512b5633a service neutron] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:17.854210 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce20271-9e3f-4ea6-b337-dc6512b5633a service neutron] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:17.854480 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce20271-9e3f-4ea6-b337-dc6512b5633a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:17.865529 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce20271-9e3f-4ea6-b337-dc6512b5633a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:17.866949 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce20271-9e3f-4ea6-b337-dc6512b5633a service neutron] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:17.877010 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1365/2728] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:08:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:08:18.281986 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d329d5-dd53-4abe-9411-835ecb876e66 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:18.285403 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-b7d329d5-dd53-4abe-9411-835ecb876e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:18.296412 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d329d5-dd53-4abe-9411-835ecb876e66 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:18.301627 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760e5a0-392e-46cc-80f3-a8acca5874b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:18.302263 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760e5a0-392e-46cc-80f3-a8acca5874b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:18.302564 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760e5a0-392e-46cc-80f3-a8acca5874b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:18.302809 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760e5a0-392e-46cc-80f3-a8acca5874b5 admin admin] PATH_INFO: `/v3/projects/3fadfb7b965d438bb5d5959c698f590e` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:18.303979 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b760e5a0-392e-46cc-80f3-a8acca5874b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fadfb7b965d438bb5d5959c698f590e)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:18.306674 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b760e5a0-392e-46cc-80f3-a8acca5874b5 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:18.394596 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-b760e5a0-392e-46cc-80f3-a8acca5874b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fadfb7b965d438bb5d5959c698f590e', 'request_id': 'req-b760e5a0-392e-46cc-80f3-a8acca5874b5'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:18.459488 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-b760e5a0-392e-46cc-80f3-a8acca5874b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fadfb7b965d438bb5d5959c698f590e', 'request_id': 'req-b760e5a0-392e-46cc-80f3-a8acca5874b5'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:18.463365 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-b760e5a0-392e-46cc-80f3-a8acca5874b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fadfb7b965d438bb5d5959c698f590e', 'request_id': 'req-b760e5a0-392e-46cc-80f3-a8acca5874b5'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:18.475706 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-b760e5a0-392e-46cc-80f3-a8acca5874b5 admin admin] The token cache is being invalidate because project 3fadfb7b965d438bb5d5959c698f590e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 20:08:18.476122 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-b760e5a0-392e-46cc-80f3-a8acca5874b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:18.476911 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-b760e5a0-392e-46cc-80f3-a8acca5874b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:18.478423 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1364/2729] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 20:08:18 2022] DELETE /identity/v3/projects/3fadfb7b965d438bb5d5959c698f590e => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 20:08:18.482367 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce20271-9e3f-4ea6-b337-dc6512b5633a service neutron] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:18.494641 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce20271-9e3f-4ea6-b337-dc6512b5633a service neutron] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:18.504283 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760e5a0-392e-46cc-80f3-a8acca5874b5 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:18.505915 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-b760e5a0-392e-46cc-80f3-a8acca5874b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:18.556303 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df4928a-1281-4391-a16b-eb65735fea91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:18.556303 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df4928a-1281-4391-a16b-eb65735fea91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:18.556303 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df4928a-1281-4391-a16b-eb65735fea91 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:18.556303 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df4928a-1281-4391-a16b-eb65735fea91 admin admin] PATH_INFO: `/v3/users/ae322f31d59f4cdca1d987f363dee26f` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:18.556810 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df4928a-1281-4391-a16b-eb65735fea91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae322f31d59f4cdca1d987f363dee26f)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:18.557030 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df4928a-1281-4391-a16b-eb65735fea91 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:18.565530 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760e5a0-392e-46cc-80f3-a8acca5874b5 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:18.569192 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2425d7e4-c69b-42c2-ba8a-b276778a03f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:18.569851 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425d7e4-c69b-42c2-ba8a-b276778a03f0 service neutron] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:18.570133 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425d7e4-c69b-42c2-ba8a-b276778a03f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:18.570402 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425d7e4-c69b-42c2-ba8a-b276778a03f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:18.572440 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-2425d7e4-c69b-42c2-ba8a-b276778a03f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:18.584578 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2425d7e4-c69b-42c2-ba8a-b276778a03f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:18.586104 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2425d7e4-c69b-42c2-ba8a-b276778a03f0 service neutron] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:18.595930 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1365/2730] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:08:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 20:08:18.760570 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:08:18.774917 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-4df4928a-1281-4391-a16b-eb65735fea91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae322f31d59f4cdca1d987f363dee26f'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:18.845047 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-4df4928a-1281-4391-a16b-eb65735fea91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae322f31d59f4cdca1d987f363dee26f'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:18.845647 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-4df4928a-1281-4391-a16b-eb65735fea91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae322f31d59f4cdca1d987f363dee26f'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:18.846265 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-4df4928a-1281-4391-a16b-eb65735fea91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae322f31d59f4cdca1d987f363dee26f'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:18.861413 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-4df4928a-1281-4391-a16b-eb65735fea91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae322f31d59f4cdca1d987f363dee26f'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:18.878971 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1366/2731] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 20:08:18 2022] DELETE /identity/v3/users/ae322f31d59f4cdca1d987f363dee26f => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:08:19.281922 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2425d7e4-c69b-42c2-ba8a-b276778a03f0 service neutron] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:19.283634 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-2425d7e4-c69b-42c2-ba8a-b276778a03f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:19.296391 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2425d7e4-c69b-42c2-ba8a-b276778a03f0 service neutron] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:19.357588 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f91b21-8740-418e-a025-4a1621cdd27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:19.358492 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f91b21-8740-418e-a025-4a1621cdd27a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:19.358791 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f91b21-8740-418e-a025-4a1621cdd27a admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:19.359068 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f91b21-8740-418e-a025-4a1621cdd27a admin admin] PATH_INFO: `/v3/projects/0e6aaa0e7d1f4133b41aba1b390a8306` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:19.360223 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f91b21-8740-418e-a025-4a1621cdd27a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e6aaa0e7d1f4133b41aba1b390a8306)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:19.362453 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f91b21-8740-418e-a025-4a1621cdd27a admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:19.374586 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:08:19.469397 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-67f91b21-8740-418e-a025-4a1621cdd27a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e6aaa0e7d1f4133b41aba1b390a8306', 'request_id': 'req-67f91b21-8740-418e-a025-4a1621cdd27a'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:19.559646 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-67f91b21-8740-418e-a025-4a1621cdd27a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e6aaa0e7d1f4133b41aba1b390a8306', 'request_id': 'req-67f91b21-8740-418e-a025-4a1621cdd27a'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:19.566448 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-67f91b21-8740-418e-a025-4a1621cdd27a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e6aaa0e7d1f4133b41aba1b390a8306', 'request_id': 'req-67f91b21-8740-418e-a025-4a1621cdd27a'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:19.579754 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-67f91b21-8740-418e-a025-4a1621cdd27a admin admin] The token cache is being invalidate because project 0e6aaa0e7d1f4133b41aba1b390a8306 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 20:08:19.579754 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-67f91b21-8740-418e-a025-4a1621cdd27a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:19.579968 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-67f91b21-8740-418e-a025-4a1621cdd27a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:19.581388 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1366/2732] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 20:08:19 2022] DELETE /identity/v3/projects/0e6aaa0e7d1f4133b41aba1b390a8306 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:08:19.586425 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7ea01-3a15-4a6c-afed-9255007cd524 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:19.586900 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7ea01-3a15-4a6c-afed-9255007cd524 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:19.587096 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7ea01-3a15-4a6c-afed-9255007cd524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:19.612575 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-3ba7ea01-3a15-4a6c-afed-9255007cd524 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:08:19.614264 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-3ba7ea01-3a15-4a6c-afed-9255007cd524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:19.680154 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1367/2733] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:08:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 20:08:19.690339 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd8ae4-84bf-4ff9-b8f6-2dbeb4140389 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:19.690621 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd8ae4-84bf-4ff9-b8f6-2dbeb4140389 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:19.690902 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd8ae4-84bf-4ff9-b8f6-2dbeb4140389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:19.714381 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-f9bd8ae4-84bf-4ff9-b8f6-2dbeb4140389 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:08:19.716022 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-f9bd8ae4-84bf-4ff9-b8f6-2dbeb4140389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:19.726271 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1367/2734] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:08:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:08:19.731327 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba7ea01-3a15-4a6c-afed-9255007cd524 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:19.742430 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba7ea01-3a15-4a6c-afed-9255007cd524 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:19.747551 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb56e65-4cc8-4d0f-84a8-8b64ed0f5903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:19.748987 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb56e65-4cc8-4d0f-84a8-8b64ed0f5903 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:19.749445 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb56e65-4cc8-4d0f-84a8-8b64ed0f5903 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:19.750236 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb56e65-4cc8-4d0f-84a8-8b64ed0f5903 admin admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:19.750822 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb56e65-4cc8-4d0f-84a8-8b64ed0f5903 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:08:19.751129 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb56e65-4cc8-4d0f-84a8-8b64ed0f5903 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:19.752840 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb56e65-4cc8-4d0f-84a8-8b64ed0f5903 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:19.767367 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1368/2735] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 20:08:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:08:19.771772 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd8ae4-84bf-4ff9-b8f6-2dbeb4140389 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:19.781482 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd8ae4-84bf-4ff9-b8f6-2dbeb4140389 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:19.787035 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaaaedf-7cda-4761-9581-477eda13cf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:19.787643 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaaaedf-7cda-4761-9581-477eda13cf3f admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:19.787919 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaaaedf-7cda-4761-9581-477eda13cf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:19.788190 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaaaedf-7cda-4761-9581-477eda13cf3f admin admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:19.788821 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaaaedf-7cda-4761-9581-477eda13cf3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:19.790829 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaaaedf-7cda-4761-9581-477eda13cf3f admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:19.902884 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1368/2736] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 20:08:19 2022] POST /identity/v3/projects => generated 383 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:08:19.903945 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb56e65-4cc8-4d0f-84a8-8b64ed0f5903 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:19.915361 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb56e65-4cc8-4d0f-84a8-8b64ed0f5903 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:19.979232 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d3ffa-9cb1-4014-a217-3bbb8f2961d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:19.979854 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d3ffa-9cb1-4014-a217-3bbb8f2961d3 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:19.980369 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d3ffa-9cb1-4014-a217-3bbb8f2961d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:19.980641 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d3ffa-9cb1-4014-a217-3bbb8f2961d3 admin admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:19.981292 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0d3ffa-9cb1-4014-a217-3bbb8f2961d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:19.983325 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0d3ffa-9cb1-4014-a217-3bbb8f2961d3 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:20.083473 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1369/2737] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 20:08:19 2022] POST /identity/v3/users => generated 292 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:08:20.085043 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaaaedf-7cda-4761-9581-477eda13cf3f admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:20.096468 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaaaedf-7cda-4761-9581-477eda13cf3f admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:20.101596 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb07becf-e592-4acd-b71b-257df60c866f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:20.102210 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07becf-e592-4acd-b71b-257df60c866f admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:20.102491 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07becf-e592-4acd-b71b-257df60c866f admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:20.102768 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07becf-e592-4acd-b71b-257df60c866f admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:20.103426 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb07becf-e592-4acd-b71b-257df60c866f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:20.105106 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb07becf-e592-4acd-b71b-257df60c866f admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:20.119590 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1369/2738] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:08:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:08:20.120835 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d3ffa-9cb1-4014-a217-3bbb8f2961d3 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:20.132222 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d3ffa-9cb1-4014-a217-3bbb8f2961d3 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:20.136929 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b25f96-b781-4821-b64c-82489234d740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:20.137552 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b25f96-b781-4821-b64c-82489234d740 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:20.137834 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b25f96-b781-4821-b64c-82489234d740 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:20.138103 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b25f96-b781-4821-b64c-82489234d740 admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:20.138742 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b25f96-b781-4821-b64c-82489234d740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:20.141016 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b25f96-b781-4821-b64c-82489234d740 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:20.151773 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1370/2739] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:08:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:08:20.156510 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb07becf-e592-4acd-b71b-257df60c866f admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:20.166473 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb07becf-e592-4acd-b71b-257df60c866f admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:20.172515 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c49b4b-aed0-4431-acc2-00910a99f199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:20.173245 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c49b4b-aed0-4431-acc2-00910a99f199 admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:20.173633 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c49b4b-aed0-4431-acc2-00910a99f199 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:20.173975 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c49b4b-aed0-4431-acc2-00910a99f199 admin admin] PATH_INFO: `/v3/projects/eef403ec495f4ddc8bf02a1bc5e77e4c/users/25c45d35b1db4b308d8728b65ec7690f/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:20.189058 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c49b4b-aed0-4431-acc2-00910a99f199 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eef403ec495f4ddc8bf02a1bc5e77e4c, user_id=25c45d35b1db4b308d8728b65ec7690f, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:20.191820 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c49b4b-aed0-4431-acc2-00910a99f199 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:20.256795 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1370/2740] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 20:08:20 2022] PUT /identity/v3/projects/eef403ec495f4ddc8bf02a1bc5e77e4c/users/25c45d35b1db4b308d8728b65ec7690f/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:08:20.267761 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2964485-23fc-41ff-baea-6fc6207755ba None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:20.268041 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2964485-23fc-41ff-baea-6fc6207755ba None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:20.268306 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2964485-23fc-41ff-baea-6fc6207755ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:20.294055 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:08:20.296940 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-e2964485-23fc-41ff-baea-6fc6207755ba None None] MFA Rules not processed for user `25c45d35b1db4b308d8728b65ec7690f`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:08:20.298183 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-e2964485-23fc-41ff-baea-6fc6207755ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:20.381828 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1371/2741] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:08:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:08:20.388254 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c49b4b-aed0-4431-acc2-00910a99f199 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:20.463696 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c49b4b-aed0-4431-acc2-00910a99f199 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:20.471038 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e1740-e817-41c5-8c93-696707cb2518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:20.471735 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e1740-e817-41c5-8c93-696707cb2518 admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:20.472106 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e1740-e817-41c5-8c93-696707cb2518 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:20.472449 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e1740-e817-41c5-8c93-696707cb2518 admin admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:20.473160 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85e1740-e817-41c5-8c93-696707cb2518 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:20.475318 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85e1740-e817-41c5-8c93-696707cb2518 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:20.560439 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1371/2742] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 20:08:20 2022] POST /identity/v3/projects => generated 381 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:08:20.564616 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2964485-23fc-41ff-baea-6fc6207755ba None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:20.576188 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2964485-23fc-41ff-baea-6fc6207755ba None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:20.640089 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85701f1d-4a11-4b83-a42e-8db2c1fd6e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:20.640965 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85701f1d-4a11-4b83-a42e-8db2c1fd6e6c admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:20.641108 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85701f1d-4a11-4b83-a42e-8db2c1fd6e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:20.641853 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85701f1d-4a11-4b83-a42e-8db2c1fd6e6c admin admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:20.642175 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85701f1d-4a11-4b83-a42e-8db2c1fd6e6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:20.644277 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85701f1d-4a11-4b83-a42e-8db2c1fd6e6c admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:20.749885 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1372/2743] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 20:08:20 2022] POST /identity/v3/users => generated 297 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:08:20.753623 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e1740-e817-41c5-8c93-696707cb2518 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:20.765276 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e1740-e817-41c5-8c93-696707cb2518 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:20.770899 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c30490c-80c0-4312-844f-dfd66042fe8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:20.774795 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30490c-80c0-4312-844f-dfd66042fe8a admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:20.774795 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30490c-80c0-4312-844f-dfd66042fe8a admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:20.774795 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30490c-80c0-4312-844f-dfd66042fe8a admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:20.774795 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c30490c-80c0-4312-844f-dfd66042fe8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:20.774795 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c30490c-80c0-4312-844f-dfd66042fe8a admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:20.790633 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1372/2744] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:08:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 20:08:20.794761 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85701f1d-4a11-4b83-a42e-8db2c1fd6e6c admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:20.806297 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85701f1d-4a11-4b83-a42e-8db2c1fd6e6c admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:20.813177 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4149a33-09db-40cc-948d-811e4bce147b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:20.813897 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4149a33-09db-40cc-948d-811e4bce147b admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:20.814396 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4149a33-09db-40cc-948d-811e4bce147b admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:20.814676 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4149a33-09db-40cc-948d-811e4bce147b admin admin] PATH_INFO: `/v3/projects/ed079d4bdd7e4556b2bb62ef8d13a56a/users/89eb104e62ad404db779af3fb21f12b7/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:20.834840 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4149a33-09db-40cc-948d-811e4bce147b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed079d4bdd7e4556b2bb62ef8d13a56a, user_id=89eb104e62ad404db779af3fb21f12b7, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:20.837542 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4149a33-09db-40cc-948d-811e4bce147b admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:20.909619 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1373/2745] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 20:08:20 2022] PUT /identity/v3/projects/ed079d4bdd7e4556b2bb62ef8d13a56a/users/89eb104e62ad404db779af3fb21f12b7/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 20:08:20.913878 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c30490c-80c0-4312-844f-dfd66042fe8a admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:20.927466 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c30490c-80c0-4312-844f-dfd66042fe8a admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:20.936223 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:08:20.993854 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b8417-3fba-454f-82e7-73cee99c592d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:20.994465 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b8417-3fba-454f-82e7-73cee99c592d admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:20.994748 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b8417-3fba-454f-82e7-73cee99c592d admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:20.995022 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b8417-3fba-454f-82e7-73cee99c592d admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:20.995670 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b8417-3fba-454f-82e7-73cee99c592d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:20.997255 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b8417-3fba-454f-82e7-73cee99c592d admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:21.007440 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1373/2746] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:08:20 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:08:21.011601 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4149a33-09db-40cc-948d-811e4bce147b admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:21.023363 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4149a33-09db-40cc-948d-811e4bce147b admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:21.028421 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7031721-9ebc-4965-95ec-bab416614ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:21.029085 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7031721-9ebc-4965-95ec-bab416614ebe admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:21.029359 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7031721-9ebc-4965-95ec-bab416614ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:21.029717 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7031721-9ebc-4965-95ec-bab416614ebe admin admin] PATH_INFO: `/v3/projects/ed079d4bdd7e4556b2bb62ef8d13a56a/users/89eb104e62ad404db779af3fb21f12b7/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:21.032273 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7031721-9ebc-4965-95ec-bab416614ebe admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed079d4bdd7e4556b2bb62ef8d13a56a, user_id=89eb104e62ad404db779af3fb21f12b7, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:21.035066 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7031721-9ebc-4965-95ec-bab416614ebe admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:21.046082 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1374/2747] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 20:08:21 2022] PUT /identity/v3/projects/ed079d4bdd7e4556b2bb62ef8d13a56a/users/89eb104e62ad404db779af3fb21f12b7/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:08:21.056900 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba06e2-3b8d-4abd-89b0-238c38f2c184 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:21.057212 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba06e2-3b8d-4abd-89b0-238c38f2c184 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:21.057536 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba06e2-3b8d-4abd-89b0-238c38f2c184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:21.091691 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-7aba06e2-3b8d-4abd-89b0-238c38f2c184 None None] MFA Rules not processed for user `89eb104e62ad404db779af3fb21f12b7`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:08:21.094393 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-7aba06e2-3b8d-4abd-89b0-238c38f2c184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:21.167692 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1374/2748] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:08:21 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:08:21.179264 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7031721-9ebc-4965-95ec-bab416614ebe admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:21.181021 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-a7031721-9ebc-4965-95ec-bab416614ebe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:21.240753 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7031721-9ebc-4965-95ec-bab416614ebe admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:21.244342 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ab32e-4fef-414f-b3b3-064873c5a8e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:21.244951 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ab32e-4fef-414f-b3b3-064873c5a8e7 service cinder] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:21.245225 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ab32e-4fef-414f-b3b3-064873c5a8e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:21.245527 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ab32e-4fef-414f-b3b3-064873c5a8e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:21.255409 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088ab32e-4fef-414f-b3b3-064873c5a8e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:21.256832 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088ab32e-4fef-414f-b3b3-064873c5a8e7 service cinder] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:21.260772 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:08:21.267582 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1375/2749] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:08:21 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:08:21.466484 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba06e2-3b8d-4abd-89b0-238c38f2c184 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:21.478000 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba06e2-3b8d-4abd-89b0-238c38f2c184 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:21.481690 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b877966f-6584-445a-a0b2-cdb3c25458fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:21.482383 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877966f-6584-445a-a0b2-cdb3c25458fd service cinder] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:21.482736 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877966f-6584-445a-a0b2-cdb3c25458fd service cinder] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:21.483241 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877966f-6584-445a-a0b2-cdb3c25458fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:21.541284 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b877966f-6584-445a-a0b2-cdb3c25458fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:21.542874 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b877966f-6584-445a-a0b2-cdb3c25458fd service cinder] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:21.553231 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1375/2750] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:08:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 20:08:22.074931 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ab32e-4fef-414f-b3b3-064873c5a8e7 service cinder] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:22.174916 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ab32e-4fef-414f-b3b3-064873c5a8e7 service cinder] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:22.179911 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f3e161-ae78-48e1-9ce8-b932993b52a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:22.180755 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3e161-ae78-48e1-9ce8-b932993b52a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:22.181062 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3e161-ae78-48e1-9ce8-b932993b52a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:22.181336 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3e161-ae78-48e1-9ce8-b932993b52a0 admin admin] PATH_INFO: `/v3/users/25c45d35b1db4b308d8728b65ec7690f` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:22.182631 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f3e161-ae78-48e1-9ce8-b932993b52a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25c45d35b1db4b308d8728b65ec7690f)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:22.184563 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f3e161-ae78-48e1-9ce8-b932993b52a0 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:22.356572 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-f8f3e161-ae78-48e1-9ce8-b932993b52a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25c45d35b1db4b308d8728b65ec7690f'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:22.434879 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-f8f3e161-ae78-48e1-9ce8-b932993b52a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25c45d35b1db4b308d8728b65ec7690f'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:22.434879 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-f8f3e161-ae78-48e1-9ce8-b932993b52a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25c45d35b1db4b308d8728b65ec7690f'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:22.435189 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b877966f-6584-445a-a0b2-cdb3c25458fd service cinder] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:22.435740 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-f8f3e161-ae78-48e1-9ce8-b932993b52a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25c45d35b1db4b308d8728b65ec7690f'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:22.436018 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-b877966f-6584-445a-a0b2-cdb3c25458fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:22.452427 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-f8f3e161-ae78-48e1-9ce8-b932993b52a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25c45d35b1db4b308d8728b65ec7690f'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:22.455961 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b877966f-6584-445a-a0b2-cdb3c25458fd service cinder] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:22.460846 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3249fd1b-158e-42fb-96dc-ca2912ee161d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:22.461850 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249fd1b-158e-42fb-96dc-ca2912ee161d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:22.462135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249fd1b-158e-42fb-96dc-ca2912ee161d admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:22.462406 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249fd1b-158e-42fb-96dc-ca2912ee161d admin admin] PATH_INFO: `/v3/users/f8bf9edbcb314286a4fc23f151062854` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:22.463603 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3249fd1b-158e-42fb-96dc-ca2912ee161d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8bf9edbcb314286a4fc23f151062854)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:22.465522 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3249fd1b-158e-42fb-96dc-ca2912ee161d admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:22.466096 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1376/2751] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 20:08:22 2022] DELETE /identity/v3/users/25c45d35b1db4b308d8728b65ec7690f => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:08:22.471043 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ce1b1-de9c-4277-ace3-fbd3f17d77f2 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:22.471409 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ce1b1-de9c-4277-ace3-fbd3f17d77f2 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:22.471737 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ce1b1-de9c-4277-ace3-fbd3f17d77f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:22.498222 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-920ce1b1-de9c-4277-ace3-fbd3f17d77f2 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:08:22.498222 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-920ce1b1-de9c-4277-ace3-fbd3f17d77f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:22.559930 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1377/2752] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:08:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 20:08:22.569334 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920ce1b1-de9c-4277-ace3-fbd3f17d77f2 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:22.570807 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-920ce1b1-de9c-4277-ace3-fbd3f17d77f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:22.577773 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:08:22.594561 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:08:22.632696 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920ce1b1-de9c-4277-ace3-fbd3f17d77f2 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:22.636391 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b3dcb3-f26d-4e54-aa30-b890f113e77b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:22.636992 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3dcb3-f26d-4e54-aa30-b890f113e77b service neutron] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:22.637267 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3dcb3-f26d-4e54-aa30-b890f113e77b service neutron] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:22.637565 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3dcb3-f26d-4e54-aa30-b890f113e77b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:22.647600 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b3dcb3-f26d-4e54-aa30-b890f113e77b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:22.649026 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b3dcb3-f26d-4e54-aa30-b890f113e77b service neutron] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:22.659668 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1378/2753] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:08:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 20:08:22.670998 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-3249fd1b-158e-42fb-96dc-ca2912ee161d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8bf9edbcb314286a4fc23f151062854'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:22.724425 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-3249fd1b-158e-42fb-96dc-ca2912ee161d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8bf9edbcb314286a4fc23f151062854'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:22.725164 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-3249fd1b-158e-42fb-96dc-ca2912ee161d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8bf9edbcb314286a4fc23f151062854'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:22.739398 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-3249fd1b-158e-42fb-96dc-ca2912ee161d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8bf9edbcb314286a4fc23f151062854'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:22.740157 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-3249fd1b-158e-42fb-96dc-ca2912ee161d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8bf9edbcb314286a4fc23f151062854'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:22.754174 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1376/2754] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 20:08:22 2022] DELETE /identity/v3/users/f8bf9edbcb314286a4fc23f151062854 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 20:08:23.086348 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b3dcb3-f26d-4e54-aa30-b890f113e77b service neutron] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:23.088080 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-71b3dcb3-f26d-4e54-aa30-b890f113e77b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:23.102192 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b3dcb3-f26d-4e54-aa30-b890f113e77b service neutron] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:23.121784 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3249fd1b-158e-42fb-96dc-ca2912ee161d admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:23.123295 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-3249fd1b-158e-42fb-96dc-ca2912ee161d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:23.177296 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc19f07-749a-482d-babc-198ed5ffd79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:23.177982 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc19f07-749a-482d-babc-198ed5ffd79e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:23.178265 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc19f07-749a-482d-babc-198ed5ffd79e admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:23.178535 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc19f07-749a-482d-babc-198ed5ffd79e admin admin] PATH_INFO: `/v3/projects/29e7e96d7d564d5ab2efdb93f5360951` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:23.179659 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc19f07-749a-482d-babc-198ed5ffd79e admin admin] RBAC: Authorizing `identity:delete_project(project_id=29e7e96d7d564d5ab2efdb93f5360951)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:23.181662 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc19f07-749a-482d-babc-198ed5ffd79e admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:23.196914 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3249fd1b-158e-42fb-96dc-ca2912ee161d admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:23.201704 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3de394-25b6-41d8-9345-2db47792d2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:23.202364 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3de394-25b6-41d8-9345-2db47792d2d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:23.202664 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3de394-25b6-41d8-9345-2db47792d2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:23.202929 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3de394-25b6-41d8-9345-2db47792d2d5 admin admin] PATH_INFO: `/v3/projects/eef403ec495f4ddc8bf02a1bc5e77e4c` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:23.204059 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3de394-25b6-41d8-9345-2db47792d2d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eef403ec495f4ddc8bf02a1bc5e77e4c)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:23.205984 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3de394-25b6-41d8-9345-2db47792d2d5 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:23.349283 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-6cc19f07-749a-482d-babc-198ed5ffd79e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29e7e96d7d564d5ab2efdb93f5360951', 'request_id': 'req-6cc19f07-749a-482d-babc-198ed5ffd79e'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:23.349623 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-0a3de394-25b6-41d8-9345-2db47792d2d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eef403ec495f4ddc8bf02a1bc5e77e4c', 'request_id': 'req-0a3de394-25b6-41d8-9345-2db47792d2d5'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:23.355886 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-6cc19f07-749a-482d-babc-198ed5ffd79e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29e7e96d7d564d5ab2efdb93f5360951', 'request_id': 'req-6cc19f07-749a-482d-babc-198ed5ffd79e'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:23.434065 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-0a3de394-25b6-41d8-9345-2db47792d2d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eef403ec495f4ddc8bf02a1bc5e77e4c', 'request_id': 'req-0a3de394-25b6-41d8-9345-2db47792d2d5'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:23.440522 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-0a3de394-25b6-41d8-9345-2db47792d2d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eef403ec495f4ddc8bf02a1bc5e77e4c', 'request_id': 'req-0a3de394-25b6-41d8-9345-2db47792d2d5'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:23.452253 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-0a3de394-25b6-41d8-9345-2db47792d2d5 admin admin] The token cache is being invalidate because project eef403ec495f4ddc8bf02a1bc5e77e4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 20:08:23.452535 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-0a3de394-25b6-41d8-9345-2db47792d2d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:23.453169 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-0a3de394-25b6-41d8-9345-2db47792d2d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:23.454691 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1377/2755] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 20:08:23 2022] DELETE /identity/v3/projects/eef403ec495f4ddc8bf02a1bc5e77e4c => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 20:08:23.458441 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3de394-25b6-41d8-9345-2db47792d2d5 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:23.459737 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-0a3de394-25b6-41d8-9345-2db47792d2d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:23.496632 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:08:23.527234 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3de394-25b6-41d8-9345-2db47792d2d5 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:23.559090 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-6cc19f07-749a-482d-babc-198ed5ffd79e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29e7e96d7d564d5ab2efdb93f5360951', 'request_id': 'req-6cc19f07-749a-482d-babc-198ed5ffd79e'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:23.570219 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-6cc19f07-749a-482d-babc-198ed5ffd79e admin admin] The token cache is being invalidate because project 29e7e96d7d564d5ab2efdb93f5360951 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 20:08:23.570561 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-6cc19f07-749a-482d-babc-198ed5ffd79e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:23.571573 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-6cc19f07-749a-482d-babc-198ed5ffd79e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:23.573063 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1379/2756] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 20:08:23 2022] DELETE /identity/v3/projects/29e7e96d7d564d5ab2efdb93f5360951 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:08:23.578030 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133074e0-70ce-43d6-9687-19821fde2527 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:23.578341 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133074e0-70ce-43d6-9687-19821fde2527 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:23.578740 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133074e0-70ce-43d6-9687-19821fde2527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:23.583014 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98cde38-15e4-4da3-92f0-93823545220c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:23.583644 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cde38-15e4-4da3-92f0-93823545220c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:23.583927 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cde38-15e4-4da3-92f0-93823545220c admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:23.584198 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cde38-15e4-4da3-92f0-93823545220c admin admin] PATH_INFO: `/v3/users/89eb104e62ad404db779af3fb21f12b7` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:23.585344 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98cde38-15e4-4da3-92f0-93823545220c admin admin] RBAC: Authorizing `identity:delete_user(user_id=89eb104e62ad404db779af3fb21f12b7)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:23.587262 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98cde38-15e4-4da3-92f0-93823545220c admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:23.598671 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-133074e0-70ce-43d6-9687-19821fde2527 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:08:23.599846 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-133074e0-70ce-43d6-9687-19821fde2527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:23.608540 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1380/2757] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:08:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 20:08:23.622743 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac8539-e9b6-4aa1-a2df-a270024a363c None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:23.623022 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac8539-e9b6-4aa1-a2df-a270024a363c None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:23.623316 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac8539-e9b6-4aa1-a2df-a270024a363c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:23.650845 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-69ac8539-e9b6-4aa1-a2df-a270024a363c None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:08:23.650845 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-69ac8539-e9b6-4aa1-a2df-a270024a363c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:23.651124 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1381/2758] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:08:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 20:08:23.655665 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac8539-e9b6-4aa1-a2df-a270024a363c None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:23.664951 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac8539-e9b6-4aa1-a2df-a270024a363c None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:23.669695 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e34677-1f62-48ec-adf2-01a79fac416f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:23.670984 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e34677-1f62-48ec-adf2-01a79fac416f admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:23.671329 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e34677-1f62-48ec-adf2-01a79fac416f admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:23.671601 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e34677-1f62-48ec-adf2-01a79fac416f admin admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:23.672207 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e34677-1f62-48ec-adf2-01a79fac416f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:08:23.672535 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e34677-1f62-48ec-adf2-01a79fac416f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:23.674290 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e34677-1f62-48ec-adf2-01a79fac416f admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:23.686253 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1382/2759] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 20:08:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:08:23.690881 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e34677-1f62-48ec-adf2-01a79fac416f admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:23.700980 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e34677-1f62-48ec-adf2-01a79fac416f admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:23.706199 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e91617-1eca-4357-99b4-66b72899b2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:23.706811 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e91617-1eca-4357-99b4-66b72899b2fa admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:23.707078 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e91617-1eca-4357-99b4-66b72899b2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:23.707352 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e91617-1eca-4357-99b4-66b72899b2fa admin admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:23.715024 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e91617-1eca-4357-99b4-66b72899b2fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:23.715024 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e91617-1eca-4357-99b4-66b72899b2fa admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:23.858631 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-e98cde38-15e4-4da3-92f0-93823545220c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89eb104e62ad404db779af3fb21f12b7'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:23.881028 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1383/2760] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 20:08:23 2022] POST /identity/v3/projects => generated 377 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 20:08:23.885347 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e91617-1eca-4357-99b4-66b72899b2fa admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:23.890042 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:08:23.947165 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e91617-1eca-4357-99b4-66b72899b2fa admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:23.947869 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-e98cde38-15e4-4da3-92f0-93823545220c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89eb104e62ad404db779af3fb21f12b7'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:23.948500 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-e98cde38-15e4-4da3-92f0-93823545220c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89eb104e62ad404db779af3fb21f12b7'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:23.952622 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14076c13-c2a7-436f-a845-e02e83923a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:23.957918 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14076c13-c2a7-436f-a845-e02e83923a75 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:23.957918 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14076c13-c2a7-436f-a845-e02e83923a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:23.957918 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14076c13-c2a7-436f-a845-e02e83923a75 admin admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:23.957918 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14076c13-c2a7-436f-a845-e02e83923a75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:23.957918 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14076c13-c2a7-436f-a845-e02e83923a75 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:23.962188 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-e98cde38-15e4-4da3-92f0-93823545220c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89eb104e62ad404db779af3fb21f12b7'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:23.962842 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-e98cde38-15e4-4da3-92f0-93823545220c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89eb104e62ad404db779af3fb21f12b7'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:23.976008 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1378/2761] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 20:08:23 2022] DELETE /identity/v3/users/89eb104e62ad404db779af3fb21f12b7 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 20:08:24.114294 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1384/2762] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 20:08:23 2022] POST /identity/v3/users => generated 289 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 20:08:24.118491 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98cde38-15e4-4da3-92f0-93823545220c admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:24.119921 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-e98cde38-15e4-4da3-92f0-93823545220c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:24.198729 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98cde38-15e4-4da3-92f0-93823545220c admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:24.198729 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc5b4bd-78e1-49da-963d-fbd60dd0d711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:24.198729 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5b4bd-78e1-49da-963d-fbd60dd0d711 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:24.198729 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5b4bd-78e1-49da-963d-fbd60dd0d711 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:24.199452 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5b4bd-78e1-49da-963d-fbd60dd0d711 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:24.199452 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc5b4bd-78e1-49da-963d-fbd60dd0d711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:24.201058 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc5b4bd-78e1-49da-963d-fbd60dd0d711 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:24.203128 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:08:24.212669 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1379/2763] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:08:24 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 20:08:24.216728 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14076c13-c2a7-436f-a845-e02e83923a75 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:24.227205 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14076c13-c2a7-436f-a845-e02e83923a75 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:24.231735 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad7675-47c5-425b-912c-cdbcd8d9a1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:24.232336 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad7675-47c5-425b-912c-cdbcd8d9a1bb admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:24.232844 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad7675-47c5-425b-912c-cdbcd8d9a1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:24.233250 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad7675-47c5-425b-912c-cdbcd8d9a1bb admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:24.234036 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ad7675-47c5-425b-912c-cdbcd8d9a1bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:24.235623 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ad7675-47c5-425b-912c-cdbcd8d9a1bb admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:24.246810 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1385/2764] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:08:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:08:24.251079 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc5b4bd-78e1-49da-963d-fbd60dd0d711 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:24.261078 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc5b4bd-78e1-49da-963d-fbd60dd0d711 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:24.266278 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00c9ff-dd61-4290-89c5-53fb9c564c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:24.266932 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00c9ff-dd61-4290-89c5-53fb9c564c5c admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:24.267207 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00c9ff-dd61-4290-89c5-53fb9c564c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:24.267477 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00c9ff-dd61-4290-89c5-53fb9c564c5c admin admin] PATH_INFO: `/v3/projects/699d61b24fd64c5da6533360c0be48eb/users/b64d52c25ee04eb1a8509faf716f2f55/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:24.284819 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e00c9ff-dd61-4290-89c5-53fb9c564c5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=699d61b24fd64c5da6533360c0be48eb, user_id=b64d52c25ee04eb1a8509faf716f2f55, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:24.287707 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e00c9ff-dd61-4290-89c5-53fb9c564c5c admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:24.393088 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1380/2765] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 20:08:24 2022] PUT /identity/v3/projects/699d61b24fd64c5da6533360c0be48eb/users/b64d52c25ee04eb1a8509faf716f2f55/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:08:24.398258 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fad36a-19d9-4b7e-b6c9-70bf91ccc21e None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:24.398546 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fad36a-19d9-4b7e-b6c9-70bf91ccc21e None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:24.398819 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fad36a-19d9-4b7e-b6c9-70bf91ccc21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:24.418074 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-c2fad36a-19d9-4b7e-b6c9-70bf91ccc21e None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:08:24.419285 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-c2fad36a-19d9-4b7e-b6c9-70bf91ccc21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:24.430991 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00c9ff-dd61-4290-89c5-53fb9c564c5c admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:24.433895 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-3e00c9ff-dd61-4290-89c5-53fb9c564c5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:24.505998 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1386/2766] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:08:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:08:24.515237 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00c9ff-dd61-4290-89c5-53fb9c564c5c admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:24.516294 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fad36a-19d9-4b7e-b6c9-70bf91ccc21e None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:24.517591 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-c2fad36a-19d9-4b7e-b6c9-70bf91ccc21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:24.520656 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b385ae56-8fcf-45a0-89b8-ad5a86ee84ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:24.521287 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385ae56-8fcf-45a0-89b8-ad5a86ee84ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:24.521596 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385ae56-8fcf-45a0-89b8-ad5a86ee84ec admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:24.521872 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385ae56-8fcf-45a0-89b8-ad5a86ee84ec admin admin] PATH_INFO: `/v3/projects/ed079d4bdd7e4556b2bb62ef8d13a56a` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:24.522987 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b385ae56-8fcf-45a0-89b8-ad5a86ee84ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed079d4bdd7e4556b2bb62ef8d13a56a)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:24.524886 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b385ae56-8fcf-45a0-89b8-ad5a86ee84ec admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:24.575966 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fad36a-19d9-4b7e-b6c9-70bf91ccc21e None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:24.580627 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa3eb50-cb71-40b1-b690-21cb9c8047a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:24.581236 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3eb50-cb71-40b1-b690-21cb9c8047a5 service neutron] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:24.581539 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3eb50-cb71-40b1-b690-21cb9c8047a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:24.581818 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3eb50-cb71-40b1-b690-21cb9c8047a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:24.590932 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa3eb50-cb71-40b1-b690-21cb9c8047a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:24.593576 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa3eb50-cb71-40b1-b690-21cb9c8047a5 service neutron] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:24.603047 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1387/2767] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:08:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:08:24.646186 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-b385ae56-8fcf-45a0-89b8-ad5a86ee84ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed079d4bdd7e4556b2bb62ef8d13a56a', 'request_id': 'req-b385ae56-8fcf-45a0-89b8-ad5a86ee84ec'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:24.715456 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-b385ae56-8fcf-45a0-89b8-ad5a86ee84ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed079d4bdd7e4556b2bb62ef8d13a56a', 'request_id': 'req-b385ae56-8fcf-45a0-89b8-ad5a86ee84ec'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:24.723135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-b385ae56-8fcf-45a0-89b8-ad5a86ee84ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed079d4bdd7e4556b2bb62ef8d13a56a', 'request_id': 'req-b385ae56-8fcf-45a0-89b8-ad5a86ee84ec'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:24.735654 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-b385ae56-8fcf-45a0-89b8-ad5a86ee84ec admin admin] The token cache is being invalidate because project ed079d4bdd7e4556b2bb62ef8d13a56a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 20:08:24.736037 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-b385ae56-8fcf-45a0-89b8-ad5a86ee84ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:24.736786 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-b385ae56-8fcf-45a0-89b8-ad5a86ee84ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:24.738420 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1381/2768] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 20:08:24 2022] DELETE /identity/v3/projects/ed079d4bdd7e4556b2bb62ef8d13a56a => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:08:24.743287 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d53ae-bf49-4fca-a5c8-934f748ceb30 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:24.743750 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d53ae-bf49-4fca-a5c8-934f748ceb30 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:24.744111 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d53ae-bf49-4fca-a5c8-934f748ceb30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:24.768986 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-4e9d53ae-bf49-4fca-a5c8-934f748ceb30 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:08:24.771141 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-4e9d53ae-bf49-4fca-a5c8-934f748ceb30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:24.793994 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:08:24.834324 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1388/2769] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:08:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:08:24.842785 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75448a95-825e-411b-9349-97b47349f96c None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:24.843070 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75448a95-825e-411b-9349-97b47349f96c None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:24.843374 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75448a95-825e-411b-9349-97b47349f96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:24.862898 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-75448a95-825e-411b-9349-97b47349f96c None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:08:24.864090 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-75448a95-825e-411b-9349-97b47349f96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:24.871986 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1382/2770] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:08:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:08:24.876268 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d53ae-bf49-4fca-a5c8-934f748ceb30 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:24.885993 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d53ae-bf49-4fca-a5c8-934f748ceb30 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:24.891358 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c91c9-0ff9-43b7-91fb-87de8cd3c961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:24.892189 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c91c9-0ff9-43b7-91fb-87de8cd3c961 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:24.893043 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c91c9-0ff9-43b7-91fb-87de8cd3c961 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:24.893871 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c91c9-0ff9-43b7-91fb-87de8cd3c961 admin admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:24.894185 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461c91c9-0ff9-43b7-91fb-87de8cd3c961 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:08:24.894487 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461c91c9-0ff9-43b7-91fb-87de8cd3c961 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:24.896079 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461c91c9-0ff9-43b7-91fb-87de8cd3c961 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:24.908621 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1389/2771] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 20:08:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:08:24.912886 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75448a95-825e-411b-9349-97b47349f96c None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:24.922347 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75448a95-825e-411b-9349-97b47349f96c None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:24.927099 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379762f2-b68f-4076-88d3-1a49492e9e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:24.928028 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379762f2-b68f-4076-88d3-1a49492e9e05 admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:24.928322 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379762f2-b68f-4076-88d3-1a49492e9e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:24.928596 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379762f2-b68f-4076-88d3-1a49492e9e05 admin admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:24.929242 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379762f2-b68f-4076-88d3-1a49492e9e05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:24.931178 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379762f2-b68f-4076-88d3-1a49492e9e05 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:25.107702 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1383/2772] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 20:08:24 2022] POST /identity/v3/projects => generated 385 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:08:25.109023 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c91c9-0ff9-43b7-91fb-87de8cd3c961 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:25.119534 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c91c9-0ff9-43b7-91fb-87de8cd3c961 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:25.189257 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3fee8-69ca-49d8-a521-d2fcede11923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:25.189915 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3fee8-69ca-49d8-a521-d2fcede11923 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:25.190200 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3fee8-69ca-49d8-a521-d2fcede11923 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:25.190661 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3fee8-69ca-49d8-a521-d2fcede11923 admin admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:25.191301 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d3fee8-69ca-49d8-a521-d2fcede11923 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:25.193364 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d3fee8-69ca-49d8-a521-d2fcede11923 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:25.268741 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1390/2773] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 20:08:25 2022] POST /identity/v3/users => generated 293 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:08:25.273514 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379762f2-b68f-4076-88d3-1a49492e9e05 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:25.284503 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379762f2-b68f-4076-88d3-1a49492e9e05 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:25.289430 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55c27a-f4d3-4c6e-be0b-86bd74fc9894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:25.290086 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55c27a-f4d3-4c6e-be0b-86bd74fc9894 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:25.290365 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55c27a-f4d3-4c6e-be0b-86bd74fc9894 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:25.290638 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55c27a-f4d3-4c6e-be0b-86bd74fc9894 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:25.291287 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c55c27a-f4d3-4c6e-be0b-86bd74fc9894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:25.292889 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c55c27a-f4d3-4c6e-be0b-86bd74fc9894 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:25.307833 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1384/2774] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:08:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:08:25.309324 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3fee8-69ca-49d8-a521-d2fcede11923 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:25.320679 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3fee8-69ca-49d8-a521-d2fcede11923 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:25.325611 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85c950-12c6-47f6-ae86-e0f99c2f00b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:25.326223 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85c950-12c6-47f6-ae86-e0f99c2f00b4 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:25.326715 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85c950-12c6-47f6-ae86-e0f99c2f00b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:25.326990 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85c950-12c6-47f6-ae86-e0f99c2f00b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:25.327792 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff85c950-12c6-47f6-ae86-e0f99c2f00b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:25.329404 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff85c950-12c6-47f6-ae86-e0f99c2f00b4 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:25.340827 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1391/2775] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:08:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:08:25.345146 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55c27a-f4d3-4c6e-be0b-86bd74fc9894 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:25.355461 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55c27a-f4d3-4c6e-be0b-86bd74fc9894 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:25.361071 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a726292-334f-4d45-b1d8-db4a5b71a99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:25.361763 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a726292-334f-4d45-b1d8-db4a5b71a99f admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:25.362042 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a726292-334f-4d45-b1d8-db4a5b71a99f admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:25.362347 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a726292-334f-4d45-b1d8-db4a5b71a99f admin admin] PATH_INFO: `/v3/projects/6a46469f94414363918d1b4f1584b6ad/users/6d161df2d60a446a90b21539e5bed75b/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:25.379471 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a726292-334f-4d45-b1d8-db4a5b71a99f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a46469f94414363918d1b4f1584b6ad, user_id=6d161df2d60a446a90b21539e5bed75b, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:25.382280 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a726292-334f-4d45-b1d8-db4a5b71a99f admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:25.473782 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:08:25.479853 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1385/2776] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 20:08:25 2022] PUT /identity/v3/projects/6a46469f94414363918d1b4f1584b6ad/users/6d161df2d60a446a90b21539e5bed75b/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:08:25.490318 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea2b77-5aec-4bf4-bfa2-ca38ba37e1e8 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:25.490665 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea2b77-5aec-4bf4-bfa2-ca38ba37e1e8 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:25.490938 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea2b77-5aec-4bf4-bfa2-ca38ba37e1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:25.524385 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-5cea2b77-5aec-4bf4-bfa2-ca38ba37e1e8 None None] MFA Rules not processed for user `6d161df2d60a446a90b21539e5bed75b`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:08:25.525599 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-5cea2b77-5aec-4bf4-bfa2-ca38ba37e1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:25.592623 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1392/2777] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:08:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:08:25.598899 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a726292-334f-4d45-b1d8-db4a5b71a99f admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:25.663027 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a726292-334f-4d45-b1d8-db4a5b71a99f admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:25.668380 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7236ad0f-acb5-49d4-8d0a-ad749f60e284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:25.668998 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236ad0f-acb5-49d4-8d0a-ad749f60e284 admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:25.669281 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236ad0f-acb5-49d4-8d0a-ad749f60e284 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:25.669578 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236ad0f-acb5-49d4-8d0a-ad749f60e284 admin admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:25.670311 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7236ad0f-acb5-49d4-8d0a-ad749f60e284 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:25.673370 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7236ad0f-acb5-49d4-8d0a-ad749f60e284 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:25.748816 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1386/2778] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 20:08:25 2022] POST /identity/v3/projects => generated 385 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:08:25.753461 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea2b77-5aec-4bf4-bfa2-ca38ba37e1e8 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:25.764234 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea2b77-5aec-4bf4-bfa2-ca38ba37e1e8 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:25.781403 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:08:25.821709 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8cf30a-1ec0-486a-a720-bab4f554eff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:25.822335 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8cf30a-1ec0-486a-a720-bab4f554eff0 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:25.822978 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8cf30a-1ec0-486a-a720-bab4f554eff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:25.823330 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8cf30a-1ec0-486a-a720-bab4f554eff0 admin admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:25.823958 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8cf30a-1ec0-486a-a720-bab4f554eff0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:25.825914 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8cf30a-1ec0-486a-a720-bab4f554eff0 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:25.926486 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1393/2779] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 20:08:25 2022] POST /identity/v3/users => generated 299 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:08:25.930510 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7236ad0f-acb5-49d4-8d0a-ad749f60e284 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:25.941437 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7236ad0f-acb5-49d4-8d0a-ad749f60e284 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:25.946414 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2193b8d-1bed-416b-be48-560dc475d088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:25.947112 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2193b8d-1bed-416b-be48-560dc475d088 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:25.947395 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2193b8d-1bed-416b-be48-560dc475d088 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:25.947670 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2193b8d-1bed-416b-be48-560dc475d088 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:25.948308 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2193b8d-1bed-416b-be48-560dc475d088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:25.949925 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2193b8d-1bed-416b-be48-560dc475d088 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:25.961041 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1387/2780] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:08:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:08:25.965268 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8cf30a-1ec0-486a-a720-bab4f554eff0 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:25.976267 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8cf30a-1ec0-486a-a720-bab4f554eff0 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:25.981068 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f789a1-bbbd-4fb4-b817-05aeea92f082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:25.981779 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f789a1-bbbd-4fb4-b817-05aeea92f082 admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:25.982061 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f789a1-bbbd-4fb4-b817-05aeea92f082 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:25.982333 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f789a1-bbbd-4fb4-b817-05aeea92f082 admin admin] PATH_INFO: `/v3/projects/5ecc398786784088a8786078e536c3f1/users/3f6d523cf7ae4d14873fbfe03fa16030/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:25.997831 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f789a1-bbbd-4fb4-b817-05aeea92f082 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ecc398786784088a8786078e536c3f1, user_id=3f6d523cf7ae4d14873fbfe03fa16030, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:26.000625 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f789a1-bbbd-4fb4-b817-05aeea92f082 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:26.063613 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1394/2781] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 20:08:25 2022] PUT /identity/v3/projects/5ecc398786784088a8786078e536c3f1/users/3f6d523cf7ae4d14873fbfe03fa16030/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:08:26.067659 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2193b8d-1bed-416b-be48-560dc475d088 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:26.078908 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2193b8d-1bed-416b-be48-560dc475d088 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:26.143376 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcede6f-e10c-475f-b811-041e743ed77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:26.144091 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcede6f-e10c-475f-b811-041e743ed77a admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:26.144377 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcede6f-e10c-475f-b811-041e743ed77a admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:26.144652 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcede6f-e10c-475f-b811-041e743ed77a admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:26.145300 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcede6f-e10c-475f-b811-041e743ed77a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:26.147224 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcede6f-e10c-475f-b811-041e743ed77a admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:26.159300 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1388/2782] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:08:26 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:08:26.163565 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f789a1-bbbd-4fb4-b817-05aeea92f082 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:26.174862 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f789a1-bbbd-4fb4-b817-05aeea92f082 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:26.179794 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa184f11-f05f-4a30-b6e9-17f41018b96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:26.180576 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa184f11-f05f-4a30-b6e9-17f41018b96b admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:26.180856 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa184f11-f05f-4a30-b6e9-17f41018b96b admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:26.181121 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa184f11-f05f-4a30-b6e9-17f41018b96b admin admin] PATH_INFO: `/v3/projects/5ecc398786784088a8786078e536c3f1/users/3f6d523cf7ae4d14873fbfe03fa16030/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:26.183182 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa184f11-f05f-4a30-b6e9-17f41018b96b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ecc398786784088a8786078e536c3f1, user_id=3f6d523cf7ae4d14873fbfe03fa16030, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:26.186644 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa184f11-f05f-4a30-b6e9-17f41018b96b admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:26.199614 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1395/2783] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 20:08:26 2022] PUT /identity/v3/projects/5ecc398786784088a8786078e536c3f1/users/3f6d523cf7ae4d14873fbfe03fa16030/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:08:26.272204 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb05c6-bc0e-46b0-aeba-8401bfabf999 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:26.272492 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb05c6-bc0e-46b0-aeba-8401bfabf999 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:26.272765 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb05c6-bc0e-46b0-aeba-8401bfabf999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:26.303464 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-f1eb05c6-bc0e-46b0-aeba-8401bfabf999 None None] MFA Rules not processed for user `3f6d523cf7ae4d14873fbfe03fa16030`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:08:26.304685 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-f1eb05c6-bc0e-46b0-aeba-8401bfabf999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:26.370096 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:08:26.381258 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1389/2784] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:08:26 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:08:26.393042 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa184f11-f05f-4a30-b6e9-17f41018b96b admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:26.395087 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-fa184f11-f05f-4a30-b6e9-17f41018b96b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:26.462333 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa184f11-f05f-4a30-b6e9-17f41018b96b admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:26.470510 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1bf687-cdda-43e9-8158-a7ec2f1a597e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:26.471165 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1bf687-cdda-43e9-8158-a7ec2f1a597e service cinder] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:26.471447 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1bf687-cdda-43e9-8158-a7ec2f1a597e service cinder] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:26.471720 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1bf687-cdda-43e9-8158-a7ec2f1a597e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:26.536207 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1bf687-cdda-43e9-8158-a7ec2f1a597e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:26.537690 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1bf687-cdda-43e9-8158-a7ec2f1a597e service cinder] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:26.547872 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1396/2785] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:08:26 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 20:08:30.178497 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbf358-042c-4029-a715-b8db98a47432 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:30.179020 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbf358-042c-4029-a715-b8db98a47432 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:30.179020 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbf358-042c-4029-a715-b8db98a47432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:30.228839 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-12fbf358-042c-4029-a715-b8db98a47432 None None] MFA Rules not processed for user `b64d52c25ee04eb1a8509faf716f2f55`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:08:30.230152 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-12fbf358-042c-4029-a715-b8db98a47432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:30.315206 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1390/2786] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:08:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:08:30.334287 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1bf687-cdda-43e9-8158-a7ec2f1a597e service cinder] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:30.336309 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-9e1bf687-cdda-43e9-8158-a7ec2f1a597e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:30.372434 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:08:30.422964 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1bf687-cdda-43e9-8158-a7ec2f1a597e service cinder] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:30.428698 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f337dc-68c9-4d9a-8bf9-8af1e54ccc42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5047a59bc4547be643ffa78808a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:30.429311 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f337dc-68c9-4d9a-8bf9-8af1e54ccc42 service nova] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:30.429624 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f337dc-68c9-4d9a-8bf9-8af1e54ccc42 service nova] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:30.429897 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f337dc-68c9-4d9a-8bf9-8af1e54ccc42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:30.438513 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f337dc-68c9-4d9a-8bf9-8af1e54ccc42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:30.440128 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f337dc-68c9-4d9a-8bf9-8af1e54ccc42 service nova] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:30.450360 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1397/2787] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:08:30 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:08:32.085639 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fbf358-042c-4029-a715-b8db98a47432 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:32.087135 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-12fbf358-042c-4029-a715-b8db98a47432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:32.101322 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fbf358-042c-4029-a715-b8db98a47432 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:32.105176 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c005933-a280-415a-a453-c6079ed24c10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:32.105962 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c005933-a280-415a-a453-c6079ed24c10 service cinder] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:32.106346 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c005933-a280-415a-a453-c6079ed24c10 service cinder] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:32.106890 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c005933-a280-415a-a453-c6079ed24c10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:32.117488 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c005933-a280-415a-a453-c6079ed24c10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:32.119131 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c005933-a280-415a-a453-c6079ed24c10 service cinder] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:32.131402 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1391/2788] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:08:32 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:08:33.082163 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35088e-5b8e-4700-8f1c-006725f8a871 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:33.082749 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35088e-5b8e-4700-8f1c-006725f8a871 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:33.082749 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35088e-5b8e-4700-8f1c-006725f8a871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:33.106757 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-2f35088e-5b8e-4700-8f1c-006725f8a871 None None] MFA Rules not processed for user `b64d52c25ee04eb1a8509faf716f2f55`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:08:33.108522 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-2f35088e-5b8e-4700-8f1c-006725f8a871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:33.115907 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1398/2789] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:08:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:08:38.106764 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c005933-a280-415a-a453-c6079ed24c10 service cinder] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:38.168567 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c005933-a280-415a-a453-c6079ed24c10 service cinder] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:38.173936 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4068a38-0d1c-4765-b486-de50f5b22851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:38.174612 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4068a38-0d1c-4765-b486-de50f5b22851 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:38.174901 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4068a38-0d1c-4765-b486-de50f5b22851 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:38.175176 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4068a38-0d1c-4765-b486-de50f5b22851 admin admin] PATH_INFO: `/v3/users/6d161df2d60a446a90b21539e5bed75b` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:38.176399 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4068a38-0d1c-4765-b486-de50f5b22851 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d161df2d60a446a90b21539e5bed75b)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:38.178530 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4068a38-0d1c-4765-b486-de50f5b22851 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:38.179845 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35088e-5b8e-4700-8f1c-006725f8a871 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:38.197481 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35088e-5b8e-4700-8f1c-006725f8a871 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:38.203840 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96731911-9b61-48f1-8564-a6a491eaaeb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5047a59bc4547be643ffa78808a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:38.204577 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96731911-9b61-48f1-8564-a6a491eaaeb7 service nova] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:38.204957 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96731911-9b61-48f1-8564-a6a491eaaeb7 service nova] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:38.205321 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96731911-9b61-48f1-8564-a6a491eaaeb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:38.207660 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-96731911-9b61-48f1-8564-a6a491eaaeb7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:38.220521 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96731911-9b61-48f1-8564-a6a491eaaeb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:38.222459 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96731911-9b61-48f1-8564-a6a491eaaeb7 service nova] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:38.234324 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1399/2790] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:08:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:08:38.375016 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-f4068a38-0d1c-4765-b486-de50f5b22851 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d161df2d60a446a90b21539e5bed75b'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:38.433591 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-f4068a38-0d1c-4765-b486-de50f5b22851 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d161df2d60a446a90b21539e5bed75b'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:38.434512 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-f4068a38-0d1c-4765-b486-de50f5b22851 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d161df2d60a446a90b21539e5bed75b'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:38.450765 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-f4068a38-0d1c-4765-b486-de50f5b22851 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d161df2d60a446a90b21539e5bed75b'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:38.451679 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-f4068a38-0d1c-4765-b486-de50f5b22851 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d161df2d60a446a90b21539e5bed75b'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:38.453374 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:08:38.467471 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1392/2791] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 20:08:38 2022] DELETE /identity/v3/users/6d161df2d60a446a90b21539e5bed75b => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:08:38.472585 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7c173-51e5-4fdd-9bc9-6336105387ab None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:38.473119 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7c173-51e5-4fdd-9bc9-6336105387ab None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:38.473390 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7c173-51e5-4fdd-9bc9-6336105387ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:38.493645 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-dcb7c173-51e5-4fdd-9bc9-6336105387ab None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:08:38.494906 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-dcb7c173-51e5-4fdd-9bc9-6336105387ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:38.568113 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1400/2792] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:08:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:08:38.579702 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4068a38-0d1c-4765-b486-de50f5b22851 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:38.581195 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-f4068a38-0d1c-4765-b486-de50f5b22851 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:38.643745 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4068a38-0d1c-4765-b486-de50f5b22851 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:38.647549 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2bacc6-25ae-4bf1-bd24-c312d6cd7403 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:38.648221 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2bacc6-25ae-4bf1-bd24-c312d6cd7403 service neutron] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:38.648498 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2bacc6-25ae-4bf1-bd24-c312d6cd7403 service neutron] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:38.648870 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2bacc6-25ae-4bf1-bd24-c312d6cd7403 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:38.661771 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2bacc6-25ae-4bf1-bd24-c312d6cd7403 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:38.663191 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2bacc6-25ae-4bf1-bd24-c312d6cd7403 service neutron] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:38.682860 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1393/2793] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:08:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:08:39.132313 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb7c173-51e5-4fdd-9bc9-6336105387ab None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:39.133777 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-dcb7c173-51e5-4fdd-9bc9-6336105387ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:39.148625 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb7c173-51e5-4fdd-9bc9-6336105387ab None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:39.153858 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c13e219-f894-4899-8bb3-e37b6c495c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:39.154492 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13e219-f894-4899-8bb3-e37b6c495c38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:39.154774 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13e219-f894-4899-8bb3-e37b6c495c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:39.155024 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13e219-f894-4899-8bb3-e37b6c495c38 admin admin] PATH_INFO: `/v3/projects/6a46469f94414363918d1b4f1584b6ad` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:39.156598 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c13e219-f894-4899-8bb3-e37b6c495c38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a46469f94414363918d1b4f1584b6ad)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:39.160830 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c13e219-f894-4899-8bb3-e37b6c495c38 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:39.239208 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-6c13e219-f894-4899-8bb3-e37b6c495c38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a46469f94414363918d1b4f1584b6ad', 'request_id': 'req-6c13e219-f894-4899-8bb3-e37b6c495c38'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:39.245384 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-6c13e219-f894-4899-8bb3-e37b6c495c38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a46469f94414363918d1b4f1584b6ad', 'request_id': 'req-6c13e219-f894-4899-8bb3-e37b6c495c38'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:39.296101 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-6c13e219-f894-4899-8bb3-e37b6c495c38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a46469f94414363918d1b4f1584b6ad', 'request_id': 'req-6c13e219-f894-4899-8bb3-e37b6c495c38'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:39.307163 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-6c13e219-f894-4899-8bb3-e37b6c495c38 admin admin] The token cache is being invalidate because project 6a46469f94414363918d1b4f1584b6ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 20:08:39.307453 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-6c13e219-f894-4899-8bb3-e37b6c495c38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:39.308127 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-6c13e219-f894-4899-8bb3-e37b6c495c38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:39.309759 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1401/2794] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 20:08:39 2022] DELETE /identity/v3/projects/6a46469f94414363918d1b4f1584b6ad => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 20:08:39.314423 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2bacc6-25ae-4bf1-bd24-c312d6cd7403 service neutron] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:39.324301 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2bacc6-25ae-4bf1-bd24-c312d6cd7403 service neutron] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:39.382250 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b7c2e-b0dc-4da0-ba8b-a956b744afdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:39.383137 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b7c2e-b0dc-4da0-ba8b-a956b744afdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:39.383437 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b7c2e-b0dc-4da0-ba8b-a956b744afdb admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:39.383720 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b7c2e-b0dc-4da0-ba8b-a956b744afdb admin admin] PATH_INFO: `/v3/users/3f6d523cf7ae4d14873fbfe03fa16030` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:39.384893 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83b7c2e-b0dc-4da0-ba8b-a956b744afdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f6d523cf7ae4d14873fbfe03fa16030)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:39.386801 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83b7c2e-b0dc-4da0-ba8b-a956b744afdb admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:39.573312 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-e83b7c2e-b0dc-4da0-ba8b-a956b744afdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f6d523cf7ae4d14873fbfe03fa16030'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:39.627820 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-e83b7c2e-b0dc-4da0-ba8b-a956b744afdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f6d523cf7ae4d14873fbfe03fa16030'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:39.628530 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-e83b7c2e-b0dc-4da0-ba8b-a956b744afdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f6d523cf7ae4d14873fbfe03fa16030'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:39.641783 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-e83b7c2e-b0dc-4da0-ba8b-a956b744afdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f6d523cf7ae4d14873fbfe03fa16030'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:39.642348 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-e83b7c2e-b0dc-4da0-ba8b-a956b744afdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f6d523cf7ae4d14873fbfe03fa16030'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:39.654742 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1394/2795] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 20:08:39 2022] DELETE /identity/v3/users/3f6d523cf7ae4d14873fbfe03fa16030 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:08:40.179011 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c13e219-f894-4899-8bb3-e37b6c495c38 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:40.180510 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-6c13e219-f894-4899-8bb3-e37b6c495c38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:40.194647 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c13e219-f894-4899-8bb3-e37b6c495c38 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:40.207077 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:08:40.251907 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4aac47-368a-4732-b211-a19dbbd3b52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:40.252584 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4aac47-368a-4732-b211-a19dbbd3b52b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:40.252796 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4aac47-368a-4732-b211-a19dbbd3b52b admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:40.253066 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4aac47-368a-4732-b211-a19dbbd3b52b admin admin] PATH_INFO: `/v3/projects/5ecc398786784088a8786078e536c3f1` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:40.254193 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4aac47-368a-4732-b211-a19dbbd3b52b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ecc398786784088a8786078e536c3f1)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:40.256154 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4aac47-368a-4732-b211-a19dbbd3b52b admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:40.354100 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-da4aac47-368a-4732-b211-a19dbbd3b52b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ecc398786784088a8786078e536c3f1', 'request_id': 'req-da4aac47-368a-4732-b211-a19dbbd3b52b'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:40.360468 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-da4aac47-368a-4732-b211-a19dbbd3b52b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ecc398786784088a8786078e536c3f1', 'request_id': 'req-da4aac47-368a-4732-b211-a19dbbd3b52b'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:40.456236 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-da4aac47-368a-4732-b211-a19dbbd3b52b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ecc398786784088a8786078e536c3f1', 'request_id': 'req-da4aac47-368a-4732-b211-a19dbbd3b52b'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:40.468770 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-da4aac47-368a-4732-b211-a19dbbd3b52b admin admin] The token cache is being invalidate because project 5ecc398786784088a8786078e536c3f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 20:08:40.469063 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-da4aac47-368a-4732-b211-a19dbbd3b52b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:40.469744 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-da4aac47-368a-4732-b211-a19dbbd3b52b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:40.471229 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1402/2796] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 20:08:40 2022] DELETE /identity/v3/projects/5ecc398786784088a8786078e536c3f1 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:08:40.477101 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ac252-d8af-496c-91be-7ca97410d55c None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:40.477692 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ac252-d8af-496c-91be-7ca97410d55c None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:40.477692 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ac252-d8af-496c-91be-7ca97410d55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:40.497165 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-361ac252-d8af-496c-91be-7ca97410d55c None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:08:40.498392 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-361ac252-d8af-496c-91be-7ca97410d55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:40.503815 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:08:40.558188 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1395/2797] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:08:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:08:40.566469 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a1cad-858f-45b0-88ce-af64a063b9ca None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:40.566754 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a1cad-858f-45b0-88ce-af64a063b9ca None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:40.567029 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a1cad-858f-45b0-88ce-af64a063b9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:40.587427 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-fc2a1cad-858f-45b0-88ce-af64a063b9ca None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:08:40.588627 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-fc2a1cad-858f-45b0-88ce-af64a063b9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:40.597284 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1403/2798] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:08:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:08:40.601414 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ac252-d8af-496c-91be-7ca97410d55c None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:40.613272 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ac252-d8af-496c-91be-7ca97410d55c None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:40.618060 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3131204b-9718-493a-b779-4f6be9777713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:40.618652 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131204b-9718-493a-b779-4f6be9777713 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:40.618934 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131204b-9718-493a-b779-4f6be9777713 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:40.619258 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131204b-9718-493a-b779-4f6be9777713 admin admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:40.619897 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3131204b-9718-493a-b779-4f6be9777713 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:08:40.620197 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3131204b-9718-493a-b779-4f6be9777713 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:40.621803 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3131204b-9718-493a-b779-4f6be9777713 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:40.634178 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1396/2799] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 20:08:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:08:40.638760 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a1cad-858f-45b0-88ce-af64a063b9ca None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:40.648548 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a1cad-858f-45b0-88ce-af64a063b9ca None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:40.653149 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075603bc-03f3-4e5c-951a-894041df71f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:40.653805 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075603bc-03f3-4e5c-951a-894041df71f1 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:40.654070 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075603bc-03f3-4e5c-951a-894041df71f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:40.654337 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075603bc-03f3-4e5c-951a-894041df71f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:40.654958 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075603bc-03f3-4e5c-951a-894041df71f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:40.656875 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075603bc-03f3-4e5c-951a-894041df71f1 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:40.756111 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1404/2800] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 20:08:40 2022] POST /identity/v3/projects => generated 383 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:08:40.760586 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3131204b-9718-493a-b779-4f6be9777713 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:40.772038 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3131204b-9718-493a-b779-4f6be9777713 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:40.834010 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead2d12e-403a-458f-be6b-f17c30a05c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:40.834625 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2d12e-403a-458f-be6b-f17c30a05c4a admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:40.834907 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2d12e-403a-458f-be6b-f17c30a05c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:40.835204 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2d12e-403a-458f-be6b-f17c30a05c4a admin admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:40.835848 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead2d12e-403a-458f-be6b-f17c30a05c4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:40.837773 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead2d12e-403a-458f-be6b-f17c30a05c4a admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:40.919311 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1397/2801] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 20:08:40 2022] POST /identity/v3/users => generated 292 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:08:40.922733 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075603bc-03f3-4e5c-951a-894041df71f1 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:40.933063 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075603bc-03f3-4e5c-951a-894041df71f1 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:40.938802 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb4c85-3735-4e11-9dd6-2b0181e9c8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:40.939442 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb4c85-3735-4e11-9dd6-2b0181e9c8a1 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:40.939714 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb4c85-3735-4e11-9dd6-2b0181e9c8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:40.939981 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb4c85-3735-4e11-9dd6-2b0181e9c8a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:40.940609 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb4c85-3735-4e11-9dd6-2b0181e9c8a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:40.942230 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb4c85-3735-4e11-9dd6-2b0181e9c8a1 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:40.953361 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1405/2802] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:08:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:08:40.957544 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead2d12e-403a-458f-be6b-f17c30a05c4a admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:40.967727 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead2d12e-403a-458f-be6b-f17c30a05c4a admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:40.973028 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c5c04-d7da-48a9-a6da-aa1c0737de9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:40.973666 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c5c04-d7da-48a9-a6da-aa1c0737de9b admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:40.973945 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c5c04-d7da-48a9-a6da-aa1c0737de9b admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:40.974212 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c5c04-d7da-48a9-a6da-aa1c0737de9b admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:40.974849 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c5c04-d7da-48a9-a6da-aa1c0737de9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:40.976409 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c5c04-d7da-48a9-a6da-aa1c0737de9b admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:40.988349 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1398/2803] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:08:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:08:40.992554 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb4c85-3735-4e11-9dd6-2b0181e9c8a1 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:41.003352 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb4c85-3735-4e11-9dd6-2b0181e9c8a1 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:41.008462 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97315693-56b2-4024-b0be-87154f690204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:41.009064 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97315693-56b2-4024-b0be-87154f690204 admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:41.009339 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97315693-56b2-4024-b0be-87154f690204 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:41.009647 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97315693-56b2-4024-b0be-87154f690204 admin admin] PATH_INFO: `/v3/projects/64ddba67944e45a8babf5935a6488e55/users/20fae4c008d54bc69e4489ea6c8ef4fc/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:41.025447 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97315693-56b2-4024-b0be-87154f690204 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64ddba67944e45a8babf5935a6488e55, user_id=20fae4c008d54bc69e4489ea6c8ef4fc, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:41.028123 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97315693-56b2-4024-b0be-87154f690204 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:41.119679 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1406/2804] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 20:08:40 2022] PUT /identity/v3/projects/64ddba67944e45a8babf5935a6488e55/users/20fae4c008d54bc69e4489ea6c8ef4fc/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 20:08:41.131606 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4f0f0-293b-4b2b-9618-dee004a4f437 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:41.131930 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4f0f0-293b-4b2b-9618-dee004a4f437 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:41.132212 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4f0f0-293b-4b2b-9618-dee004a4f437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:41.159789 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-52a4f0f0-293b-4b2b-9618-dee004a4f437 None None] MFA Rules not processed for user `20fae4c008d54bc69e4489ea6c8ef4fc`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:08:41.162669 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-52a4f0f0-293b-4b2b-9618-dee004a4f437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:41.229221 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1399/2805] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:08:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:08:41.240763 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97315693-56b2-4024-b0be-87154f690204 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:41.242487 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-97315693-56b2-4024-b0be-87154f690204 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:41.288231 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:08:41.301151 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97315693-56b2-4024-b0be-87154f690204 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:41.304827 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc7c23-8edc-4934-9bf9-5a8266c92236 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:41.305441 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc7c23-8edc-4934-9bf9-5a8266c92236 service cinder] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:41.305764 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc7c23-8edc-4934-9bf9-5a8266c92236 service cinder] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:41.306087 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc7c23-8edc-4934-9bf9-5a8266c92236 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:41.315535 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfc7c23-8edc-4934-9bf9-5a8266c92236 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:41.320635 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfc7c23-8edc-4934-9bf9-5a8266c92236 service cinder] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:41.326277 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1407/2806] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:08:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:08:48.221763 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a4f0f0-293b-4b2b-9618-dee004a4f437 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:48.230574 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:08:48.286023 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a4f0f0-293b-4b2b-9618-dee004a4f437 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:48.290585 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bbbc2e-1d50-4b07-9c82-17b24e5e5156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:48.291241 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbbc2e-1d50-4b07-9c82-17b24e5e5156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:48.291523 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbbc2e-1d50-4b07-9c82-17b24e5e5156 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:48.291798 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbbc2e-1d50-4b07-9c82-17b24e5e5156 admin admin] PATH_INFO: `/v3/users/20fae4c008d54bc69e4489ea6c8ef4fc` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:48.292931 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bbbc2e-1d50-4b07-9c82-17b24e5e5156 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20fae4c008d54bc69e4489ea6c8ef4fc)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:48.294992 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bbbc2e-1d50-4b07-9c82-17b24e5e5156 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:48.424749 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-b8bbbc2e-1d50-4b07-9c82-17b24e5e5156 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20fae4c008d54bc69e4489ea6c8ef4fc'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:48.488795 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-b8bbbc2e-1d50-4b07-9c82-17b24e5e5156 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20fae4c008d54bc69e4489ea6c8ef4fc'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:48.489450 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-b8bbbc2e-1d50-4b07-9c82-17b24e5e5156 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20fae4c008d54bc69e4489ea6c8ef4fc'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:48.504452 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-b8bbbc2e-1d50-4b07-9c82-17b24e5e5156 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20fae4c008d54bc69e4489ea6c8ef4fc'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:48.505305 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-b8bbbc2e-1d50-4b07-9c82-17b24e5e5156 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20fae4c008d54bc69e4489ea6c8ef4fc'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:48.518383 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1400/2807] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 20:08:48 2022] DELETE /identity/v3/users/20fae4c008d54bc69e4489ea6c8ef4fc => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:08:48.522981 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5ab3a-08d1-47f8-94a0-0f2635b22778 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:48.523445 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5ab3a-08d1-47f8-94a0-0f2635b22778 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:48.523545 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5ab3a-08d1-47f8-94a0-0f2635b22778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:48.542799 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-11e5ab3a-08d1-47f8-94a0-0f2635b22778 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:08:48.544084 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-11e5ab3a-08d1-47f8-94a0-0f2635b22778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:48.605221 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1408/2808] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:08:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:08:48.615071 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bbbc2e-1d50-4b07-9c82-17b24e5e5156 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:48.616501 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-b8bbbc2e-1d50-4b07-9c82-17b24e5e5156 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:48.676286 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bbbc2e-1d50-4b07-9c82-17b24e5e5156 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:48.680806 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f86045-7880-47a8-b8ea-786a7e74b908 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:48.681373 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f86045-7880-47a8-b8ea-786a7e74b908 service neutron] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:48.681697 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f86045-7880-47a8-b8ea-786a7e74b908 service neutron] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:48.681975 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f86045-7880-47a8-b8ea-786a7e74b908 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:48.692004 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f86045-7880-47a8-b8ea-786a7e74b908 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:48.693430 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f86045-7880-47a8-b8ea-786a7e74b908 service neutron] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:48.703696 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1401/2809] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:08:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 20:08:49.133757 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5ab3a-08d1-47f8-94a0-0f2635b22778 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:49.135307 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-11e5ab3a-08d1-47f8-94a0-0f2635b22778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:49.164351 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5ab3a-08d1-47f8-94a0-0f2635b22778 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:49.170331 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e4930-8a2e-4453-ac8e-ea22794c4756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:49.170967 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e4930-8a2e-4453-ac8e-ea22794c4756 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:49.171241 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e4930-8a2e-4453-ac8e-ea22794c4756 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:49.171501 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e4930-8a2e-4453-ac8e-ea22794c4756 admin admin] PATH_INFO: `/v3/projects/64ddba67944e45a8babf5935a6488e55` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:49.173198 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4e4930-8a2e-4453-ac8e-ea22794c4756 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64ddba67944e45a8babf5935a6488e55)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:49.175214 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4e4930-8a2e-4453-ac8e-ea22794c4756 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:49.310365 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-8a4e4930-8a2e-4453-ac8e-ea22794c4756 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64ddba67944e45a8babf5935a6488e55', 'request_id': 'req-8a4e4930-8a2e-4453-ac8e-ea22794c4756'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:49.317218 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-8a4e4930-8a2e-4453-ac8e-ea22794c4756 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64ddba67944e45a8babf5935a6488e55', 'request_id': 'req-8a4e4930-8a2e-4453-ac8e-ea22794c4756'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:49.386166 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-8a4e4930-8a2e-4453-ac8e-ea22794c4756 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64ddba67944e45a8babf5935a6488e55', 'request_id': 'req-8a4e4930-8a2e-4453-ac8e-ea22794c4756'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:49.397805 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-8a4e4930-8a2e-4453-ac8e-ea22794c4756 admin admin] The token cache is being invalidate because project 64ddba67944e45a8babf5935a6488e55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 20:08:49.398090 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-8a4e4930-8a2e-4453-ac8e-ea22794c4756 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:49.398721 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-8a4e4930-8a2e-4453-ac8e-ea22794c4756 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:49.400257 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1409/2810] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 20:08:49 2022] DELETE /identity/v3/projects/64ddba67944e45a8babf5935a6488e55 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:08:49.405394 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb5612-7444-4ea2-be28-cfb08575c4b3 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:49.406802 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb5612-7444-4ea2-be28-cfb08575c4b3 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:49.406802 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb5612-7444-4ea2-be28-cfb08575c4b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:49.425541 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-d0eb5612-7444-4ea2-be28-cfb08575c4b3 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:08:49.426834 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-d0eb5612-7444-4ea2-be28-cfb08575c4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:49.453889 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:08:49.495717 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1402/2811] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:08:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:08:49.504932 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4871633-db01-49c5-9627-63a2c7cbe961 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:49.505292 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4871633-db01-49c5-9627-63a2c7cbe961 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:49.505479 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4871633-db01-49c5-9627-63a2c7cbe961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:49.527940 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-d4871633-db01-49c5-9627-63a2c7cbe961 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:08:49.529168 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-d4871633-db01-49c5-9627-63a2c7cbe961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:49.537796 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1410/2812] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:08:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:08:49.548528 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb5612-7444-4ea2-be28-cfb08575c4b3 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:49.558420 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb5612-7444-4ea2-be28-cfb08575c4b3 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:49.564288 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b934b70-cf6e-4e06-b53e-72afcf107721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:49.564945 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b934b70-cf6e-4e06-b53e-72afcf107721 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:49.565228 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b934b70-cf6e-4e06-b53e-72afcf107721 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:49.565524 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b934b70-cf6e-4e06-b53e-72afcf107721 admin admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:49.566204 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b934b70-cf6e-4e06-b53e-72afcf107721 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:08:49.566509 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b934b70-cf6e-4e06-b53e-72afcf107721 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:49.568249 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b934b70-cf6e-4e06-b53e-72afcf107721 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:49.586411 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1403/2813] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 20:08:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:08:49.587723 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4871633-db01-49c5-9627-63a2c7cbe961 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:49.597642 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4871633-db01-49c5-9627-63a2c7cbe961 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:49.603104 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d6ec0-fe43-4b95-9fb1-225260b40d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:49.603736 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d6ec0-fe43-4b95-9fb1-225260b40d28 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:49.604015 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d6ec0-fe43-4b95-9fb1-225260b40d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:49.604289 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d6ec0-fe43-4b95-9fb1-225260b40d28 admin admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:49.605068 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d6ec0-fe43-4b95-9fb1-225260b40d28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:49.607036 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d6ec0-fe43-4b95-9fb1-225260b40d28 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:49.695769 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1411/2814] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 20:08:49 2022] POST /identity/v3/projects => generated 373 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 20:08:49.699470 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b934b70-cf6e-4e06-b53e-72afcf107721 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:49.709879 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b934b70-cf6e-4e06-b53e-72afcf107721 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:49.774035 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afacf04-dc96-4bdb-ba45-caa2fee9ec1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:49.774706 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afacf04-dc96-4bdb-ba45-caa2fee9ec1c admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:49.774954 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afacf04-dc96-4bdb-ba45-caa2fee9ec1c admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:49.775226 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afacf04-dc96-4bdb-ba45-caa2fee9ec1c admin admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:49.775866 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afacf04-dc96-4bdb-ba45-caa2fee9ec1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:49.777789 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afacf04-dc96-4bdb-ba45-caa2fee9ec1c admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:49.884741 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1404/2815] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 20:08:49 2022] POST /identity/v3/users => generated 287 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:08:49.888990 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d6ec0-fe43-4b95-9fb1-225260b40d28 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:49.900696 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d6ec0-fe43-4b95-9fb1-225260b40d28 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:49.905663 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e266ab-c1f0-49e4-9920-a7990b3017be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:49.906375 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e266ab-c1f0-49e4-9920-a7990b3017be admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:49.906655 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e266ab-c1f0-49e4-9920-a7990b3017be admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:49.906981 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e266ab-c1f0-49e4-9920-a7990b3017be admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:49.907640 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e266ab-c1f0-49e4-9920-a7990b3017be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:49.909846 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e266ab-c1f0-49e4-9920-a7990b3017be admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:49.925095 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1412/2816] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:08:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:08:49.926424 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afacf04-dc96-4bdb-ba45-caa2fee9ec1c admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:49.936873 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afacf04-dc96-4bdb-ba45-caa2fee9ec1c admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:49.943348 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137618a6-94f5-4ca4-93ff-a6905ef8d7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:49.944240 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137618a6-94f5-4ca4-93ff-a6905ef8d7ff admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:49.944363 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137618a6-94f5-4ca4-93ff-a6905ef8d7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:49.944652 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137618a6-94f5-4ca4-93ff-a6905ef8d7ff admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:49.945641 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137618a6-94f5-4ca4-93ff-a6905ef8d7ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:49.947430 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137618a6-94f5-4ca4-93ff-a6905ef8d7ff admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:49.962828 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1405/2817] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:08:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:08:49.963810 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e266ab-c1f0-49e4-9920-a7990b3017be admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:49.974853 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e266ab-c1f0-49e4-9920-a7990b3017be admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:49.979485 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540ef926-11fc-408f-ad89-2f2bfbe55483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:49.980141 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ef926-11fc-408f-ad89-2f2bfbe55483 admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:49.980424 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ef926-11fc-408f-ad89-2f2bfbe55483 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:49.980693 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ef926-11fc-408f-ad89-2f2bfbe55483 admin admin] PATH_INFO: `/v3/projects/0ab0597a27dc4efb9c0747e88d59e84c/users/a6727007860347cbbf6f6bd8fd4da6f7/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:49.997278 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540ef926-11fc-408f-ad89-2f2bfbe55483 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ab0597a27dc4efb9c0747e88d59e84c, user_id=a6727007860347cbbf6f6bd8fd4da6f7, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:49.999970 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540ef926-11fc-408f-ad89-2f2bfbe55483 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:50.090426 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1413/2818] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 20:08:49 2022] PUT /identity/v3/projects/0ab0597a27dc4efb9c0747e88d59e84c/users/a6727007860347cbbf6f6bd8fd4da6f7/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:08:50.101453 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c3305-1237-4946-88c1-8d5fcc2ac777 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:50.101847 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c3305-1237-4946-88c1-8d5fcc2ac777 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:50.102190 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c3305-1237-4946-88c1-8d5fcc2ac777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:50.133406 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-904c3305-1237-4946-88c1-8d5fcc2ac777 None None] MFA Rules not processed for user `a6727007860347cbbf6f6bd8fd4da6f7`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:08:50.134696 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-904c3305-1237-4946-88c1-8d5fcc2ac777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:50.209064 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1406/2819] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:08:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:08:50.220138 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540ef926-11fc-408f-ad89-2f2bfbe55483 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:50.222023 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-540ef926-11fc-408f-ad89-2f2bfbe55483 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:50.228452 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:08:50.280314 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540ef926-11fc-408f-ad89-2f2bfbe55483 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:50.285875 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220a6a9b-b520-45db-89c2-781ec34c33dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:50.286481 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220a6a9b-b520-45db-89c2-781ec34c33dd service cinder] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:50.286760 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220a6a9b-b520-45db-89c2-781ec34c33dd service cinder] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:50.287032 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220a6a9b-b520-45db-89c2-781ec34c33dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:50.295679 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220a6a9b-b520-45db-89c2-781ec34c33dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:50.297144 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220a6a9b-b520-45db-89c2-781ec34c33dd service cinder] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:50.306574 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1414/2820] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:08:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:08:54.185838 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c3305-1237-4946-88c1-8d5fcc2ac777 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:54.213781 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:08:54.248820 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c3305-1237-4946-88c1-8d5fcc2ac777 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:54.253419 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b362a76-edd7-4edd-9d01-53c25e598ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:54.254391 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b362a76-edd7-4edd-9d01-53c25e598ea3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:54.254729 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b362a76-edd7-4edd-9d01-53c25e598ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:54.255021 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b362a76-edd7-4edd-9d01-53c25e598ea3 admin admin] PATH_INFO: `/v3/users/a6727007860347cbbf6f6bd8fd4da6f7` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:54.256481 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b362a76-edd7-4edd-9d01-53c25e598ea3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6727007860347cbbf6f6bd8fd4da6f7)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:54.258475 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b362a76-edd7-4edd-9d01-53c25e598ea3 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:54.446898 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-1b362a76-edd7-4edd-9d01-53c25e598ea3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6727007860347cbbf6f6bd8fd4da6f7'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:54.534226 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-1b362a76-edd7-4edd-9d01-53c25e598ea3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6727007860347cbbf6f6bd8fd4da6f7'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:54.534838 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-1b362a76-edd7-4edd-9d01-53c25e598ea3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6727007860347cbbf6f6bd8fd4da6f7'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:54.547589 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-1b362a76-edd7-4edd-9d01-53c25e598ea3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6727007860347cbbf6f6bd8fd4da6f7'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:54.548246 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-1b362a76-edd7-4edd-9d01-53c25e598ea3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6727007860347cbbf6f6bd8fd4da6f7'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:54.560759 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1407/2821] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 20:08:54 2022] DELETE /identity/v3/users/a6727007860347cbbf6f6bd8fd4da6f7 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:08:54.565224 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331ef87-6308-4eb0-b8f6-82200027d2cd None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:54.565716 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331ef87-6308-4eb0-b8f6-82200027d2cd None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:54.565836 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331ef87-6308-4eb0-b8f6-82200027d2cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:54.585924 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-9331ef87-6308-4eb0-b8f6-82200027d2cd None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:08:54.587105 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-9331ef87-6308-4eb0-b8f6-82200027d2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:54.645192 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1415/2822] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:08:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:08:54.655643 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b362a76-edd7-4edd-9d01-53c25e598ea3 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:54.657080 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-1b362a76-edd7-4edd-9d01-53c25e598ea3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:54.715856 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b362a76-edd7-4edd-9d01-53c25e598ea3 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:54.719393 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62391cc-08d1-4781-a83b-84ec3c31bb60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:54.719996 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62391cc-08d1-4781-a83b-84ec3c31bb60 service neutron] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:54.720274 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62391cc-08d1-4781-a83b-84ec3c31bb60 service neutron] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:54.720547 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62391cc-08d1-4781-a83b-84ec3c31bb60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:54.729678 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62391cc-08d1-4781-a83b-84ec3c31bb60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:54.731170 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62391cc-08d1-4781-a83b-84ec3c31bb60 service neutron] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:54.742057 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1408/2823] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:08:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:08:55.217698 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9331ef87-6308-4eb0-b8f6-82200027d2cd None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:08:55.219120 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-9331ef87-6308-4eb0-b8f6-82200027d2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:08:55.233516 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9331ef87-6308-4eb0-b8f6-82200027d2cd None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:08:55.236344 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0072cae-5fa9-43f5-9438-dcc6e51ef562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:08:55.237001 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0072cae-5fa9-43f5-9438-dcc6e51ef562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:08:55.237275 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0072cae-5fa9-43f5-9438-dcc6e51ef562 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:08:55.237572 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0072cae-5fa9-43f5-9438-dcc6e51ef562 admin admin] PATH_INFO: `/v3/projects/0ab0597a27dc4efb9c0747e88d59e84c` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:08:55.238687 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0072cae-5fa9-43f5-9438-dcc6e51ef562 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ab0597a27dc4efb9c0747e88d59e84c)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:08:55.241447 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0072cae-5fa9-43f5-9438-dcc6e51ef562 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:08:55.341931 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-c0072cae-5fa9-43f5-9438-dcc6e51ef562 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ab0597a27dc4efb9c0747e88d59e84c', 'request_id': 'req-c0072cae-5fa9-43f5-9438-dcc6e51ef562'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:55.348115 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-c0072cae-5fa9-43f5-9438-dcc6e51ef562 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ab0597a27dc4efb9c0747e88d59e84c', 'request_id': 'req-c0072cae-5fa9-43f5-9438-dcc6e51ef562'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:55.432939 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-c0072cae-5fa9-43f5-9438-dcc6e51ef562 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ab0597a27dc4efb9c0747e88d59e84c', 'request_id': 'req-c0072cae-5fa9-43f5-9438-dcc6e51ef562'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:55.444026 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-c0072cae-5fa9-43f5-9438-dcc6e51ef562 admin admin] The token cache is being invalidate because project 0ab0597a27dc4efb9c0747e88d59e84c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 20:08:55.444314 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-c0072cae-5fa9-43f5-9438-dcc6e51ef562 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:55.445265 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-c0072cae-5fa9-43f5-9438-dcc6e51ef562 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:08:55.446788 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1416/2824] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 20:08:55 2022] DELETE /identity/v3/projects/0ab0597a27dc4efb9c0747e88d59e84c => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:09:04.686560 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62391cc-08d1-4781-a83b-84ec3c31bb60 service neutron] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:09:04.687995 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-d62391cc-08d1-4781-a83b-84ec3c31bb60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:09:04.700090 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62391cc-08d1-4781-a83b-84ec3c31bb60 service neutron] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:09:04.743652 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:09:04.749023 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b46607-b260-42cb-83e0-1c2d94f54a5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:09:04.756926 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b46607-b260-42cb-83e0-1c2d94f54a5b service neutron] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:09:04.756926 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b46607-b260-42cb-83e0-1c2d94f54a5b service neutron] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:09:04.756926 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b46607-b260-42cb-83e0-1c2d94f54a5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:09:04.756926 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-98b46607-b260-42cb-83e0-1c2d94f54a5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:09:04.763144 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b46607-b260-42cb-83e0-1c2d94f54a5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:09:04.764581 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b46607-b260-42cb-83e0-1c2d94f54a5b service neutron] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:09:04.772792 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1409/2825] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:09:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:09:05.440673 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=78,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:09:14.878592 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=5 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:12:07.325115 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0072cae-5fa9-43f5-9438-dcc6e51ef562 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:12:07.326517 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-c0072cae-5fa9-43f5-9438-dcc6e51ef562 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:12:07.393713 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0072cae-5fa9-43f5-9438-dcc6e51ef562 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:12:07.399092 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d215f-44de-4433-b86d-4e9a3514f6fe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f19f1385114fa5a921999747a6666b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:12:07.399409 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d215f-44de-4433-b86d-4e9a3514f6fe service placement] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:12:07.399684 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d215f-44de-4433-b86d-4e9a3514f6fe service placement] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:12:07.399951 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d215f-44de-4433-b86d-4e9a3514f6fe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:12:07.401667 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-e51d215f-44de-4433-b86d-4e9a3514f6fe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:12:07.412652 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51d215f-44de-4433-b86d-4e9a3514f6fe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:12:07.414405 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51d215f-44de-4433-b86d-4e9a3514f6fe service placement] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:12:07.424518 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1417/2826] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:12:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:12:17.419909 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=32 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:12:37.854059 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a3db9-d061-435a-be0d-442e73a495e3 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:12:37.854523 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a3db9-d061-435a-be0d-442e73a495e3 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:12:37.854635 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a3db9-d061-435a-be0d-442e73a495e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:12:37.874450 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-860a3db9-d061-435a-be0d-442e73a495e3 None None] MFA Rules not processed for user `b64d52c25ee04eb1a8509faf716f2f55`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:12:37.875667 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-860a3db9-d061-435a-be0d-442e73a495e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:12:37.932364 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1410/2827] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:12:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:12:38.247586 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d215f-44de-4433-b86d-4e9a3514f6fe service placement] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:12:38.249180 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-e51d215f-44de-4433-b86d-4e9a3514f6fe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:12:38.260575 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d215f-44de-4433-b86d-4e9a3514f6fe service placement] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:12:38.264776 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb30274-c35b-429d-81c3-ba0d733bc5b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:12:38.265397 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb30274-c35b-429d-81c3-ba0d733bc5b3 service neutron] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:12:38.265702 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb30274-c35b-429d-81c3-ba0d733bc5b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:12:38.265973 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb30274-c35b-429d-81c3-ba0d733bc5b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:12:38.267647 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-0eb30274-c35b-429d-81c3-ba0d733bc5b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:12:38.277569 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb30274-c35b-429d-81c3-ba0d733bc5b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:12:38.278983 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb30274-c35b-429d-81c3-ba0d733bc5b3 service neutron] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:12:38.287614 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1418/2828] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:12:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:12:38.774106 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a3db9-d061-435a-be0d-442e73a495e3 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:12:38.786117 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a3db9-d061-435a-be0d-442e73a495e3 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:12:38.791007 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a777d9-485c-4f0e-9fda-01af993ac695 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f19f1385114fa5a921999747a6666b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:12:38.791607 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a777d9-485c-4f0e-9fda-01af993ac695 service placement] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:12:38.791883 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a777d9-485c-4f0e-9fda-01af993ac695 service placement] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:12:38.792151 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a777d9-485c-4f0e-9fda-01af993ac695 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:12:38.793903 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-49a777d9-485c-4f0e-9fda-01af993ac695 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:12:38.806451 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a777d9-485c-4f0e-9fda-01af993ac695 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:12:38.807840 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a777d9-485c-4f0e-9fda-01af993ac695 service placement] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:12:38.820480 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1411/2829] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:12:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:12:48.283991 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=6 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:12:48.814971 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=31 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:12:49.879680 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb30274-c35b-429d-81c3-ba0d733bc5b3 service neutron] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:12:49.881418 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-0eb30274-c35b-429d-81c3-ba0d733bc5b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:12:49.956036 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb30274-c35b-429d-81c3-ba0d733bc5b3 service neutron] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:12:49.962267 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba615d4-defc-4e81-afc7-977d5deb1655 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5047a59bc4547be643ffa78808a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:12:49.962873 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba615d4-defc-4e81-afc7-977d5deb1655 service nova] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:12:49.963149 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba615d4-defc-4e81-afc7-977d5deb1655 service nova] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:12:49.963418 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba615d4-defc-4e81-afc7-977d5deb1655 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:12:49.965536 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-9ba615d4-defc-4e81-afc7-977d5deb1655 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:12:49.979342 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba615d4-defc-4e81-afc7-977d5deb1655 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:12:49.981160 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba615d4-defc-4e81-afc7-977d5deb1655 service nova] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:12:49.994953 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1419/2830] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:12:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:12:59.989537 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=34 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:13:58.744068 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a777d9-485c-4f0e-9fda-01af993ac695 service placement] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:13:58.757327 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a777d9-485c-4f0e-9fda-01af993ac695 service placement] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:13:58.762839 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d642a-cabf-4134-832b-ceab587d11a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5047a59bc4547be643ffa78808a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:13:58.763438 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d642a-cabf-4134-832b-ceab587d11a4 service nova] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:13:58.763718 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d642a-cabf-4134-832b-ceab587d11a4 service nova] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:13:58.764035 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d642a-cabf-4134-832b-ceab587d11a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:13:58.765779 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-010d642a-cabf-4134-832b-ceab587d11a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:13:58.778147 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d642a-cabf-4134-832b-ceab587d11a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:13:58.779939 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d642a-cabf-4134-832b-ceab587d11a4 service nova] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:13:58.790543 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1412/2831] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:13:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:14:01.722310 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba615d4-defc-4e81-afc7-977d5deb1655 service nova] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:14:01.723695 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-9ba615d4-defc-4e81-afc7-977d5deb1655 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:14:01.780431 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba615d4-defc-4e81-afc7-977d5deb1655 service nova] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:14:01.784591 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a38a367-2385-4947-92c5-10156dcf210c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:14:01.785167 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a38a367-2385-4947-92c5-10156dcf210c service cinder] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:14:01.785441 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a38a367-2385-4947-92c5-10156dcf210c service cinder] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:14:01.785739 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a38a367-2385-4947-92c5-10156dcf210c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:14:01.787452 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-0a38a367-2385-4947-92c5-10156dcf210c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:14:01.803560 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a38a367-2385-4947-92c5-10156dcf210c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:14:01.805116 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a38a367-2385-4947-92c5-10156dcf210c service cinder] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:14:01.816695 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1420/2832] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:14:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:14:07.798466 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d642a-cabf-4134-832b-ceab587d11a4 service nova] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:14:07.809065 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d642a-cabf-4134-832b-ceab587d11a4 service nova] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:14:07.813059 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d857d3a-e583-4e21-8179-f348002b428c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:14:07.813775 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d857d3a-e583-4e21-8179-f348002b428c service neutron] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:14:07.814078 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d857d3a-e583-4e21-8179-f348002b428c service neutron] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:14:07.814353 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d857d3a-e583-4e21-8179-f348002b428c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:14:07.822324 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d857d3a-e583-4e21-8179-f348002b428c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:14:07.823793 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d857d3a-e583-4e21-8179-f348002b428c service neutron] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:14:07.832119 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1413/2833] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:14:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:14:11.811697 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=26 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:14:17.828343 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=12 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:14:20.948385 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a38a367-2385-4947-92c5-10156dcf210c service cinder] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:14:20.961595 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a38a367-2385-4947-92c5-10156dcf210c service cinder] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:14:20.967912 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22252d3a-7cb1-45f4-a5ef-7abdf2104d10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5047a59bc4547be643ffa78808a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:14:20.968551 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22252d3a-7cb1-45f4-a5ef-7abdf2104d10 service nova] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:14:20.968829 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22252d3a-7cb1-45f4-a5ef-7abdf2104d10 service nova] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:14:20.969201 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22252d3a-7cb1-45f4-a5ef-7abdf2104d10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:14:20.971069 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-22252d3a-7cb1-45f4-a5ef-7abdf2104d10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:14:20.985449 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22252d3a-7cb1-45f4-a5ef-7abdf2104d10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:14:20.987087 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22252d3a-7cb1-45f4-a5ef-7abdf2104d10 service nova] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:14:20.999998 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1421/2834] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:14:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:14:28.396131 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d857d3a-e583-4e21-8179-f348002b428c service neutron] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:14:28.406024 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d857d3a-e583-4e21-8179-f348002b428c service neutron] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:14:28.409789 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac9e25-212b-4d82-8228-c4866733f4c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:14:28.410390 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac9e25-212b-4d82-8228-c4866733f4c4 service neutron] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:14:28.410672 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac9e25-212b-4d82-8228-c4866733f4c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:14:28.410950 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac9e25-212b-4d82-8228-c4866733f4c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:14:28.412710 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-58ac9e25-212b-4d82-8228-c4866733f4c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:14:28.479566 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ac9e25-212b-4d82-8228-c4866733f4c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:14:28.481188 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ac9e25-212b-4d82-8228-c4866733f4c4 service neutron] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:14:28.491122 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1414/2835] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:14:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:14:30.994553 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=6 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:14:31.960919 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22252d3a-7cb1-45f4-a5ef-7abdf2104d10 service nova] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:14:31.962473 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-22252d3a-7cb1-45f4-a5ef-7abdf2104d10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:14:31.977143 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22252d3a-7cb1-45f4-a5ef-7abdf2104d10 service nova] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:14:31.983370 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb423a58-8aee-4e59-882f-6fe397f8c4b4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f19f1385114fa5a921999747a6666b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:14:31.984034 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb423a58-8aee-4e59-882f-6fe397f8c4b4 service placement] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:14:31.984318 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb423a58-8aee-4e59-882f-6fe397f8c4b4 service placement] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:14:31.984590 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb423a58-8aee-4e59-882f-6fe397f8c4b4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:14:31.986371 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-bb423a58-8aee-4e59-882f-6fe397f8c4b4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:14:31.999025 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb423a58-8aee-4e59-882f-6fe397f8c4b4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:14:32.000606 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb423a58-8aee-4e59-882f-6fe397f8c4b4 service placement] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:14:32.011526 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1422/2836] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:14:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:14:32.121813 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac9e25-212b-4d82-8228-c4866733f4c4 service neutron] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:14:32.122353 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-58ac9e25-212b-4d82-8228-c4866733f4c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:14:32.135755 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac9e25-212b-4d82-8228-c4866733f4c4 service neutron] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:14:32.140689 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95ef72f-2788-43a9-8feb-7d82703db6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:14:32.141329 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ef72f-2788-43a9-8feb-7d82703db6d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:14:32.141666 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ef72f-2788-43a9-8feb-7d82703db6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:14:32.141965 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ef72f-2788-43a9-8feb-7d82703db6d8 admin admin] PATH_INFO: `/v3/users/b64d52c25ee04eb1a8509faf716f2f55` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:14:32.143106 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95ef72f-2788-43a9-8feb-7d82703db6d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b64d52c25ee04eb1a8509faf716f2f55)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:14:32.145071 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95ef72f-2788-43a9-8feb-7d82703db6d8 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:14:32.338881 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-f95ef72f-2788-43a9-8feb-7d82703db6d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b64d52c25ee04eb1a8509faf716f2f55'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:14:32.437127 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-f95ef72f-2788-43a9-8feb-7d82703db6d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b64d52c25ee04eb1a8509faf716f2f55'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:14:32.437708 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-f95ef72f-2788-43a9-8feb-7d82703db6d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b64d52c25ee04eb1a8509faf716f2f55'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:14:32.451189 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-f95ef72f-2788-43a9-8feb-7d82703db6d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b64d52c25ee04eb1a8509faf716f2f55'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:14:32.451867 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-f95ef72f-2788-43a9-8feb-7d82703db6d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b64d52c25ee04eb1a8509faf716f2f55'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:14:32.464826 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1415/2837] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 20:14:32 2022] DELETE /identity/v3/users/b64d52c25ee04eb1a8509faf716f2f55 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:14:32.724827 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb423a58-8aee-4e59-882f-6fe397f8c4b4 service placement] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:14:32.736856 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb423a58-8aee-4e59-882f-6fe397f8c4b4 service placement] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:14:32.807349 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c7e3e-109f-4f54-9725-f95ffe216def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:14:32.809396 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c7e3e-109f-4f54-9725-f95ffe216def admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:14:32.809844 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c7e3e-109f-4f54-9725-f95ffe216def admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:14:32.810161 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c7e3e-109f-4f54-9725-f95ffe216def admin admin] PATH_INFO: `/v3/projects/699d61b24fd64c5da6533360c0be48eb` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:14:32.811423 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532c7e3e-109f-4f54-9725-f95ffe216def admin admin] RBAC: Authorizing `identity:delete_project(project_id=699d61b24fd64c5da6533360c0be48eb)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:14:32.813476 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532c7e3e-109f-4f54-9725-f95ffe216def admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:14:32.930303 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-532c7e3e-109f-4f54-9725-f95ffe216def admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '699d61b24fd64c5da6533360c0be48eb', 'request_id': 'req-532c7e3e-109f-4f54-9725-f95ffe216def'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:14:32.941890 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-532c7e3e-109f-4f54-9725-f95ffe216def admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '699d61b24fd64c5da6533360c0be48eb', 'request_id': 'req-532c7e3e-109f-4f54-9725-f95ffe216def'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:14:33.026421 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-532c7e3e-109f-4f54-9725-f95ffe216def admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '699d61b24fd64c5da6533360c0be48eb', 'request_id': 'req-532c7e3e-109f-4f54-9725-f95ffe216def'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:14:33.038408 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-532c7e3e-109f-4f54-9725-f95ffe216def admin admin] The token cache is being invalidate because project 699d61b24fd64c5da6533360c0be48eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 20:14:33.039926 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-532c7e3e-109f-4f54-9725-f95ffe216def admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:14:33.039926 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-532c7e3e-109f-4f54-9725-f95ffe216def admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:14:33.041303 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1423/2838] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 20:14:32 2022] DELETE /identity/v3/projects/699d61b24fd64c5da6533360c0be48eb => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:14:33.047978 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b166c-7272-451f-937d-afe24c2efd70 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:14:33.048317 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b166c-7272-451f-937d-afe24c2efd70 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:14:33.048633 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b166c-7272-451f-937d-afe24c2efd70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:14:33.069998 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-560b166c-7272-451f-937d-afe24c2efd70 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:14:33.071200 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-560b166c-7272-451f-937d-afe24c2efd70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:14:33.134169 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1416/2839] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:14:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:14:33.142266 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b039f1-cad6-4573-a685-ed611308ddf3 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:14:33.142641 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b039f1-cad6-4573-a685-ed611308ddf3 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:14:33.142887 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b039f1-cad6-4573-a685-ed611308ddf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:14:33.163306 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-08b039f1-cad6-4573-a685-ed611308ddf3 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:14:33.164514 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-08b039f1-cad6-4573-a685-ed611308ddf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:14:33.173300 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1424/2840] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:14:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:14:33.177770 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b166c-7272-451f-937d-afe24c2efd70 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:14:33.189443 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b166c-7272-451f-937d-afe24c2efd70 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:14:33.194350 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544e8d80-c200-4c11-b306-6951979d04b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:14:33.194906 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e8d80-c200-4c11-b306-6951979d04b3 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:14:33.195216 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e8d80-c200-4c11-b306-6951979d04b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:14:33.195458 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e8d80-c200-4c11-b306-6951979d04b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:14:33.196100 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544e8d80-c200-4c11-b306-6951979d04b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93400) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:14:33.196405 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544e8d80-c200-4c11-b306-6951979d04b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:14:33.198030 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544e8d80-c200-4c11-b306-6951979d04b3 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:14:33.199867 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:14:33.211322 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1417/2841] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 20:14:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:14:33.216766 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b039f1-cad6-4573-a685-ed611308ddf3 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:14:33.226869 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b039f1-cad6-4573-a685-ed611308ddf3 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:14:33.232205 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d177b4-fbe8-4cd4-bd5a-2c4d10ae2df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:14:33.232805 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d177b4-fbe8-4cd4-bd5a-2c4d10ae2df8 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:14:33.233105 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d177b4-fbe8-4cd4-bd5a-2c4d10ae2df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:14:33.233372 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d177b4-fbe8-4cd4-bd5a-2c4d10ae2df8 admin admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:14:33.234046 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d177b4-fbe8-4cd4-bd5a-2c4d10ae2df8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:14:33.235956 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d177b4-fbe8-4cd4-bd5a-2c4d10ae2df8 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:14:33.369942 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1425/2842] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 20:14:33 2022] POST /identity/v3/projects => generated 385 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 20:14:33.373989 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544e8d80-c200-4c11-b306-6951979d04b3 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:14:33.384098 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544e8d80-c200-4c11-b306-6951979d04b3 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:14:33.443655 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e53c0e-e90c-4f15-9bb0-65bffd2489c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:14:33.444290 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e53c0e-e90c-4f15-9bb0-65bffd2489c5 admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:14:33.444622 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e53c0e-e90c-4f15-9bb0-65bffd2489c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:14:33.444910 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e53c0e-e90c-4f15-9bb0-65bffd2489c5 admin admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:14:33.445484 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e53c0e-e90c-4f15-9bb0-65bffd2489c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:14:33.447428 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e53c0e-e90c-4f15-9bb0-65bffd2489c5 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:14:33.540852 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1418/2843] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 20:14:33 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:14:33.545621 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d177b4-fbe8-4cd4-bd5a-2c4d10ae2df8 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:14:33.556705 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d177b4-fbe8-4cd4-bd5a-2c4d10ae2df8 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:14:33.562414 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd591c0-0ebf-4d04-a0cb-b6fa5d218466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:14:33.563043 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd591c0-0ebf-4d04-a0cb-b6fa5d218466 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:14:33.563317 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd591c0-0ebf-4d04-a0cb-b6fa5d218466 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:14:33.563601 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd591c0-0ebf-4d04-a0cb-b6fa5d218466 admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:14:33.564216 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd591c0-0ebf-4d04-a0cb-b6fa5d218466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:14:33.565900 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd591c0-0ebf-4d04-a0cb-b6fa5d218466 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:14:33.576613 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1426/2844] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:14:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:14:33.580775 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e53c0e-e90c-4f15-9bb0-65bffd2489c5 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:14:33.591279 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e53c0e-e90c-4f15-9bb0-65bffd2489c5 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:14:33.595958 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26cf0e0-b161-4134-8cff-7116cb1a6f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:14:33.596548 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26cf0e0-b161-4134-8cff-7116cb1a6f81 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:14:33.596822 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26cf0e0-b161-4134-8cff-7116cb1a6f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:14:33.597098 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26cf0e0-b161-4134-8cff-7116cb1a6f81 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:14:33.597764 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26cf0e0-b161-4134-8cff-7116cb1a6f81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:14:33.599325 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26cf0e0-b161-4134-8cff-7116cb1a6f81 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:14:33.609964 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1419/2845] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:14:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:14:33.614326 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd591c0-0ebf-4d04-a0cb-b6fa5d218466 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:14:33.625085 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd591c0-0ebf-4d04-a0cb-b6fa5d218466 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:14:33.629778 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e27fd2-e416-4d47-9df9-6d8774818d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:14:33.630420 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e27fd2-e416-4d47-9df9-6d8774818d5c admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:14:33.630699 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e27fd2-e416-4d47-9df9-6d8774818d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:14:33.630962 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e27fd2-e416-4d47-9df9-6d8774818d5c admin admin] PATH_INFO: `/v3/projects/af0d7fe910924043b76578954528ec51/users/d5d59f8db168414f9663cc53c37d5f1f/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:14:33.645729 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e27fd2-e416-4d47-9df9-6d8774818d5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=af0d7fe910924043b76578954528ec51, user_id=d5d59f8db168414f9663cc53c37d5f1f, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:14:33.648344 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e27fd2-e416-4d47-9df9-6d8774818d5c admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:14:33.710494 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1427/2846] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 20:14:33 2022] PUT /identity/v3/projects/af0d7fe910924043b76578954528ec51/users/d5d59f8db168414f9663cc53c37d5f1f/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 20:14:33.721311 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ecf5ec-9e69-4a6a-8a9f-b2387e2b488a None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:14:33.721634 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ecf5ec-9e69-4a6a-8a9f-b2387e2b488a None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:14:33.727114 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ecf5ec-9e69-4a6a-8a9f-b2387e2b488a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:14:33.750473 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-d8ecf5ec-9e69-4a6a-8a9f-b2387e2b488a None None] MFA Rules not processed for user `d5d59f8db168414f9663cc53c37d5f1f`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:14:33.751688 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-d8ecf5ec-9e69-4a6a-8a9f-b2387e2b488a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:14:33.815830 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1420/2847] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:14:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:14:33.820332 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e27fd2-e416-4d47-9df9-6d8774818d5c admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:14:33.835367 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:14:33.884037 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e27fd2-e416-4d47-9df9-6d8774818d5c admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:14:33.890453 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d07da-55f5-40d9-98b8-304edc274277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:14:33.891063 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d07da-55f5-40d9-98b8-304edc274277 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:14:33.891339 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d07da-55f5-40d9-98b8-304edc274277 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:14:33.891606 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d07da-55f5-40d9-98b8-304edc274277 admin admin] PATH_INFO: `/v3/projects` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:14:33.892238 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2d07da-55f5-40d9-98b8-304edc274277 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:14:33.894171 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2d07da-55f5-40d9-98b8-304edc274277 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:14:34.005402 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1428/2848] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 20:14:33 2022] POST /identity/v3/projects => generated 387 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:14:34.009671 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ecf5ec-9e69-4a6a-8a9f-b2387e2b488a None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:14:34.021102 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ecf5ec-9e69-4a6a-8a9f-b2387e2b488a None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:14:34.081110 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7776dd5e-55ab-460d-9b6c-0925631da137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:14:34.081821 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776dd5e-55ab-460d-9b6c-0925631da137 admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:14:34.082105 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776dd5e-55ab-460d-9b6c-0925631da137 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:14:34.082379 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776dd5e-55ab-460d-9b6c-0925631da137 admin admin] PATH_INFO: `/v3/users` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:14:34.083046 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7776dd5e-55ab-460d-9b6c-0925631da137 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:14:34.084944 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7776dd5e-55ab-460d-9b6c-0925631da137 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:14:34.094041 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:14:34.197481 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1421/2849] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 20:14:34 2022] POST /identity/v3/users => generated 300 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:14:34.202503 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d07da-55f5-40d9-98b8-304edc274277 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:14:34.213398 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d07da-55f5-40d9-98b8-304edc274277 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:14:34.218431 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87883704-9d78-462d-a13f-cebce5be74f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:14:34.219052 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87883704-9d78-462d-a13f-cebce5be74f5 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:14:34.219350 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87883704-9d78-462d-a13f-cebce5be74f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:14:34.219620 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87883704-9d78-462d-a13f-cebce5be74f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:14:34.220265 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87883704-9d78-462d-a13f-cebce5be74f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:14:34.221916 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87883704-9d78-462d-a13f-cebce5be74f5 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:14:34.232820 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1429/2850] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:14:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:14:34.239218 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7776dd5e-55ab-460d-9b6c-0925631da137 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:14:34.250468 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7776dd5e-55ab-460d-9b6c-0925631da137 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:14:34.255154 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6f956-383c-4b10-8b8a-9dab7b041279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:14:34.255859 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6f956-383c-4b10-8b8a-9dab7b041279 admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:14:34.256090 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6f956-383c-4b10-8b8a-9dab7b041279 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:14:34.256366 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6f956-383c-4b10-8b8a-9dab7b041279 admin admin] PATH_INFO: `/v3/projects/e1b6c023d20d45a3be06c2c2a15e57bb/users/061053c29d054a5ab03a9055f8ccb751/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:14:34.272505 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b6f956-383c-4b10-8b8a-9dab7b041279 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1b6c023d20d45a3be06c2c2a15e57bb, user_id=061053c29d054a5ab03a9055f8ccb751, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:14:34.275177 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b6f956-383c-4b10-8b8a-9dab7b041279 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:14:34.346200 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1422/2851] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 20:14:34 2022] PUT /identity/v3/projects/e1b6c023d20d45a3be06c2c2a15e57bb/users/061053c29d054a5ab03a9055f8ccb751/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:14:34.350537 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87883704-9d78-462d-a13f-cebce5be74f5 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:14:34.363394 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87883704-9d78-462d-a13f-cebce5be74f5 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:14:34.421890 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4035f6-cbd4-4af8-8d8b-603f350c3505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:14:34.422506 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4035f6-cbd4-4af8-8d8b-603f350c3505 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:14:34.422774 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4035f6-cbd4-4af8-8d8b-603f350c3505 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:14:34.423037 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4035f6-cbd4-4af8-8d8b-603f350c3505 admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:14:34.423698 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4035f6-cbd4-4af8-8d8b-603f350c3505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:14:34.425271 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4035f6-cbd4-4af8-8d8b-603f350c3505 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:14:34.435927 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1430/2852] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:14:34 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:14:34.440281 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6f956-383c-4b10-8b8a-9dab7b041279 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:14:34.451081 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6f956-383c-4b10-8b8a-9dab7b041279 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:14:34.455935 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa6a629-724e-47ed-a481-969506145396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:14:34.456608 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6a629-724e-47ed-a481-969506145396 admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:14:34.456886 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6a629-724e-47ed-a481-969506145396 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:14:34.457158 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6a629-724e-47ed-a481-969506145396 admin admin] PATH_INFO: `/v3/projects/e1b6c023d20d45a3be06c2c2a15e57bb/users/061053c29d054a5ab03a9055f8ccb751/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:14:34.459120 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa6a629-724e-47ed-a481-969506145396 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1b6c023d20d45a3be06c2c2a15e57bb, user_id=061053c29d054a5ab03a9055f8ccb751, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:14:34.461820 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa6a629-724e-47ed-a481-969506145396 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:14:34.473337 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1423/2853] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 20:14:34 2022] PUT /identity/v3/projects/e1b6c023d20d45a3be06c2c2a15e57bb/users/061053c29d054a5ab03a9055f8ccb751/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:14:34.487485 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04b3f6-a2c1-4f9c-9e0b-425ba967036c None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:14:34.487830 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04b3f6-a2c1-4f9c-9e0b-425ba967036c None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:14:34.488120 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04b3f6-a2c1-4f9c-9e0b-425ba967036c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:14:34.518057 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-6c04b3f6-a2c1-4f9c-9e0b-425ba967036c None None] MFA Rules not processed for user `061053c29d054a5ab03a9055f8ccb751`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:14:34.519192 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-6c04b3f6-a2c1-4f9c-9e0b-425ba967036c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:14:34.589120 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1431/2854] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:14:34 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:14:34.600789 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa6a629-724e-47ed-a481-969506145396 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:14:34.602553 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-9fa6a629-724e-47ed-a481-969506145396 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:14:34.664472 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa6a629-724e-47ed-a481-969506145396 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:14:34.669547 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ce8c9b-ca0f-4cca-a947-20a9d09a15a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:14:34.670174 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce8c9b-ca0f-4cca-a947-20a9d09a15a1 service cinder] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:14:34.670457 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce8c9b-ca0f-4cca-a947-20a9d09a15a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:14:34.670731 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce8c9b-ca0f-4cca-a947-20a9d09a15a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:14:34.680646 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ce8c9b-ca0f-4cca-a947-20a9d09a15a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:14:34.682119 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ce8c9b-ca0f-4cca-a947-20a9d09a15a1 service cinder] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:14:34.693058 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1424/2855] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:14:34 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:14:34.760460 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04b3f6-a2c1-4f9c-9e0b-425ba967036c None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:14:34.772327 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:14:34.828681 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04b3f6-a2c1-4f9c-9e0b-425ba967036c None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:14:34.834162 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad7c4f-f687-4ead-9a75-ef9874a44bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:14:34.834804 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad7c4f-f687-4ead-9a75-ef9874a44bcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:14:34.835089 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad7c4f-f687-4ead-9a75-ef9874a44bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:14:34.835358 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad7c4f-f687-4ead-9a75-ef9874a44bcb admin admin] PATH_INFO: `/v3/users/d5d59f8db168414f9663cc53c37d5f1f` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:14:34.836541 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ad7c4f-f687-4ead-9a75-ef9874a44bcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5d59f8db168414f9663cc53c37d5f1f)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:14:34.838519 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ad7c4f-f687-4ead-9a75-ef9874a44bcb admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:14:35.009077 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-a6ad7c4f-f687-4ead-9a75-ef9874a44bcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5d59f8db168414f9663cc53c37d5f1f'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:14:35.077198 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-a6ad7c4f-f687-4ead-9a75-ef9874a44bcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5d59f8db168414f9663cc53c37d5f1f'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:14:35.077857 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-a6ad7c4f-f687-4ead-9a75-ef9874a44bcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5d59f8db168414f9663cc53c37d5f1f'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:14:35.078463 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-a6ad7c4f-f687-4ead-9a75-ef9874a44bcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5d59f8db168414f9663cc53c37d5f1f'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:14:35.091812 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-a6ad7c4f-f687-4ead-9a75-ef9874a44bcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5d59f8db168414f9663cc53c37d5f1f'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:14:35.106402 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1432/2856] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 20:14:34 2022] DELETE /identity/v3/users/d5d59f8db168414f9663cc53c37d5f1f => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:14:35.111021 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58b72e-9fb5-40f2-a8ef-3aaf9ccd0daf None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:14:35.111311 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58b72e-9fb5-40f2-a8ef-3aaf9ccd0daf None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:14:35.111588 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58b72e-9fb5-40f2-a8ef-3aaf9ccd0daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:14:35.130805 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-1e58b72e-9fb5-40f2-a8ef-3aaf9ccd0daf None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:14:35.132037 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-1e58b72e-9fb5-40f2-a8ef-3aaf9ccd0daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:14:35.193757 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1425/2857] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:14:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:14:35.204066 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad7c4f-f687-4ead-9a75-ef9874a44bcb admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:14:35.205584 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-a6ad7c4f-f687-4ead-9a75-ef9874a44bcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:14:35.266211 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad7c4f-f687-4ead-9a75-ef9874a44bcb admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:14:35.269915 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe2bf7-6cb8-482d-b677-56289c5bb96e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:14:35.270520 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe2bf7-6cb8-482d-b677-56289c5bb96e service neutron] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:14:35.270791 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe2bf7-6cb8-482d-b677-56289c5bb96e service neutron] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:14:35.271114 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe2bf7-6cb8-482d-b677-56289c5bb96e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:14:35.281182 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fe2bf7-6cb8-482d-b677-56289c5bb96e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:14:35.282647 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fe2bf7-6cb8-482d-b677-56289c5bb96e service neutron] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:14:35.293565 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1433/2858] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:14:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:14:35.736795 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e58b72e-9fb5-40f2-a8ef-3aaf9ccd0daf None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:14:35.738323 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-1e58b72e-9fb5-40f2-a8ef-3aaf9ccd0daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:14:35.750820 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e58b72e-9fb5-40f2-a8ef-3aaf9ccd0daf None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:14:35.755479 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ebe1a3-b949-4def-842a-f26a6ee42b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:14:35.756118 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ebe1a3-b949-4def-842a-f26a6ee42b5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:14:35.756401 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ebe1a3-b949-4def-842a-f26a6ee42b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:14:35.756674 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ebe1a3-b949-4def-842a-f26a6ee42b5e admin admin] PATH_INFO: `/v3/projects/af0d7fe910924043b76578954528ec51` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:14:35.757854 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ebe1a3-b949-4def-842a-f26a6ee42b5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=af0d7fe910924043b76578954528ec51)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:14:35.759771 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ebe1a3-b949-4def-842a-f26a6ee42b5e admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:14:35.860735 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-d3ebe1a3-b949-4def-842a-f26a6ee42b5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af0d7fe910924043b76578954528ec51', 'request_id': 'req-d3ebe1a3-b949-4def-842a-f26a6ee42b5e'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:14:35.863460 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:INSERT=5,keystone:SELECT=91,keystone:DELETE=4 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:14:35.979626 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-d3ebe1a3-b949-4def-842a-f26a6ee42b5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af0d7fe910924043b76578954528ec51', 'request_id': 'req-d3ebe1a3-b949-4def-842a-f26a6ee42b5e'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:14:35.985736 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-d3ebe1a3-b949-4def-842a-f26a6ee42b5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af0d7fe910924043b76578954528ec51', 'request_id': 'req-d3ebe1a3-b949-4def-842a-f26a6ee42b5e'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:14:35.997191 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-d3ebe1a3-b949-4def-842a-f26a6ee42b5e admin admin] The token cache is being invalidate because project af0d7fe910924043b76578954528ec51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 20:14:35.997486 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-d3ebe1a3-b949-4def-842a-f26a6ee42b5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:14:35.998175 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-d3ebe1a3-b949-4def-842a-f26a6ee42b5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:14:35.999958 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1426/2859] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 20:14:35 2022] DELETE /identity/v3/projects/af0d7fe910924043b76578954528ec51 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:14:36.003874 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe2bf7-6cb8-482d-b677-56289c5bb96e service neutron] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:14:36.014644 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe2bf7-6cb8-482d-b677-56289c5bb96e service neutron] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:14:36.045509 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:14:36.075476 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d089d19-983c-4bf1-8f4c-6480e5ee78dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:14:36.076139 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d089d19-983c-4bf1-8f4c-6480e5ee78dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:14:36.076418 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d089d19-983c-4bf1-8f4c-6480e5ee78dd admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:14:36.076689 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d089d19-983c-4bf1-8f4c-6480e5ee78dd admin admin] PATH_INFO: `/v3/users/061053c29d054a5ab03a9055f8ccb751` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:14:36.078002 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d089d19-983c-4bf1-8f4c-6480e5ee78dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=061053c29d054a5ab03a9055f8ccb751)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:14:36.079998 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d089d19-983c-4bf1-8f4c-6480e5ee78dd admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:14:36.306307 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-7d089d19-983c-4bf1-8f4c-6480e5ee78dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '061053c29d054a5ab03a9055f8ccb751'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:14:36.377645 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-7d089d19-983c-4bf1-8f4c-6480e5ee78dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '061053c29d054a5ab03a9055f8ccb751'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:14:36.378266 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-7d089d19-983c-4bf1-8f4c-6480e5ee78dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '061053c29d054a5ab03a9055f8ccb751'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:14:36.379063 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-7d089d19-983c-4bf1-8f4c-6480e5ee78dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '061053c29d054a5ab03a9055f8ccb751'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:14:36.392605 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-7d089d19-983c-4bf1-8f4c-6480e5ee78dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '061053c29d054a5ab03a9055f8ccb751'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:14:36.404939 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1434/2860] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 20:14:36 2022] DELETE /identity/v3/users/061053c29d054a5ab03a9055f8ccb751 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:14:36.821744 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ebe1a3-b949-4def-842a-f26a6ee42b5e admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:14:36.823907 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-d3ebe1a3-b949-4def-842a-f26a6ee42b5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:14:36.841281 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ebe1a3-b949-4def-842a-f26a6ee42b5e admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:14:36.902856 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e72fce-6565-4588-83dd-407801be6544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:14:36.903525 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e72fce-6565-4588-83dd-407801be6544 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:14:36.903905 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e72fce-6565-4588-83dd-407801be6544 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:14:36.904268 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e72fce-6565-4588-83dd-407801be6544 admin admin] PATH_INFO: `/v3/projects/e1b6c023d20d45a3be06c2c2a15e57bb` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:14:36.905300 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e72fce-6565-4588-83dd-407801be6544 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1b6c023d20d45a3be06c2c2a15e57bb)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:14:36.907428 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e72fce-6565-4588-83dd-407801be6544 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:14:37.009953 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-a4e72fce-6565-4588-83dd-407801be6544 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1b6c023d20d45a3be06c2c2a15e57bb', 'request_id': 'req-a4e72fce-6565-4588-83dd-407801be6544'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:14:37.094234 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-a4e72fce-6565-4588-83dd-407801be6544 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1b6c023d20d45a3be06c2c2a15e57bb', 'request_id': 'req-a4e72fce-6565-4588-83dd-407801be6544'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:14:37.100614 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-a4e72fce-6565-4588-83dd-407801be6544 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1b6c023d20d45a3be06c2c2a15e57bb', 'request_id': 'req-a4e72fce-6565-4588-83dd-407801be6544'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:14:37.112938 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-a4e72fce-6565-4588-83dd-407801be6544 admin admin] The token cache is being invalidate because project e1b6c023d20d45a3be06c2c2a15e57bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 20:14:37.113222 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-a4e72fce-6565-4588-83dd-407801be6544 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:14:37.113922 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-a4e72fce-6565-4588-83dd-407801be6544 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:14:37.115765 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1427/2861] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 20:14:36 2022] DELETE /identity/v3/projects/e1b6c023d20d45a3be06c2c2a15e57bb => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:14:37.121395 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c11129-b2cb-47b3-898b-28ed07dc7008 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:14:37.121699 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c11129-b2cb-47b3-898b-28ed07dc7008 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:14:37.122099 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c11129-b2cb-47b3-898b-28ed07dc7008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:14:37.142889 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-44c11129-b2cb-47b3-898b-28ed07dc7008 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:14:37.144120 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-44c11129-b2cb-47b3-898b-28ed07dc7008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:14:37.206267 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1435/2862] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:14:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:14:37.214658 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118652d6-b512-4ba4-ab61-d09dc2035dac None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:14:37.214961 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118652d6-b512-4ba4-ab61-d09dc2035dac None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:14:37.215240 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118652d6-b512-4ba4-ab61-d09dc2035dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:14:37.236671 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-118652d6-b512-4ba4-ab61-d09dc2035dac None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:14:37.237935 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-118652d6-b512-4ba4-ab61-d09dc2035dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:14:37.246821 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1428/2863] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:14:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:14:37.251324 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c11129-b2cb-47b3-898b-28ed07dc7008 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:14:37.262637 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c11129-b2cb-47b3-898b-28ed07dc7008 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:14:37.267914 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ce7fd-c521-44e8-ad7a-a2b63f009e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:14:37.268520 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ce7fd-c521-44e8-ad7a-a2b63f009e1b admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:14:37.268802 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ce7fd-c521-44e8-ad7a-a2b63f009e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:14:37.269072 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ce7fd-c521-44e8-ad7a-a2b63f009e1b admin admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:14:37.269760 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0ce7fd-c521-44e8-ad7a-a2b63f009e1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:14:37.270191 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0ce7fd-c521-44e8-ad7a-a2b63f009e1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:14:37.271829 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0ce7fd-c521-44e8-ad7a-a2b63f009e1b admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:14:37.284458 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1436/2864] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 20:14:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:14:37.288818 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118652d6-b512-4ba4-ab61-d09dc2035dac None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:14:37.299206 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118652d6-b512-4ba4-ab61-d09dc2035dac None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:14:37.310526 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f939b6-d692-4fb5-9e4d-bc6d0771ce58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:14:37.310526 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f939b6-d692-4fb5-9e4d-bc6d0771ce58 admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:14:37.310526 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f939b6-d692-4fb5-9e4d-bc6d0771ce58 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:14:37.310526 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f939b6-d692-4fb5-9e4d-bc6d0771ce58 admin admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:14:37.310975 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f939b6-d692-4fb5-9e4d-bc6d0771ce58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:14:37.310975 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f939b6-d692-4fb5-9e4d-bc6d0771ce58 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:14:37.422960 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1429/2865] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 20:14:37 2022] POST /identity/v3/projects => generated 371 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:14:37.426974 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ce7fd-c521-44e8-ad7a-a2b63f009e1b admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:14:37.438191 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ce7fd-c521-44e8-ad7a-a2b63f009e1b admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:14:37.473383 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:14:37.498593 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf047cd-e3b9-4e46-aca9-59487374f833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:14:37.499215 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf047cd-e3b9-4e46-aca9-59487374f833 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:14:37.499489 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf047cd-e3b9-4e46-aca9-59487374f833 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:14:37.499757 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf047cd-e3b9-4e46-aca9-59487374f833 admin admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:14:37.500401 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf047cd-e3b9-4e46-aca9-59487374f833 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:14:37.502359 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf047cd-e3b9-4e46-aca9-59487374f833 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:14:37.646803 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1437/2866] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 20:14:37 2022] POST /identity/v3/users => generated 286 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 20:14:37.651006 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f939b6-d692-4fb5-9e4d-bc6d0771ce58 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:14:37.662387 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f939b6-d692-4fb5-9e4d-bc6d0771ce58 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:14:37.669392 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9168a567-b9e8-4662-83eb-3304ad2cc7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:14:37.670212 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168a567-b9e8-4662-83eb-3304ad2cc7da admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:14:37.670640 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168a567-b9e8-4662-83eb-3304ad2cc7da admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:14:37.671030 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168a567-b9e8-4662-83eb-3304ad2cc7da admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:14:37.671952 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9168a567-b9e8-4662-83eb-3304ad2cc7da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:14:37.674504 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9168a567-b9e8-4662-83eb-3304ad2cc7da admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:14:37.687381 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1430/2867] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:14:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:14:37.691463 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf047cd-e3b9-4e46-aca9-59487374f833 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:14:37.702130 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf047cd-e3b9-4e46-aca9-59487374f833 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:14:37.706862 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1689868b-74c2-45e6-893a-6bff7c01b574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:14:37.707451 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689868b-74c2-45e6-893a-6bff7c01b574 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:14:37.707721 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689868b-74c2-45e6-893a-6bff7c01b574 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:14:37.707984 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689868b-74c2-45e6-893a-6bff7c01b574 admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:14:37.708617 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1689868b-74c2-45e6-893a-6bff7c01b574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:14:37.710246 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1689868b-74c2-45e6-893a-6bff7c01b574 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:14:37.720234 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1438/2868] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:14:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:14:37.724449 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9168a567-b9e8-4662-83eb-3304ad2cc7da admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:14:37.735336 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9168a567-b9e8-4662-83eb-3304ad2cc7da admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:14:37.740022 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a9fae1-2548-47f5-b6bb-e8ead25d524d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:14:37.740667 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9fae1-2548-47f5-b6bb-e8ead25d524d admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:14:37.740949 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9fae1-2548-47f5-b6bb-e8ead25d524d admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:14:37.741217 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9fae1-2548-47f5-b6bb-e8ead25d524d admin admin] PATH_INFO: `/v3/projects/b48ac24463cc43558c206232e406d551/users/9344b0bbd81c4d629a3294169f19d87a/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:14:37.756817 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a9fae1-2548-47f5-b6bb-e8ead25d524d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b48ac24463cc43558c206232e406d551, user_id=9344b0bbd81c4d629a3294169f19d87a, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:14:37.759559 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a9fae1-2548-47f5-b6bb-e8ead25d524d admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:14:37.844745 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1431/2869] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 20:14:37 2022] PUT /identity/v3/projects/b48ac24463cc43558c206232e406d551/users/9344b0bbd81c4d629a3294169f19d87a/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:14:37.859144 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ebb95-e027-4af2-8e67-46a97d088cad None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:14:37.859607 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ebb95-e027-4af2-8e67-46a97d088cad None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:14:37.860075 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ebb95-e027-4af2-8e67-46a97d088cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:14:37.891034 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-df9ebb95-e027-4af2-8e67-46a97d088cad None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:14:37.892949 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-df9ebb95-e027-4af2-8e67-46a97d088cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:14:37.954610 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1439/2870] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:14:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:14:37.965033 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a9fae1-2548-47f5-b6bb-e8ead25d524d admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:14:37.966908 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-49a9fae1-2548-47f5-b6bb-e8ead25d524d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:14:37.977338 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:14:38.033665 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a9fae1-2548-47f5-b6bb-e8ead25d524d admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:14:38.037372 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1706dc71-fe70-4dd3-b3b3-798d5279390b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:14:38.038053 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706dc71-fe70-4dd3-b3b3-798d5279390b service neutron] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:14:38.038355 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706dc71-fe70-4dd3-b3b3-798d5279390b service neutron] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:14:38.038623 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706dc71-fe70-4dd3-b3b3-798d5279390b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:14:38.049222 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1706dc71-fe70-4dd3-b3b3-798d5279390b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:14:38.050691 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1706dc71-fe70-4dd3-b3b3-798d5279390b service neutron] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:14:38.061081 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1432/2871] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:14:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:14:39.461196 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bcfd9e-366c-470f-9431-712fd77c81dc None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:14:39.461795 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bcfd9e-366c-470f-9431-712fd77c81dc None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:14:39.461795 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bcfd9e-366c-470f-9431-712fd77c81dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:14:39.492308 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-62bcfd9e-366c-470f-9431-712fd77c81dc None None] MFA Rules not processed for user `9344b0bbd81c4d629a3294169f19d87a`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:14:39.493744 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-62bcfd9e-366c-470f-9431-712fd77c81dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:14:39.566632 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1440/2872] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:14:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:14:39.571425 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1706dc71-fe70-4dd3-b3b3-798d5279390b service neutron] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:14:39.585414 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1706dc71-fe70-4dd3-b3b3-798d5279390b service neutron] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:14:39.590941 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b1793-9ab5-4455-81ec-647e15ff42d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:14:39.591562 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b1793-9ab5-4455-81ec-647e15ff42d1 admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:14:39.591869 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b1793-9ab5-4455-81ec-647e15ff42d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:14:39.592139 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b1793-9ab5-4455-81ec-647e15ff42d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:14:39.592784 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5b1793-9ab5-4455-81ec-647e15ff42d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:14:39.594698 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5b1793-9ab5-4455-81ec-647e15ff42d1 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:14:39.678738 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1433/2873] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 20:14:39 2022] POST /identity/v3/projects => generated 373 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:14:39.683570 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bcfd9e-366c-470f-9431-712fd77c81dc None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:14:39.694418 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bcfd9e-366c-470f-9431-712fd77c81dc None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:14:39.742162 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:14:39.755001 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfaa474-7f7f-44ff-9dae-d8d76eb97335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:14:39.755662 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfaa474-7f7f-44ff-9dae-d8d76eb97335 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:14:39.755970 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfaa474-7f7f-44ff-9dae-d8d76eb97335 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:14:39.756241 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfaa474-7f7f-44ff-9dae-d8d76eb97335 admin admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:14:39.756885 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfaa474-7f7f-44ff-9dae-d8d76eb97335 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:14:39.758830 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfaa474-7f7f-44ff-9dae-d8d76eb97335 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:14:39.889247 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1441/2874] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 20:14:39 2022] POST /identity/v3/users => generated 293 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 20:14:39.893486 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b1793-9ab5-4455-81ec-647e15ff42d1 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:14:39.905292 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b1793-9ab5-4455-81ec-647e15ff42d1 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:14:39.909982 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5329a9-84fd-43da-9fa5-76a9fef44f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:14:39.911751 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5329a9-84fd-43da-9fa5-76a9fef44f53 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:14:39.911751 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5329a9-84fd-43da-9fa5-76a9fef44f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:14:39.911751 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5329a9-84fd-43da-9fa5-76a9fef44f53 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:14:39.911751 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5329a9-84fd-43da-9fa5-76a9fef44f53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:14:39.913321 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5329a9-84fd-43da-9fa5-76a9fef44f53 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:14:39.924986 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1434/2875] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:14:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:14:39.929399 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfaa474-7f7f-44ff-9dae-d8d76eb97335 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:14:39.940627 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfaa474-7f7f-44ff-9dae-d8d76eb97335 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:14:39.945361 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6598719-999b-4d62-87b8-64b2dc6a88da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:14:39.946049 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6598719-999b-4d62-87b8-64b2dc6a88da admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:14:39.946329 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6598719-999b-4d62-87b8-64b2dc6a88da admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:14:39.946607 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6598719-999b-4d62-87b8-64b2dc6a88da admin admin] PATH_INFO: `/v3/projects/709dcaf9cc2244c7bc724e3becded8b8/users/152bd3aef9304371aaab4f73b30e9e95/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:14:39.963109 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6598719-999b-4d62-87b8-64b2dc6a88da admin admin] RBAC: Authorizing `identity:create_grant(project_id=709dcaf9cc2244c7bc724e3becded8b8, user_id=152bd3aef9304371aaab4f73b30e9e95, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:14:39.967054 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6598719-999b-4d62-87b8-64b2dc6a88da admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:14:40.053367 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1442/2876] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 20:14:39 2022] PUT /identity/v3/projects/709dcaf9cc2244c7bc724e3becded8b8/users/152bd3aef9304371aaab4f73b30e9e95/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:14:40.057940 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5329a9-84fd-43da-9fa5-76a9fef44f53 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:14:40.068570 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5329a9-84fd-43da-9fa5-76a9fef44f53 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:14:40.127230 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d5380-ba29-468f-b678-801134df0594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:14:40.127839 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d5380-ba29-468f-b678-801134df0594 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:14:40.128118 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d5380-ba29-468f-b678-801134df0594 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:14:40.128388 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d5380-ba29-468f-b678-801134df0594 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:14:40.129028 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072d5380-ba29-468f-b678-801134df0594 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:14:40.130919 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072d5380-ba29-468f-b678-801134df0594 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:14:40.141684 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1435/2877] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:14:40.145881 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6598719-999b-4d62-87b8-64b2dc6a88da admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:14:40.156377 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6598719-999b-4d62-87b8-64b2dc6a88da admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:14:40.161150 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cdb0bf-5b62-411e-b27d-061cd42e77d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:14:40.161828 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cdb0bf-5b62-411e-b27d-061cd42e77d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:14:40.162101 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cdb0bf-5b62-411e-b27d-061cd42e77d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:14:40.162365 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cdb0bf-5b62-411e-b27d-061cd42e77d1 admin admin] PATH_INFO: `/v3/projects/709dcaf9cc2244c7bc724e3becded8b8/users/152bd3aef9304371aaab4f73b30e9e95/roles/f022705fa6ce43828345ef50b3f7efc9` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:14:40.164257 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cdb0bf-5b62-411e-b27d-061cd42e77d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=709dcaf9cc2244c7bc724e3becded8b8, user_id=152bd3aef9304371aaab4f73b30e9e95, role_id=f022705fa6ce43828345ef50b3f7efc9)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:14:40.166961 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cdb0bf-5b62-411e-b27d-061cd42e77d1 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:14:40.177264 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1443/2878] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 20:14:40 2022] PUT /identity/v3/projects/709dcaf9cc2244c7bc724e3becded8b8/users/152bd3aef9304371aaab4f73b30e9e95/roles/f022705fa6ce43828345ef50b3f7efc9 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:14:41.829267 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4007cb7-5ad3-4acb-bcaf-5c2a7dfeb20b None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:14:41.829904 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4007cb7-5ad3-4acb-bcaf-5c2a7dfeb20b None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:14:41.829904 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4007cb7-5ad3-4acb-bcaf-5c2a7dfeb20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:14:41.861189 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-d4007cb7-5ad3-4acb-bcaf-5c2a7dfeb20b None None] MFA Rules not processed for user `152bd3aef9304371aaab4f73b30e9e95`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:14:41.862498 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-d4007cb7-5ad3-4acb-bcaf-5c2a7dfeb20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:14:41.933852 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:14:41.939145 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1436/2879] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:14:41 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:14:41.950574 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d822b-e33d-415e-a2b2-3bb848c76cf0 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:14:41.951165 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d822b-e33d-415e-a2b2-3bb848c76cf0 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:14:41.951165 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d822b-e33d-415e-a2b2-3bb848c76cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:14:41.972346 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-2b6d822b-e33d-415e-a2b2-3bb848c76cf0 None None] MFA Rules not processed for user `9344b0bbd81c4d629a3294169f19d87a`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:14:41.973601 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-2b6d822b-e33d-415e-a2b2-3bb848c76cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:14:42.039217 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1444/2880] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:14:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:14:42.053613 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4007cb7-5ad3-4acb-bcaf-5c2a7dfeb20b None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:14:42.055074 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-d4007cb7-5ad3-4acb-bcaf-5c2a7dfeb20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:14:42.138489 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4007cb7-5ad3-4acb-bcaf-5c2a7dfeb20b None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:14:42.144042 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e933b-3db3-4330-b3c5-011dbb76b907 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5047a59bc4547be643ffa78808a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:14:42.144689 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e933b-3db3-4330-b3c5-011dbb76b907 service nova] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:14:42.144970 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e933b-3db3-4330-b3c5-011dbb76b907 service nova] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:14:42.145245 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e933b-3db3-4330-b3c5-011dbb76b907 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:14:42.154371 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e933b-3db3-4330-b3c5-011dbb76b907 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:14:42.155955 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e933b-3db3-4330-b3c5-011dbb76b907 service nova] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:14:42.164964 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1437/2881] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:14:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:14:52.032157 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=48,keystone:INSERT=5 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:14:52.160981 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=35 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:15:01.515831 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d822b-e33d-415e-a2b2-3bb848c76cf0 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:15:01.517351 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-2b6d822b-e33d-415e-a2b2-3bb848c76cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:15:01.579023 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d822b-e33d-415e-a2b2-3bb848c76cf0 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:15:01.583093 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc3e581-5df4-460e-89b2-7371f3c4ec81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:15:01.583712 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3e581-5df4-460e-89b2-7371f3c4ec81 service cinder] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:15:01.583989 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3e581-5df4-460e-89b2-7371f3c4ec81 service cinder] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:15:01.584261 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3e581-5df4-460e-89b2-7371f3c4ec81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:15:01.594684 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc3e581-5df4-460e-89b2-7371f3c4ec81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:15:01.596116 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc3e581-5df4-460e-89b2-7371f3c4ec81 service cinder] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:15:01.605962 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1445/2882] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:15:01 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:15:02.734817 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e933b-3db3-4330-b3c5-011dbb76b907 service nova] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:15:02.792454 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e933b-3db3-4330-b3c5-011dbb76b907 service nova] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:15:02.796603 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9546f3-2b7f-4d2b-95db-2bcb443b7c13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:15:02.797201 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9546f3-2b7f-4d2b-95db-2bcb443b7c13 service neutron] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:15:02.797476 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9546f3-2b7f-4d2b-95db-2bcb443b7c13 service neutron] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:15:02.797774 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9546f3-2b7f-4d2b-95db-2bcb443b7c13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:15:02.799568 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-ed9546f3-2b7f-4d2b-95db-2bcb443b7c13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:15:02.813846 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9546f3-2b7f-4d2b-95db-2bcb443b7c13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:15:02.815284 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9546f3-2b7f-4d2b-95db-2bcb443b7c13 service neutron] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:15:02.827019 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1438/2883] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:15:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:15:02.834653 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc3e581-5df4-460e-89b2-7371f3c4ec81 service cinder] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:15:02.844989 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc3e581-5df4-460e-89b2-7371f3c4ec81 service cinder] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:15:02.848710 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e865b174-0b6c-40f8-8e21-812bfcd9040d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:15:02.849347 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865b174-0b6c-40f8-8e21-812bfcd9040d service neutron] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:15:02.856432 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865b174-0b6c-40f8-8e21-812bfcd9040d service neutron] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:15:02.856432 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865b174-0b6c-40f8-8e21-812bfcd9040d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:15:02.856432 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-e865b174-0b6c-40f8-8e21-812bfcd9040d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:15:02.882467 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application [None req-e865b174-0b6c-40f8-8e21-812bfcd9040d service neutron] Could not find project: bf05261a41ac4e2389d3c3708022674b.: keystone.exception.ProjectNotFound: Could not find project: bf05261a41ac4e2389d3c3708022674b. Sep 24 20:15:02.882467 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:15:02.882467 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:15:02.882467 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:15:02.882467 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:15:02.882467 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:15:02.882467 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:15:02.882467 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:15:02.882467 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:15:02.882467 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:15:02.882467 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:15:02.882467 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:15:02.882467 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Sep 24 20:15:02.882467 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Sep 24 20:15:02.882467 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Sep 24 20:15:02.883842 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Sep 24 20:15:02.883842 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Sep 24 20:15:02.883842 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Sep 24 20:15:02.883842 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:15:02.883842 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:15:02.883842 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 145, in validate_token Sep 24 20:15:02.883842 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application token = self._validate_token(token_id) Sep 24 20:15:02.883842 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:15:02.883842 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:15:02.883842 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:15:02.883842 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:15:02.883842 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:15:02.883842 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 20:15:02.883842 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:15:02.883842 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:15:02.883842 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:15:02.883842 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:15:02.885302 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:15:02.885302 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:15:02.885302 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:15:02.885302 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:15:02.885302 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 179, in _validate_token Sep 24 20:15:02.885302 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application token.mint(token_id, issued_at) Sep 24 20:15:02.885302 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 579, in mint Sep 24 20:15:02.885302 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application self._validate_token_resources() Sep 24 20:15:02.885302 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 464, in _validate_token_resources Sep 24 20:15:02.885302 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application if self.project and not self.project.get('enabled'): Sep 24 20:15:02.885302 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 162, in project Sep 24 20:15:02.885302 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application self.__project = PROVIDERS.resource_api.get_project( Sep 24 20:15:02.885302 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:15:02.885302 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:15:02.885302 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:15:02.885302 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:15:02.885302 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:15:02.886497 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:15:02.886497 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:15:02.886497 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application with Lock( Sep 24 20:15:02.886497 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:15:02.886497 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:15:02.886497 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:15:02.886497 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:15:02.886497 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:15:02.886497 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:15:02.886497 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:15:02.886497 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:15:02.886497 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 20:15:02.886497 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 20:15:02.886497 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 20:15:02.886497 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 20:15:02.886497 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 20:15:02.886497 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 20:15:02.888356 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: bf05261a41ac4e2389d3c3708022674b. Sep 24 20:15:02.888356 dv-cinder-859191-1-smb devstack@keystone.service[93399]: ERROR keystone.server.flask.application Sep 24 20:15:02.888356 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1446/2884] 10.222.0.60 () {60 vars in 1396 bytes} [Sat Sep 24 20:15:02 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 113 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 24 20:15:02.915429 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b88852-df59-4bb3-817d-ff94e4e25c82 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:15:02.915429 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b88852-df59-4bb3-817d-ff94e4e25c82 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:15:02.922731 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b88852-df59-4bb3-817d-ff94e4e25c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:15:02.956521 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-26b88852-df59-4bb3-817d-ff94e4e25c82 None None] MFA Rules not processed for user `f3b5047a59bc4547be643ffa78808a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:15:02.957669 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-26b88852-df59-4bb3-817d-ff94e4e25c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:15:02.967759 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1439/2885] 10.222.0.60 () {58 vars in 1009 bytes} [Sat Sep 24 20:15:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:15:02.977907 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e865b174-0b6c-40f8-8e21-812bfcd9040d service neutron] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:15:02.988223 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e865b174-0b6c-40f8-8e21-812bfcd9040d service neutron] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:15:02.992164 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de97f056-730c-4b78-b6f1-8f5418782722 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:15:02.992842 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97f056-730c-4b78-b6f1-8f5418782722 service neutron] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:15:02.993549 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97f056-730c-4b78-b6f1-8f5418782722 service neutron] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:15:02.993549 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97f056-730c-4b78-b6f1-8f5418782722 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:15:03.005606 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de97f056-730c-4b78-b6f1-8f5418782722 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:15:03.007125 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de97f056-730c-4b78-b6f1-8f5418782722 service neutron] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:15:03.019041 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1447/2886] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:15:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:15:12.953536 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=35 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:15:13.014162 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=36 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:15:26.031532 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b88852-df59-4bb3-817d-ff94e4e25c82 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:15:26.033216 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-26b88852-df59-4bb3-817d-ff94e4e25c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:15:26.108868 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b88852-df59-4bb3-817d-ff94e4e25c82 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:15:26.113884 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31853aa4-24ee-4b81-8f9e-82dacddb52ca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f19f1385114fa5a921999747a6666b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:15:26.114491 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31853aa4-24ee-4b81-8f9e-82dacddb52ca service placement] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:15:26.114772 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31853aa4-24ee-4b81-8f9e-82dacddb52ca service placement] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:15:26.115065 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31853aa4-24ee-4b81-8f9e-82dacddb52ca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:15:26.116817 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-31853aa4-24ee-4b81-8f9e-82dacddb52ca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:15:26.128809 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31853aa4-24ee-4b81-8f9e-82dacddb52ca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:15:26.130411 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31853aa4-24ee-4b81-8f9e-82dacddb52ca service placement] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:15:26.141201 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1440/2887] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:15:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:15:26.173842 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de97f056-730c-4b78-b6f1-8f5418782722 service neutron] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:15:26.240684 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de97f056-730c-4b78-b6f1-8f5418782722 service neutron] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:15:26.245328 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9748e96-a84d-4b69-844d-fd88e2b60fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:15:26.246045 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9748e96-a84d-4b69-844d-fd88e2b60fda admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:15:26.246327 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9748e96-a84d-4b69-844d-fd88e2b60fda admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:15:26.246598 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9748e96-a84d-4b69-844d-fd88e2b60fda admin admin] PATH_INFO: `/v3/users/9344b0bbd81c4d629a3294169f19d87a` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:15:26.247773 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9748e96-a84d-4b69-844d-fd88e2b60fda admin admin] RBAC: Authorizing `identity:delete_user(user_id=9344b0bbd81c4d629a3294169f19d87a)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:15:26.249862 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9748e96-a84d-4b69-844d-fd88e2b60fda admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:15:26.416757 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-e9748e96-a84d-4b69-844d-fd88e2b60fda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9344b0bbd81c4d629a3294169f19d87a'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:15:26.478754 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-e9748e96-a84d-4b69-844d-fd88e2b60fda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9344b0bbd81c4d629a3294169f19d87a'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:15:26.479365 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-e9748e96-a84d-4b69-844d-fd88e2b60fda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9344b0bbd81c4d629a3294169f19d87a'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:15:26.479963 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-e9748e96-a84d-4b69-844d-fd88e2b60fda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9344b0bbd81c4d629a3294169f19d87a'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:15:26.492779 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-e9748e96-a84d-4b69-844d-fd88e2b60fda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9344b0bbd81c4d629a3294169f19d87a'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:15:26.506432 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1448/2888] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 20:15:26 2022] DELETE /identity/v3/users/9344b0bbd81c4d629a3294169f19d87a => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:15:26.780035 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31853aa4-24ee-4b81-8f9e-82dacddb52ca service placement] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:15:26.791178 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31853aa4-24ee-4b81-8f9e-82dacddb52ca service placement] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:15:26.866957 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909d493-444f-4cca-a331-229be436bcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:15:26.867740 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909d493-444f-4cca-a331-229be436bcd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:15:26.868056 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909d493-444f-4cca-a331-229be436bcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:15:26.868370 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909d493-444f-4cca-a331-229be436bcd6 admin admin] PATH_INFO: `/v3/projects/b48ac24463cc43558c206232e406d551` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:15:26.869861 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c909d493-444f-4cca-a331-229be436bcd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b48ac24463cc43558c206232e406d551)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:15:26.872216 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c909d493-444f-4cca-a331-229be436bcd6 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:15:27.010659 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-c909d493-444f-4cca-a331-229be436bcd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b48ac24463cc43558c206232e406d551', 'request_id': 'req-c909d493-444f-4cca-a331-229be436bcd6'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:15:27.104556 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-c909d493-444f-4cca-a331-229be436bcd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b48ac24463cc43558c206232e406d551', 'request_id': 'req-c909d493-444f-4cca-a331-229be436bcd6'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:15:27.111458 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-c909d493-444f-4cca-a331-229be436bcd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b48ac24463cc43558c206232e406d551', 'request_id': 'req-c909d493-444f-4cca-a331-229be436bcd6'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:15:27.123244 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-c909d493-444f-4cca-a331-229be436bcd6 admin admin] The token cache is being invalidate because project b48ac24463cc43558c206232e406d551 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 20:15:27.123536 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-c909d493-444f-4cca-a331-229be436bcd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:15:27.124192 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-c909d493-444f-4cca-a331-229be436bcd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:15:27.125721 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1441/2889] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 20:15:26 2022] DELETE /identity/v3/projects/b48ac24463cc43558c206232e406d551 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 20:15:27.130052 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9748e96-a84d-4b69-844d-fd88e2b60fda admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:15:27.131471 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-e9748e96-a84d-4b69-844d-fd88e2b60fda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:15:27.145345 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9748e96-a84d-4b69-844d-fd88e2b60fda admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:15:27.212151 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23b005-c5b9-426d-b275-5dbcb620f215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:15:27.212890 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23b005-c5b9-426d-b275-5dbcb620f215 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:15:27.213124 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23b005-c5b9-426d-b275-5dbcb620f215 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:15:27.213399 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23b005-c5b9-426d-b275-5dbcb620f215 admin admin] PATH_INFO: `/v3/users/152bd3aef9304371aaab4f73b30e9e95` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:15:27.214606 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a23b005-c5b9-426d-b275-5dbcb620f215 admin admin] RBAC: Authorizing `identity:delete_user(user_id=152bd3aef9304371aaab4f73b30e9e95)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:15:27.217892 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a23b005-c5b9-426d-b275-5dbcb620f215 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:15:27.243605 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:15:27.439368 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-2a23b005-c5b9-426d-b275-5dbcb620f215 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '152bd3aef9304371aaab4f73b30e9e95'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:15:27.515787 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-2a23b005-c5b9-426d-b275-5dbcb620f215 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '152bd3aef9304371aaab4f73b30e9e95'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:15:27.516547 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-2a23b005-c5b9-426d-b275-5dbcb620f215 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '152bd3aef9304371aaab4f73b30e9e95'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:15:27.517282 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-2a23b005-c5b9-426d-b275-5dbcb620f215 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '152bd3aef9304371aaab4f73b30e9e95'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:15:27.532243 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-2a23b005-c5b9-426d-b275-5dbcb620f215 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '152bd3aef9304371aaab4f73b30e9e95'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:15:27.546283 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1449/2890] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 20:15:27 2022] DELETE /identity/v3/users/152bd3aef9304371aaab4f73b30e9e95 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:15:27.805939 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909d493-444f-4cca-a331-229be436bcd6 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:15:27.807699 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-c909d493-444f-4cca-a331-229be436bcd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:15:27.822368 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909d493-444f-4cca-a331-229be436bcd6 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:15:27.840741 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:15:27.882023 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3397681-558f-4249-9410-1ef2a3440bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:15:27.882659 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3397681-558f-4249-9410-1ef2a3440bcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:15:27.882936 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3397681-558f-4249-9410-1ef2a3440bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:15:27.883206 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3397681-558f-4249-9410-1ef2a3440bcd admin admin] PATH_INFO: `/v3/projects/709dcaf9cc2244c7bc724e3becded8b8` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:15:27.884343 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3397681-558f-4249-9410-1ef2a3440bcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=709dcaf9cc2244c7bc724e3becded8b8)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:15:27.886596 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3397681-558f-4249-9410-1ef2a3440bcd admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:15:27.990765 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-b3397681-558f-4249-9410-1ef2a3440bcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '709dcaf9cc2244c7bc724e3becded8b8', 'request_id': 'req-b3397681-558f-4249-9410-1ef2a3440bcd'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:15:28.062225 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-b3397681-558f-4249-9410-1ef2a3440bcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '709dcaf9cc2244c7bc724e3becded8b8', 'request_id': 'req-b3397681-558f-4249-9410-1ef2a3440bcd'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:15:28.068171 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-b3397681-558f-4249-9410-1ef2a3440bcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '709dcaf9cc2244c7bc724e3becded8b8', 'request_id': 'req-b3397681-558f-4249-9410-1ef2a3440bcd'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:15:28.080015 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-b3397681-558f-4249-9410-1ef2a3440bcd admin admin] The token cache is being invalidate because project 709dcaf9cc2244c7bc724e3becded8b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 20:15:28.080323 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-b3397681-558f-4249-9410-1ef2a3440bcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:15:28.080970 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-b3397681-558f-4249-9410-1ef2a3440bcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:15:28.082486 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1442/2891] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 20:15:27 2022] DELETE /identity/v3/projects/709dcaf9cc2244c7bc724e3becded8b8 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:15:28.087620 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2aa59-9a31-4006-b676-3ff996efa607 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:15:28.087906 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2aa59-9a31-4006-b676-3ff996efa607 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:15:28.088182 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2aa59-9a31-4006-b676-3ff996efa607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:15:28.108080 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-19a2aa59-9a31-4006-b676-3ff996efa607 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:15:28.109278 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-19a2aa59-9a31-4006-b676-3ff996efa607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:15:28.168161 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1450/2892] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:15:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:15:28.176093 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0020cb4a-eb60-4b4c-80f9-283d9be8f3bc None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:15:28.176633 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0020cb4a-eb60-4b4c-80f9-283d9be8f3bc None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:15:28.179977 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0020cb4a-eb60-4b4c-80f9-283d9be8f3bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:15:28.199353 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-0020cb4a-eb60-4b4c-80f9-283d9be8f3bc None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:15:28.200571 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-0020cb4a-eb60-4b4c-80f9-283d9be8f3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:15:28.209690 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1443/2893] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:15:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 20:15:28.213992 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a2aa59-9a31-4006-b676-3ff996efa607 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:15:28.224789 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a2aa59-9a31-4006-b676-3ff996efa607 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:15:28.229398 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c3434-c0e2-4c48-bb1c-715c76996242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:15:28.230051 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c3434-c0e2-4c48-bb1c-715c76996242 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:15:28.230324 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c3434-c0e2-4c48-bb1c-715c76996242 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:15:28.230590 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c3434-c0e2-4c48-bb1c-715c76996242 admin admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:15:28.231224 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326c3434-c0e2-4c48-bb1c-715c76996242 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:15:28.231523 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326c3434-c0e2-4c48-bb1c-715c76996242 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:15:28.233237 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326c3434-c0e2-4c48-bb1c-715c76996242 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:15:28.244910 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1451/2894] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 20:15:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:15:28.249769 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0020cb4a-eb60-4b4c-80f9-283d9be8f3bc None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:15:28.259044 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0020cb4a-eb60-4b4c-80f9-283d9be8f3bc None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:15:28.264641 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1985bfea-5767-4e6d-9336-a39465d13fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:15:28.265263 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985bfea-5767-4e6d-9336-a39465d13fcf admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:15:28.265574 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985bfea-5767-4e6d-9336-a39465d13fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:15:28.265848 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985bfea-5767-4e6d-9336-a39465d13fcf admin admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:15:28.266487 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1985bfea-5767-4e6d-9336-a39465d13fcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:15:28.268387 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1985bfea-5767-4e6d-9336-a39465d13fcf admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:15:28.361188 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1444/2895] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 20:15:28 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:15:28.365556 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c3434-c0e2-4c48-bb1c-715c76996242 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:15:28.376371 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c3434-c0e2-4c48-bb1c-715c76996242 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:15:28.436150 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b5751-addf-4382-b5ff-a539c590f564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:15:28.436758 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b5751-addf-4382-b5ff-a539c590f564 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:15:28.437037 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b5751-addf-4382-b5ff-a539c590f564 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:15:28.437306 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b5751-addf-4382-b5ff-a539c590f564 admin admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:15:28.437973 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b5751-addf-4382-b5ff-a539c590f564 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:15:28.439879 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b5751-addf-4382-b5ff-a539c590f564 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:15:28.514347 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1452/2896] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 20:15:28 2022] POST /identity/v3/users => generated 293 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:15:28.518649 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1985bfea-5767-4e6d-9336-a39465d13fcf admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:15:28.530268 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1985bfea-5767-4e6d-9336-a39465d13fcf admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:15:28.535011 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62394e7-f5cd-456e-b449-4c03b4cf3659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:15:28.535624 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62394e7-f5cd-456e-b449-4c03b4cf3659 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:15:28.535904 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62394e7-f5cd-456e-b449-4c03b4cf3659 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:15:28.536175 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62394e7-f5cd-456e-b449-4c03b4cf3659 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:15:28.536820 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62394e7-f5cd-456e-b449-4c03b4cf3659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:15:28.538471 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62394e7-f5cd-456e-b449-4c03b4cf3659 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:15:28.549337 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1445/2897] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:15:28.553653 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b5751-addf-4382-b5ff-a539c590f564 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:15:28.564964 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b5751-addf-4382-b5ff-a539c590f564 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:15:28.569842 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad85cf8-6d35-4bfd-a074-3dfe3866592d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:15:28.570445 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad85cf8-6d35-4bfd-a074-3dfe3866592d admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:15:28.570724 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad85cf8-6d35-4bfd-a074-3dfe3866592d admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:15:28.570997 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad85cf8-6d35-4bfd-a074-3dfe3866592d admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:15:28.571685 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad85cf8-6d35-4bfd-a074-3dfe3866592d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:15:28.573251 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad85cf8-6d35-4bfd-a074-3dfe3866592d admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:15:28.585634 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1453/2898] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:15:28.589830 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62394e7-f5cd-456e-b449-4c03b4cf3659 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:15:28.600592 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62394e7-f5cd-456e-b449-4c03b4cf3659 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:15:28.606017 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c8f3be-4dce-429e-9c16-51e45aa20dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:15:28.610628 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8f3be-4dce-429e-9c16-51e45aa20dca admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:15:28.610628 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8f3be-4dce-429e-9c16-51e45aa20dca admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:15:28.610628 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8f3be-4dce-429e-9c16-51e45aa20dca admin admin] PATH_INFO: `/v3/projects/e17578bff84f49cbbab3310e7f844f5d/users/d063156a4cb14ad6b75a41e3100ead58/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:15:28.630639 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c8f3be-4dce-429e-9c16-51e45aa20dca admin admin] RBAC: Authorizing `identity:create_grant(project_id=e17578bff84f49cbbab3310e7f844f5d, user_id=d063156a4cb14ad6b75a41e3100ead58, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:15:28.633246 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c8f3be-4dce-429e-9c16-51e45aa20dca admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:15:28.727418 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1446/2899] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 20:15:28 2022] PUT /identity/v3/projects/e17578bff84f49cbbab3310e7f844f5d/users/d063156a4cb14ad6b75a41e3100ead58/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:15:28.738941 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422196a-328f-49a2-820c-29ebf1739290 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:15:28.739217 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422196a-328f-49a2-820c-29ebf1739290 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:15:28.739774 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422196a-328f-49a2-820c-29ebf1739290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:15:28.747816 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:15:28.769712 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-8422196a-328f-49a2-820c-29ebf1739290 None None] MFA Rules not processed for user `d063156a4cb14ad6b75a41e3100ead58`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:15:28.770929 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-8422196a-328f-49a2-820c-29ebf1739290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:15:28.838764 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1454/2900] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:15:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:15:28.851067 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c8f3be-4dce-429e-9c16-51e45aa20dca admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:15:28.852785 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-b0c8f3be-4dce-429e-9c16-51e45aa20dca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:15:28.907979 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:15:28.913455 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c8f3be-4dce-429e-9c16-51e45aa20dca admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:15:28.917182 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171251eb-1ef4-4000-866d-fd858cdbb550 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:15:28.917829 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171251eb-1ef4-4000-866d-fd858cdbb550 service cinder] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:15:28.920189 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171251eb-1ef4-4000-866d-fd858cdbb550 service cinder] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:15:28.920189 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171251eb-1ef4-4000-866d-fd858cdbb550 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:15:28.927683 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171251eb-1ef4-4000-866d-fd858cdbb550 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:15:28.929098 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171251eb-1ef4-4000-866d-fd858cdbb550 service cinder] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:15:28.938505 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1447/2901] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:15:28 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:15:28.959544 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8422196a-328f-49a2-820c-29ebf1739290 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:15:29.025558 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8422196a-328f-49a2-820c-29ebf1739290 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:15:29.030618 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0637f5-a687-4abb-9856-b7c74dffe56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:15:29.031225 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0637f5-a687-4abb-9856-b7c74dffe56f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:15:29.031503 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0637f5-a687-4abb-9856-b7c74dffe56f admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:15:29.031772 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0637f5-a687-4abb-9856-b7c74dffe56f admin admin] PATH_INFO: `/v3/users/d063156a4cb14ad6b75a41e3100ead58` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:15:29.032985 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0637f5-a687-4abb-9856-b7c74dffe56f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d063156a4cb14ad6b75a41e3100ead58)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:15:29.035173 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0637f5-a687-4abb-9856-b7c74dffe56f admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:15:29.204268 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-7a0637f5-a687-4abb-9856-b7c74dffe56f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd063156a4cb14ad6b75a41e3100ead58'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:15:29.278676 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-7a0637f5-a687-4abb-9856-b7c74dffe56f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd063156a4cb14ad6b75a41e3100ead58'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:15:29.280447 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-7a0637f5-a687-4abb-9856-b7c74dffe56f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd063156a4cb14ad6b75a41e3100ead58'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:15:29.281183 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-7a0637f5-a687-4abb-9856-b7c74dffe56f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd063156a4cb14ad6b75a41e3100ead58'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:15:29.296250 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-7a0637f5-a687-4abb-9856-b7c74dffe56f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd063156a4cb14ad6b75a41e3100ead58'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:15:29.312173 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1455/2902] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 20:15:28 2022] DELETE /identity/v3/users/d063156a4cb14ad6b75a41e3100ead58 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:15:29.317012 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482507f-0757-4f03-b1e4-9a14668b518d None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:15:29.317544 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482507f-0757-4f03-b1e4-9a14668b518d None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:15:29.317648 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482507f-0757-4f03-b1e4-9a14668b518d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:15:29.337651 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-7482507f-0757-4f03-b1e4-9a14668b518d None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:15:29.342714 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-7482507f-0757-4f03-b1e4-9a14668b518d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:15:29.402353 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1448/2903] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:15:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:15:29.413915 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0637f5-a687-4abb-9856-b7c74dffe56f admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:15:29.415811 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-7a0637f5-a687-4abb-9856-b7c74dffe56f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:15:29.431120 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:15:29.480052 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0637f5-a687-4abb-9856-b7c74dffe56f admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:15:29.484153 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd3b43-5b9f-4a9a-b5fb-e9e5fd86d403 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:15:29.484842 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd3b43-5b9f-4a9a-b5fb-e9e5fd86d403 service neutron] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:15:29.485162 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd3b43-5b9f-4a9a-b5fb-e9e5fd86d403 service neutron] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:15:29.485474 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd3b43-5b9f-4a9a-b5fb-e9e5fd86d403 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:15:29.495888 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bd3b43-5b9f-4a9a-b5fb-e9e5fd86d403 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:15:29.497400 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bd3b43-5b9f-4a9a-b5fb-e9e5fd86d403 service neutron] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:15:29.508555 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1456/2904] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:15:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:15:30.046978 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7482507f-0757-4f03-b1e4-9a14668b518d None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:15:30.048441 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-7482507f-0757-4f03-b1e4-9a14668b518d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:15:30.064719 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7482507f-0757-4f03-b1e4-9a14668b518d None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:15:30.071498 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a60c4f-1a9e-4b12-9c60-04ec6650ec67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:15:30.072149 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a60c4f-1a9e-4b12-9c60-04ec6650ec67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:15:30.072429 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a60c4f-1a9e-4b12-9c60-04ec6650ec67 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:15:30.072919 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a60c4f-1a9e-4b12-9c60-04ec6650ec67 admin admin] PATH_INFO: `/v3/projects/e17578bff84f49cbbab3310e7f844f5d` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:15:30.074945 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a60c4f-1a9e-4b12-9c60-04ec6650ec67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e17578bff84f49cbbab3310e7f844f5d)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:15:30.077194 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a60c4f-1a9e-4b12-9c60-04ec6650ec67 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:15:30.180240 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-f0a60c4f-1a9e-4b12-9c60-04ec6650ec67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e17578bff84f49cbbab3310e7f844f5d', 'request_id': 'req-f0a60c4f-1a9e-4b12-9c60-04ec6650ec67'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:15:30.247030 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-f0a60c4f-1a9e-4b12-9c60-04ec6650ec67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e17578bff84f49cbbab3310e7f844f5d', 'request_id': 'req-f0a60c4f-1a9e-4b12-9c60-04ec6650ec67'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:15:30.257459 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-f0a60c4f-1a9e-4b12-9c60-04ec6650ec67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e17578bff84f49cbbab3310e7f844f5d', 'request_id': 'req-f0a60c4f-1a9e-4b12-9c60-04ec6650ec67'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:15:30.269702 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-f0a60c4f-1a9e-4b12-9c60-04ec6650ec67 admin admin] The token cache is being invalidate because project e17578bff84f49cbbab3310e7f844f5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 20:15:30.269994 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-f0a60c4f-1a9e-4b12-9c60-04ec6650ec67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:15:30.270671 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-f0a60c4f-1a9e-4b12-9c60-04ec6650ec67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:15:30.272199 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1449/2905] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 20:15:30 2022] DELETE /identity/v3/projects/e17578bff84f49cbbab3310e7f844f5d => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:15:30.277360 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e22391-a451-4150-adae-0e39a2bbb5d0 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:15:30.279504 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e22391-a451-4150-adae-0e39a2bbb5d0 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:15:30.279504 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e22391-a451-4150-adae-0e39a2bbb5d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:15:30.301112 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-a1e22391-a451-4150-adae-0e39a2bbb5d0 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:15:30.301603 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-a1e22391-a451-4150-adae-0e39a2bbb5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:15:30.366525 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1457/2906] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:15:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:15:30.375608 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808660c-3099-440a-9341-8974fc2d9609 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:15:30.376209 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808660c-3099-440a-9341-8974fc2d9609 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:15:30.376209 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808660c-3099-440a-9341-8974fc2d9609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:15:30.397275 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-8808660c-3099-440a-9341-8974fc2d9609 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:15:30.398501 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-8808660c-3099-440a-9341-8974fc2d9609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:15:30.407687 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1450/2907] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:15:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:15:30.412001 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e22391-a451-4150-adae-0e39a2bbb5d0 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:15:30.423864 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e22391-a451-4150-adae-0e39a2bbb5d0 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:15:30.428868 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5a0a2-97e0-4d29-b6b6-20abf6be5404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:15:30.429533 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5a0a2-97e0-4d29-b6b6-20abf6be5404 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:15:30.429816 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5a0a2-97e0-4d29-b6b6-20abf6be5404 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:15:30.430096 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5a0a2-97e0-4d29-b6b6-20abf6be5404 admin admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:15:30.430807 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef5a0a2-97e0-4d29-b6b6-20abf6be5404 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:15:30.431118 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef5a0a2-97e0-4d29-b6b6-20abf6be5404 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:15:30.433012 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef5a0a2-97e0-4d29-b6b6-20abf6be5404 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:15:30.446066 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1458/2908] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 20:15:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:15:30.450561 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8808660c-3099-440a-9341-8974fc2d9609 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:15:30.460186 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8808660c-3099-440a-9341-8974fc2d9609 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:15:30.464960 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20452b5e-2e9a-4e28-9bbb-6acad7d01364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:15:30.465682 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20452b5e-2e9a-4e28-9bbb-6acad7d01364 admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:15:30.465942 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20452b5e-2e9a-4e28-9bbb-6acad7d01364 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:15:30.466899 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20452b5e-2e9a-4e28-9bbb-6acad7d01364 admin admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:15:30.467539 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20452b5e-2e9a-4e28-9bbb-6acad7d01364 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:15:30.469429 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20452b5e-2e9a-4e28-9bbb-6acad7d01364 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:15:30.568880 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1451/2909] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 20:15:30 2022] POST /identity/v3/projects => generated 377 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:15:30.575050 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5a0a2-97e0-4d29-b6b6-20abf6be5404 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:15:30.586271 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5a0a2-97e0-4d29-b6b6-20abf6be5404 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:15:30.646434 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e8ea1-bc74-4087-9df2-134f70f5b459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:15:30.647036 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e8ea1-bc74-4087-9df2-134f70f5b459 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:15:30.647312 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e8ea1-bc74-4087-9df2-134f70f5b459 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:15:30.647578 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e8ea1-bc74-4087-9df2-134f70f5b459 admin admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:15:30.648210 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e8ea1-bc74-4087-9df2-134f70f5b459 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:15:30.650154 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e8ea1-bc74-4087-9df2-134f70f5b459 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:15:30.762020 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1459/2910] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 20:15:30 2022] POST /identity/v3/users => generated 289 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:15:30.767308 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20452b5e-2e9a-4e28-9bbb-6acad7d01364 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:15:30.778539 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20452b5e-2e9a-4e28-9bbb-6acad7d01364 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:15:30.784038 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45ded2-3989-4058-a8af-b7719f378e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:15:30.784652 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45ded2-3989-4058-a8af-b7719f378e67 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:15:30.784932 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45ded2-3989-4058-a8af-b7719f378e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:15:30.785231 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45ded2-3989-4058-a8af-b7719f378e67 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:15:30.785968 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea45ded2-3989-4058-a8af-b7719f378e67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:15:30.794809 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea45ded2-3989-4058-a8af-b7719f378e67 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:15:30.799260 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1452/2911] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:15:30.804162 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e8ea1-bc74-4087-9df2-134f70f5b459 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:15:30.816113 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e8ea1-bc74-4087-9df2-134f70f5b459 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:15:30.821575 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d53477-d246-46b9-85f8-844a3991f5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:15:30.822151 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d53477-d246-46b9-85f8-844a3991f5f2 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:15:30.822413 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d53477-d246-46b9-85f8-844a3991f5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:15:30.822687 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d53477-d246-46b9-85f8-844a3991f5f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:15:30.823386 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d53477-d246-46b9-85f8-844a3991f5f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:15:30.825018 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d53477-d246-46b9-85f8-844a3991f5f2 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:15:30.839065 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1460/2912] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:15:30.849485 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45ded2-3989-4058-a8af-b7719f378e67 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:15:30.860762 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45ded2-3989-4058-a8af-b7719f378e67 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:15:30.865524 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e1440-7b11-4575-bb62-17ce7dee989a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:15:30.866206 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e1440-7b11-4575-bb62-17ce7dee989a admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:15:30.866504 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e1440-7b11-4575-bb62-17ce7dee989a admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:15:30.866771 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e1440-7b11-4575-bb62-17ce7dee989a admin admin] PATH_INFO: `/v3/projects/f86ca7f3362243b19b77229a03d691fb/users/ab04a00d9797455aa3be99cc683b716e/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:15:30.882451 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748e1440-7b11-4575-bb62-17ce7dee989a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f86ca7f3362243b19b77229a03d691fb, user_id=ab04a00d9797455aa3be99cc683b716e, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:15:30.885144 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748e1440-7b11-4575-bb62-17ce7dee989a admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:15:30.948010 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1453/2913] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 20:15:30 2022] PUT /identity/v3/projects/f86ca7f3362243b19b77229a03d691fb/users/ab04a00d9797455aa3be99cc683b716e/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 20:15:30.959481 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391a833-edab-4647-bb8d-d7dd5a56b34f None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:15:30.959899 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391a833-edab-4647-bb8d-d7dd5a56b34f None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:15:30.960268 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391a833-edab-4647-bb8d-d7dd5a56b34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:15:30.991757 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-8391a833-edab-4647-bb8d-d7dd5a56b34f None None] MFA Rules not processed for user `ab04a00d9797455aa3be99cc683b716e`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:15:30.993019 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-8391a833-edab-4647-bb8d-d7dd5a56b34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:15:31.004105 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:15:31.077180 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1461/2914] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:15:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 20:15:31.089716 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e1440-7b11-4575-bb62-17ce7dee989a admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:15:31.091512 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-748e1440-7b11-4575-bb62-17ce7dee989a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:15:31.105101 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:15:31.184085 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e1440-7b11-4575-bb62-17ce7dee989a admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:15:31.188593 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b283c-7f27-4ea1-b1fc-7b60fe52a6b7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaf6ec7f5b4f490aa22a8e3bea91da39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:15:31.189547 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b283c-7f27-4ea1-b1fc-7b60fe52a6b7 service glance] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:15:31.189824 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b283c-7f27-4ea1-b1fc-7b60fe52a6b7 service glance] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:15:31.190087 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b283c-7f27-4ea1-b1fc-7b60fe52a6b7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:15:31.199941 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038b283c-7f27-4ea1-b1fc-7b60fe52a6b7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:15:31.203882 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038b283c-7f27-4ea1-b1fc-7b60fe52a6b7 service glance] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:15:31.214948 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1454/2915] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:15:31 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:15:41.078495 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=22 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:15:41.216202 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=31 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:15:50.820241 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391a833-edab-4647-bb8d-d7dd5a56b34f None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:15:50.893233 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391a833-edab-4647-bb8d-d7dd5a56b34f None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:15:50.898040 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51707a2-f09b-40e6-9595-cf328b10a101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:15:50.903344 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51707a2-f09b-40e6-9595-cf328b10a101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:15:50.903344 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51707a2-f09b-40e6-9595-cf328b10a101 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:15:50.903344 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51707a2-f09b-40e6-9595-cf328b10a101 admin admin] PATH_INFO: `/v3/users/ab04a00d9797455aa3be99cc683b716e` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:15:50.903344 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51707a2-f09b-40e6-9595-cf328b10a101 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab04a00d9797455aa3be99cc683b716e)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:15:50.903344 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51707a2-f09b-40e6-9595-cf328b10a101 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:15:51.212431 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-f51707a2-f09b-40e6-9595-cf328b10a101 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab04a00d9797455aa3be99cc683b716e'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:15:51.317915 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-f51707a2-f09b-40e6-9595-cf328b10a101 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab04a00d9797455aa3be99cc683b716e'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:15:51.318527 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-f51707a2-f09b-40e6-9595-cf328b10a101 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab04a00d9797455aa3be99cc683b716e'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:15:51.319124 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-f51707a2-f09b-40e6-9595-cf328b10a101 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab04a00d9797455aa3be99cc683b716e'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:15:51.332414 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-f51707a2-f09b-40e6-9595-cf328b10a101 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab04a00d9797455aa3be99cc683b716e'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:15:51.345677 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1462/2916] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 20:15:50 2022] DELETE /identity/v3/users/ab04a00d9797455aa3be99cc683b716e => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:15:51.350321 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65dafe-51c1-459f-939f-ed2ff1ffbc1d None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:15:51.350810 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65dafe-51c1-459f-939f-ed2ff1ffbc1d None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:15:51.350920 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65dafe-51c1-459f-939f-ed2ff1ffbc1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:15:51.370661 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-fd65dafe-51c1-459f-939f-ed2ff1ffbc1d None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:15:51.371861 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-fd65dafe-51c1-459f-939f-ed2ff1ffbc1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:15:51.433826 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1455/2917] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:15:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:15:51.443800 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51707a2-f09b-40e6-9595-cf328b10a101 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:15:51.445256 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-f51707a2-f09b-40e6-9595-cf328b10a101 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:15:51.512123 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51707a2-f09b-40e6-9595-cf328b10a101 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:15:51.515859 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e5aa7-a595-470e-a369-45a9cbde60a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:15:51.517371 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e5aa7-a595-470e-a369-45a9cbde60a2 service neutron] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:15:51.517371 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e5aa7-a595-470e-a369-45a9cbde60a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:15:51.517371 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e5aa7-a595-470e-a369-45a9cbde60a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:15:51.528107 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1e5aa7-a595-470e-a369-45a9cbde60a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:15:51.530187 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1e5aa7-a595-470e-a369-45a9cbde60a2 service neutron] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:15:51.541590 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1463/2918] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:15:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:15:51.981942 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd65dafe-51c1-459f-939f-ed2ff1ffbc1d None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:15:51.983508 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-fd65dafe-51c1-459f-939f-ed2ff1ffbc1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:15:51.998356 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd65dafe-51c1-459f-939f-ed2ff1ffbc1d None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:15:52.003608 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b4360a-7491-4bdd-b00f-f2e84ca176c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:15:52.004465 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b4360a-7491-4bdd-b00f-f2e84ca176c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:15:52.004821 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b4360a-7491-4bdd-b00f-f2e84ca176c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:15:52.005176 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b4360a-7491-4bdd-b00f-f2e84ca176c8 admin admin] PATH_INFO: `/v3/projects/f86ca7f3362243b19b77229a03d691fb` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:15:52.006639 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b4360a-7491-4bdd-b00f-f2e84ca176c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f86ca7f3362243b19b77229a03d691fb)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:15:52.008395 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b4360a-7491-4bdd-b00f-f2e84ca176c8 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:15:52.142786 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-13b4360a-7491-4bdd-b00f-f2e84ca176c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f86ca7f3362243b19b77229a03d691fb', 'request_id': 'req-13b4360a-7491-4bdd-b00f-f2e84ca176c8'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:15:52.254770 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-13b4360a-7491-4bdd-b00f-f2e84ca176c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f86ca7f3362243b19b77229a03d691fb', 'request_id': 'req-13b4360a-7491-4bdd-b00f-f2e84ca176c8'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:15:52.262276 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-13b4360a-7491-4bdd-b00f-f2e84ca176c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f86ca7f3362243b19b77229a03d691fb', 'request_id': 'req-13b4360a-7491-4bdd-b00f-f2e84ca176c8'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:15:52.274360 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-13b4360a-7491-4bdd-b00f-f2e84ca176c8 admin admin] The token cache is being invalidate because project f86ca7f3362243b19b77229a03d691fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 20:15:52.275166 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-13b4360a-7491-4bdd-b00f-f2e84ca176c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:15:52.275926 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-13b4360a-7491-4bdd-b00f-f2e84ca176c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:15:52.277551 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1456/2919] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 20:15:51 2022] DELETE /identity/v3/projects/f86ca7f3362243b19b77229a03d691fb => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:15:52.283188 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed906b-ee56-4878-aacb-54c77b36abd5 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:15:52.286419 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed906b-ee56-4878-aacb-54c77b36abd5 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:15:52.286419 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed906b-ee56-4878-aacb-54c77b36abd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:15:52.304175 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-18ed906b-ee56-4878-aacb-54c77b36abd5 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:15:52.305371 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-18ed906b-ee56-4878-aacb-54c77b36abd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:15:52.326132 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:15:52.367901 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1464/2920] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:15:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:15:52.376967 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9049010-cf9b-4fe5-92f8-6a34681b87ca None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:15:52.377523 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9049010-cf9b-4fe5-92f8-6a34681b87ca None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:15:52.378164 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9049010-cf9b-4fe5-92f8-6a34681b87ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:15:52.399017 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-c9049010-cf9b-4fe5-92f8-6a34681b87ca None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:15:52.400762 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-c9049010-cf9b-4fe5-92f8-6a34681b87ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:15:52.409060 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1457/2921] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:15:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:15:52.413512 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ed906b-ee56-4878-aacb-54c77b36abd5 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:15:52.424068 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ed906b-ee56-4878-aacb-54c77b36abd5 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:15:52.430242 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818059f1-22b4-431a-9dc7-7e4aaeec13c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:15:52.431769 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818059f1-22b4-431a-9dc7-7e4aaeec13c2 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:15:52.432280 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818059f1-22b4-431a-9dc7-7e4aaeec13c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:15:52.432598 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818059f1-22b4-431a-9dc7-7e4aaeec13c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:15:52.433426 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818059f1-22b4-431a-9dc7-7e4aaeec13c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:15:52.433815 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818059f1-22b4-431a-9dc7-7e4aaeec13c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:15:52.435508 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818059f1-22b4-431a-9dc7-7e4aaeec13c2 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:15:52.449894 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1465/2922] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 20:15:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:15:52.454996 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9049010-cf9b-4fe5-92f8-6a34681b87ca None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:15:52.465433 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9049010-cf9b-4fe5-92f8-6a34681b87ca None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:15:52.470111 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755be01e-ebd0-4221-bd1c-96deac3022fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:15:52.470815 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755be01e-ebd0-4221-bd1c-96deac3022fd admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:15:52.471106 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755be01e-ebd0-4221-bd1c-96deac3022fd admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:15:52.471384 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755be01e-ebd0-4221-bd1c-96deac3022fd admin admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:15:52.472032 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755be01e-ebd0-4221-bd1c-96deac3022fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:15:52.474033 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755be01e-ebd0-4221-bd1c-96deac3022fd admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:15:52.631741 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1458/2923] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 20:15:52 2022] POST /identity/v3/projects => generated 377 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:15:52.636158 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818059f1-22b4-431a-9dc7-7e4aaeec13c2 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:15:52.646372 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818059f1-22b4-431a-9dc7-7e4aaeec13c2 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:15:52.706709 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c70402-d340-4c9c-a48b-4b5d85525ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:15:52.707319 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c70402-d340-4c9c-a48b-4b5d85525ee5 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:15:52.707596 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c70402-d340-4c9c-a48b-4b5d85525ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:15:52.707867 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c70402-d340-4c9c-a48b-4b5d85525ee5 admin admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:15:52.708501 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c70402-d340-4c9c-a48b-4b5d85525ee5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:15:52.710451 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c70402-d340-4c9c-a48b-4b5d85525ee5 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:15:52.832800 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1466/2924] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 20:15:52 2022] POST /identity/v3/users => generated 289 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:15:52.837802 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755be01e-ebd0-4221-bd1c-96deac3022fd admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:15:52.848942 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755be01e-ebd0-4221-bd1c-96deac3022fd admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:15:52.853611 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7321dd11-1e77-41e1-a79c-5365ed44a1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:15:52.854535 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321dd11-1e77-41e1-a79c-5365ed44a1e4 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:15:52.854818 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321dd11-1e77-41e1-a79c-5365ed44a1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:15:52.855118 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321dd11-1e77-41e1-a79c-5365ed44a1e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:15:52.855800 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7321dd11-1e77-41e1-a79c-5365ed44a1e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:15:52.858214 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7321dd11-1e77-41e1-a79c-5365ed44a1e4 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:15:52.868715 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1459/2925] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:15:52.872941 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c70402-d340-4c9c-a48b-4b5d85525ee5 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:15:52.883587 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c70402-d340-4c9c-a48b-4b5d85525ee5 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:15:52.888939 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c784e8b-b56e-4036-a784-07fc15df11a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:15:52.889577 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c784e8b-b56e-4036-a784-07fc15df11a7 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:15:52.889881 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c784e8b-b56e-4036-a784-07fc15df11a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:15:52.890153 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c784e8b-b56e-4036-a784-07fc15df11a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:15:52.890792 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c784e8b-b56e-4036-a784-07fc15df11a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:15:52.892407 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c784e8b-b56e-4036-a784-07fc15df11a7 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:15:52.906116 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1467/2926] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:15:52.910483 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7321dd11-1e77-41e1-a79c-5365ed44a1e4 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:15:52.921227 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7321dd11-1e77-41e1-a79c-5365ed44a1e4 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:15:52.925898 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc5c66-01af-4ad8-9036-57d51273a514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:15:52.926558 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc5c66-01af-4ad8-9036-57d51273a514 admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:15:52.926837 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc5c66-01af-4ad8-9036-57d51273a514 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:15:52.927110 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc5c66-01af-4ad8-9036-57d51273a514 admin admin] PATH_INFO: `/v3/projects/d45411b46a364b9da1a66a09021d991f/users/477c8284398e41abaf75ebdb07878294/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:15:52.942557 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadc5c66-01af-4ad8-9036-57d51273a514 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d45411b46a364b9da1a66a09021d991f, user_id=477c8284398e41abaf75ebdb07878294, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:15:52.945104 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadc5c66-01af-4ad8-9036-57d51273a514 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:15:53.030790 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1460/2927] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 20:15:52 2022] PUT /identity/v3/projects/d45411b46a364b9da1a66a09021d991f/users/477c8284398e41abaf75ebdb07878294/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:15:53.043278 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93ccd5-e491-4038-bedd-7c6870c20191 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:15:53.043561 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93ccd5-e491-4038-bedd-7c6870c20191 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:15:53.043834 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93ccd5-e491-4038-bedd-7c6870c20191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:15:53.073023 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-6b93ccd5-e491-4038-bedd-7c6870c20191 None None] MFA Rules not processed for user `477c8284398e41abaf75ebdb07878294`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:15:53.074286 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-6b93ccd5-e491-4038-bedd-7c6870c20191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:15:53.141773 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1468/2928] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:15:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:15:53.153690 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc5c66-01af-4ad8-9036-57d51273a514 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:15:53.155403 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-aadc5c66-01af-4ad8-9036-57d51273a514 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:15:53.178100 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:15:53.216300 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc5c66-01af-4ad8-9036-57d51273a514 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:15:53.220258 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6470e-be76-4a09-abae-995859bb2290 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:15:53.220868 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6470e-be76-4a09-abae-995859bb2290 service cinder] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:15:53.221147 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6470e-be76-4a09-abae-995859bb2290 service cinder] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:15:53.221422 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6470e-be76-4a09-abae-995859bb2290 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:15:53.230824 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f6470e-be76-4a09-abae-995859bb2290 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:15:53.232310 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f6470e-be76-4a09-abae-995859bb2290 service cinder] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:15:53.241631 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1461/2929] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:15:53 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:16:03.138358 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:16:03.392004 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=17 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:16:11.494929 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b93ccd5-e491-4038-bedd-7c6870c20191 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:16:11.558197 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b93ccd5-e491-4038-bedd-7c6870c20191 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:16:11.562912 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5072bfe-e72c-4e5d-8f28-96df9f1cddd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:16:11.563538 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5072bfe-e72c-4e5d-8f28-96df9f1cddd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:16:11.563814 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5072bfe-e72c-4e5d-8f28-96df9f1cddd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:16:11.564132 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5072bfe-e72c-4e5d-8f28-96df9f1cddd2 admin admin] PATH_INFO: `/v3/users/477c8284398e41abaf75ebdb07878294` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:16:11.565260 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5072bfe-e72c-4e5d-8f28-96df9f1cddd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=477c8284398e41abaf75ebdb07878294)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:16:11.567257 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5072bfe-e72c-4e5d-8f28-96df9f1cddd2 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:16:11.769271 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-e5072bfe-e72c-4e5d-8f28-96df9f1cddd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '477c8284398e41abaf75ebdb07878294'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:16:11.846827 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-e5072bfe-e72c-4e5d-8f28-96df9f1cddd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '477c8284398e41abaf75ebdb07878294'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:16:11.847435 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-e5072bfe-e72c-4e5d-8f28-96df9f1cddd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '477c8284398e41abaf75ebdb07878294'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:16:11.848059 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-e5072bfe-e72c-4e5d-8f28-96df9f1cddd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '477c8284398e41abaf75ebdb07878294'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:16:11.861354 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-e5072bfe-e72c-4e5d-8f28-96df9f1cddd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '477c8284398e41abaf75ebdb07878294'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:16:11.873548 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1469/2930] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 20:16:11 2022] DELETE /identity/v3/users/477c8284398e41abaf75ebdb07878294 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:16:11.878341 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd3204-b35f-4e9b-b0a1-a68b4f59f2a4 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:16:11.878921 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd3204-b35f-4e9b-b0a1-a68b4f59f2a4 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:16:11.878921 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd3204-b35f-4e9b-b0a1-a68b4f59f2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:16:11.899531 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-83dd3204-b35f-4e9b-b0a1-a68b4f59f2a4 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:16:11.900734 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-83dd3204-b35f-4e9b-b0a1-a68b4f59f2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:16:11.963861 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1462/2931] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:16:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:16:11.974688 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5072bfe-e72c-4e5d-8f28-96df9f1cddd2 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:16:11.976250 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-e5072bfe-e72c-4e5d-8f28-96df9f1cddd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:16:12.035967 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5072bfe-e72c-4e5d-8f28-96df9f1cddd2 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:16:12.039728 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967c2a2-cfbf-474f-9757-c8348cfd5862 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:16:12.040338 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967c2a2-cfbf-474f-9757-c8348cfd5862 service neutron] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:16:12.040611 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967c2a2-cfbf-474f-9757-c8348cfd5862 service neutron] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:16:12.040881 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967c2a2-cfbf-474f-9757-c8348cfd5862 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:16:12.050051 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c967c2a2-cfbf-474f-9757-c8348cfd5862 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:16:12.051484 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c967c2a2-cfbf-474f-9757-c8348cfd5862 service neutron] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:16:12.061262 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1470/2932] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:16:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 20:16:12.522497 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dd3204-b35f-4e9b-b0a1-a68b4f59f2a4 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:16:12.523933 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-83dd3204-b35f-4e9b-b0a1-a68b4f59f2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:16:12.582457 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dd3204-b35f-4e9b-b0a1-a68b4f59f2a4 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:16:12.587454 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e61c2-7624-4a10-ac34-202be43d9c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:16:12.593284 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e61c2-7624-4a10-ac34-202be43d9c2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:16:12.593284 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e61c2-7624-4a10-ac34-202be43d9c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:16:12.593284 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e61c2-7624-4a10-ac34-202be43d9c2c admin admin] PATH_INFO: `/v3/projects/d45411b46a364b9da1a66a09021d991f` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:16:12.593284 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2e61c2-7624-4a10-ac34-202be43d9c2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d45411b46a364b9da1a66a09021d991f)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:16:12.593284 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2e61c2-7624-4a10-ac34-202be43d9c2c admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:16:12.746708 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-ee2e61c2-7624-4a10-ac34-202be43d9c2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd45411b46a364b9da1a66a09021d991f', 'request_id': 'req-ee2e61c2-7624-4a10-ac34-202be43d9c2c'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:16:12.797368 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-ee2e61c2-7624-4a10-ac34-202be43d9c2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd45411b46a364b9da1a66a09021d991f', 'request_id': 'req-ee2e61c2-7624-4a10-ac34-202be43d9c2c'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:16:12.805379 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-ee2e61c2-7624-4a10-ac34-202be43d9c2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd45411b46a364b9da1a66a09021d991f', 'request_id': 'req-ee2e61c2-7624-4a10-ac34-202be43d9c2c'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:16:12.818241 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-ee2e61c2-7624-4a10-ac34-202be43d9c2c admin admin] The token cache is being invalidate because project d45411b46a364b9da1a66a09021d991f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 20:16:12.818534 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-ee2e61c2-7624-4a10-ac34-202be43d9c2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:16:12.819205 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-ee2e61c2-7624-4a10-ac34-202be43d9c2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:16:12.820732 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1463/2933] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 20:16:12 2022] DELETE /identity/v3/projects/d45411b46a364b9da1a66a09021d991f => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 20:16:12.825666 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f299b2-882d-4d60-9d78-7cc4465e6747 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:16:12.826160 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f299b2-882d-4d60-9d78-7cc4465e6747 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:16:12.826276 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f299b2-882d-4d60-9d78-7cc4465e6747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:16:12.848303 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-c8f299b2-882d-4d60-9d78-7cc4465e6747 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:16:12.849553 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-c8f299b2-882d-4d60-9d78-7cc4465e6747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:16:12.868171 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:16:12.918834 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1471/2934] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:16:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:16:12.927706 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2c036-23ef-4994-afd6-e5df3ba56e10 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:16:12.928260 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2c036-23ef-4994-afd6-e5df3ba56e10 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:16:12.928260 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2c036-23ef-4994-afd6-e5df3ba56e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:16:12.949540 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-87a2c036-23ef-4994-afd6-e5df3ba56e10 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:16:12.950964 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-87a2c036-23ef-4994-afd6-e5df3ba56e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:16:12.959228 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1464/2935] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:16:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:16:12.963626 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f299b2-882d-4d60-9d78-7cc4465e6747 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:16:12.976522 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f299b2-882d-4d60-9d78-7cc4465e6747 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:16:12.984318 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d7c59-23a3-484d-8eec-4449aa4bcd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:16:12.985323 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d7c59-23a3-484d-8eec-4449aa4bcd42 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:16:12.986516 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d7c59-23a3-484d-8eec-4449aa4bcd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:16:12.986970 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d7c59-23a3-484d-8eec-4449aa4bcd42 admin admin] PATH_INFO: `/v3/domains` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:16:12.988145 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63d7c59-23a3-484d-8eec-4449aa4bcd42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:16:12.988706 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63d7c59-23a3-484d-8eec-4449aa4bcd42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:16:12.990387 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63d7c59-23a3-484d-8eec-4449aa4bcd42 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:16:13.002275 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1472/2936] 10.222.0.60 () {58 vars in 1153 bytes} [Sat Sep 24 20:16:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:16:13.006697 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a2c036-23ef-4994-afd6-e5df3ba56e10 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:16:13.015997 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a2c036-23ef-4994-afd6-e5df3ba56e10 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:16:13.020752 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653464f-9a5e-4d59-889f-82b2100e1486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:16:13.021350 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653464f-9a5e-4d59-889f-82b2100e1486 admin admin] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:16:13.021670 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653464f-9a5e-4d59-889f-82b2100e1486 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:16:13.021946 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653464f-9a5e-4d59-889f-82b2100e1486 admin admin] PATH_INFO: `/v3/projects` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:16:13.022609 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0653464f-9a5e-4d59-889f-82b2100e1486 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:16:13.024499 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0653464f-9a5e-4d59-889f-82b2100e1486 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:16:13.141857 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1465/2937] 10.222.0.60 () {60 vars in 1153 bytes} [Sat Sep 24 20:16:13 2022] POST /identity/v3/projects => generated 389 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:16:13.146398 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d7c59-23a3-484d-8eec-4449aa4bcd42 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:16:13.156395 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d7c59-23a3-484d-8eec-4449aa4bcd42 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:16:13.214633 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e13084-9071-4804-92cd-0776f28c71d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:16:13.215276 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e13084-9071-4804-92cd-0776f28c71d5 admin admin] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:16:13.215555 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e13084-9071-4804-92cd-0776f28c71d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:16:13.215829 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e13084-9071-4804-92cd-0776f28c71d5 admin admin] PATH_INFO: `/v3/users` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:16:13.216458 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e13084-9071-4804-92cd-0776f28c71d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:16:13.218411 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e13084-9071-4804-92cd-0776f28c71d5 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:16:13.303537 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1473/2938] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Sep 24 20:16:13 2022] POST /identity/v3/users => generated 295 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:16:13.308250 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653464f-9a5e-4d59-889f-82b2100e1486 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:16:13.318886 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653464f-9a5e-4d59-889f-82b2100e1486 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:16:13.323500 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6918aff-afe1-4b63-b681-1aa7f3dcd745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:16:13.324100 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6918aff-afe1-4b63-b681-1aa7f3dcd745 admin admin] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:16:13.324383 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6918aff-afe1-4b63-b681-1aa7f3dcd745 admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:16:13.324680 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6918aff-afe1-4b63-b681-1aa7f3dcd745 admin admin] PATH_INFO: `/v3/roles` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:16:13.325323 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6918aff-afe1-4b63-b681-1aa7f3dcd745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:16:13.326957 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6918aff-afe1-4b63-b681-1aa7f3dcd745 admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:16:13.337995 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1466/2939] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:16:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:16:13.341954 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e13084-9071-4804-92cd-0776f28c71d5 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:16:13.352571 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e13084-9071-4804-92cd-0776f28c71d5 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:16:13.357121 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d8f61-3a1f-4703-ac13-780e97680080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:16:13.357746 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d8f61-3a1f-4703-ac13-780e97680080 admin admin] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:16:13.358021 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d8f61-3a1f-4703-ac13-780e97680080 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:16:13.358291 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d8f61-3a1f-4703-ac13-780e97680080 admin admin] PATH_INFO: `/v3/roles` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:16:13.358917 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d8f61-3a1f-4703-ac13-780e97680080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:16:13.360482 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d8f61-3a1f-4703-ac13-780e97680080 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:16:13.370866 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1474/2940] 10.222.0.60 () {58 vars in 1122 bytes} [Sat Sep 24 20:16:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:16:13.374980 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6918aff-afe1-4b63-b681-1aa7f3dcd745 admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:16:13.385796 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6918aff-afe1-4b63-b681-1aa7f3dcd745 admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:16:13.390497 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc09fcf-ae80-4561-b1f1-31c6536a91ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:16:13.391143 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc09fcf-ae80-4561-b1f1-31c6536a91ef admin admin] REQUEST_METHOD: `PUT` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:16:13.391423 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc09fcf-ae80-4561-b1f1-31c6536a91ef admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:16:13.391699 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc09fcf-ae80-4561-b1f1-31c6536a91ef admin admin] PATH_INFO: `/v3/projects/379c653d541c4df6bd054804aad6f619/users/ace4c0e4d2b44de4a668b8b8e630b7ae/roles/3dfa1e29c6a0404388d256728d66e4a1` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:16:13.401311 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:16:13.407619 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc09fcf-ae80-4561-b1f1-31c6536a91ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=379c653d541c4df6bd054804aad6f619, user_id=ace4c0e4d2b44de4a668b8b8e630b7ae, role_id=3dfa1e29c6a0404388d256728d66e4a1)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:16:13.411588 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc09fcf-ae80-4561-b1f1-31c6536a91ef admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:16:13.528132 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1467/2941] 10.222.0.60 () {60 vars in 1483 bytes} [Sat Sep 24 20:16:13 2022] PUT /identity/v3/projects/379c653d541c4df6bd054804aad6f619/users/ace4c0e4d2b44de4a668b8b8e630b7ae/roles/3dfa1e29c6a0404388d256728d66e4a1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:16:13.540466 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fe031-8506-4e23-8b1f-7fbc821ea3f4 None None] REQUEST_METHOD: `POST` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:16:13.540749 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fe031-8506-4e23-8b1f-7fbc821ea3f4 None None] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:16:13.541019 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fe031-8506-4e23-8b1f-7fbc821ea3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:16:13.569670 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.auth.core [None req-a80fe031-8506-4e23-8b1f-7fbc821ea3f4 None None] MFA Rules not processed for user `ace4c0e4d2b44de4a668b8b8e630b7ae`. Rule list: `[]` (Enabled: `True`). {{(pid=93399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:16:13.570880 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-a80fe031-8506-4e23-8b1f-7fbc821ea3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:16:13.635895 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1475/2942] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:16:13 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:16:13.648266 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc09fcf-ae80-4561-b1f1-31c6536a91ef admin admin] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:16:13.649959 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-7fc09fcf-ae80-4561-b1f1-31c6536a91ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:16:13.725413 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc09fcf-ae80-4561-b1f1-31c6536a91ef admin admin] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:16:13.729155 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2342863a-f7a1-4b7b-987c-9536113f8afa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9057442a6cd4b45acdd588d432d8318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:16:13.729812 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342863a-f7a1-4b7b-987c-9536113f8afa service cinder] REQUEST_METHOD: `GET` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:16:13.730096 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342863a-f7a1-4b7b-987c-9536113f8afa service cinder] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:16:13.730369 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342863a-f7a1-4b7b-987c-9536113f8afa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:16:13.738859 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2342863a-f7a1-4b7b-987c-9536113f8afa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:16:13.740278 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2342863a-f7a1-4b7b-987c-9536113f8afa service cinder] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:16:13.749042 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1468/2943] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:16:13 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:16:23.632987 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:16:23.745132 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=38,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:16:25.590565 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80fe031-8506-4e23-8b1f-7fbc821ea3f4 None None] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:16:25.672262 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80fe031-8506-4e23-8b1f-7fbc821ea3f4 None None] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:16:25.685170 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a3a5f4-503b-466d-b148-de8cdef39eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:16:25.685842 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3a5f4-503b-466d-b148-de8cdef39eb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:16:25.686115 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3a5f4-503b-466d-b148-de8cdef39eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:16:25.686380 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3a5f4-503b-466d-b148-de8cdef39eb2 admin admin] PATH_INFO: `/v3/users/ace4c0e4d2b44de4a668b8b8e630b7ae` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:16:25.687492 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a3a5f4-503b-466d-b148-de8cdef39eb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ace4c0e4d2b44de4a668b8b8e630b7ae)` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:16:25.690012 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a3a5f4-503b-466d-b148-de8cdef39eb2 admin admin] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:16:25.862085 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-d0a3a5f4-503b-466d-b148-de8cdef39eb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ace4c0e4d2b44de4a668b8b8e630b7ae'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:16:25.922146 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-d0a3a5f4-503b-466d-b148-de8cdef39eb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ace4c0e4d2b44de4a668b8b8e630b7ae'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:16:25.923310 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-d0a3a5f4-503b-466d-b148-de8cdef39eb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ace4c0e4d2b44de4a668b8b8e630b7ae'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:16:25.924177 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-d0a3a5f4-503b-466d-b148-de8cdef39eb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ace4c0e4d2b44de4a668b8b8e630b7ae'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:16:25.937950 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.notifications [None req-d0a3a5f4-503b-466d-b148-de8cdef39eb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ace4c0e4d2b44de4a668b8b8e630b7ae'} {{(pid=93399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:16:25.951423 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1476/2944] 10.222.0.60 () {58 vars in 1224 bytes} [Sat Sep 24 20:16:25 2022] DELETE /identity/v3/users/ace4c0e4d2b44de4a668b8b8e630b7ae => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:16:25.959263 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe73c34-3822-4f29-bace-294d12e9b599 None None] REQUEST_METHOD: `POST` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:16:25.959768 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe73c34-3822-4f29-bace-294d12e9b599 None None] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:16:25.959892 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe73c34-3822-4f29-bace-294d12e9b599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:16:26.002832 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.auth.core [None req-2fe73c34-3822-4f29-bace-294d12e9b599 None None] MFA Rules not processed for user `3ee86ed717254b8d8e892338e3d639aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93400) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:16:26.003115 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-2fe73c34-3822-4f29-bace-294d12e9b599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:16:26.067282 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1469/2945] 10.222.0.60 () {58 vars in 958 bytes} [Sat Sep 24 20:16:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:16:26.077210 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a3a5f4-503b-466d-b148-de8cdef39eb2 admin admin] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:16:26.078684 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-d0a3a5f4-503b-466d-b148-de8cdef39eb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:16:26.149355 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:16:26.158208 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a3a5f4-503b-466d-b148-de8cdef39eb2 admin admin] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:16:26.161971 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3b605-3b6c-4de9-8dab-20b53908b57e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed7dee25fd54255ad24cd6ad880fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:16:26.163946 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3b605-3b6c-4de9-8dab-20b53908b57e service neutron] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:16:26.163946 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3b605-3b6c-4de9-8dab-20b53908b57e service neutron] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:16:26.163946 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3b605-3b6c-4de9-8dab-20b53908b57e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:16:26.172186 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd3b605-3b6c-4de9-8dab-20b53908b57e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:16:26.174266 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd3b605-3b6c-4de9-8dab-20b53908b57e service neutron] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:16:26.184340 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1477/2946] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:16:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:16:26.600223 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe73c34-3822-4f29-bace-294d12e9b599 None None] Authenticating user token {{(pid=93400) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:16:26.601806 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.fernet_utils [None req-2fe73c34-3822-4f29-bace-294d12e9b599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93400) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:16:26.618531 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe73c34-3822-4f29-bace-294d12e9b599 None None] Validating token access rules against request {{(pid=93400) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:16:26.621317 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476201f9-bbe2-4148-b615-163391c77d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee86ed717254b8d8e892338e3d639aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1efc13c179384208b08c31d1589c351f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93400) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:16:26.622047 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476201f9-bbe2-4148-b615-163391c77d8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:16:26.622263 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476201f9-bbe2-4148-b615-163391c77d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:16:26.622538 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476201f9-bbe2-4148-b615-163391c77d8f admin admin] PATH_INFO: `/v3/projects/379c653d541c4df6bd054804aad6f619` {{(pid=93400) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:16:26.623668 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476201f9-bbe2-4148-b615-163391c77d8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=379c653d541c4df6bd054804aad6f619)` {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:16:26.625673 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476201f9-bbe2-4148-b615-163391c77d8f admin admin] RBAC: Authorization granted {{(pid=93400) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:16:26.781097 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-476201f9-bbe2-4148-b615-163391c77d8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '379c653d541c4df6bd054804aad6f619', 'request_id': 'req-476201f9-bbe2-4148-b615-163391c77d8f'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:16:26.879771 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-476201f9-bbe2-4148-b615-163391c77d8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '379c653d541c4df6bd054804aad6f619', 'request_id': 'req-476201f9-bbe2-4148-b615-163391c77d8f'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:16:26.886098 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-476201f9-bbe2-4148-b615-163391c77d8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '379c653d541c4df6bd054804aad6f619', 'request_id': 'req-476201f9-bbe2-4148-b615-163391c77d8f'} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:16:26.898494 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-476201f9-bbe2-4148-b615-163391c77d8f admin admin] The token cache is being invalidate because project 379c653d541c4df6bd054804aad6f619 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93400) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 20:16:26.898780 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-476201f9-bbe2-4148-b615-163391c77d8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:16:26.899431 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG keystone.notifications [None req-476201f9-bbe2-4148-b615-163391c77d8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93400) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:16:26.900913 dv-cinder-859191-1-smb devstack@keystone.service[93400]: [pid: 93400|app: 0|req: 1470/2947] 10.222.0.60 () {58 vars in 1233 bytes} [Sat Sep 24 20:16:26 2022] DELETE /identity/v3/projects/379c653d541c4df6bd054804aad6f619 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:16:36.316205 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=7 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:16:36.899280 dv-cinder-859191-1-smb devstack@keystone.service[93400]: DEBUG dbcounter [-] [93400] Writing DB stats keystone:SELECT=62,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:17:11.199868 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3b605-3b6c-4de9-8dab-20b53908b57e service neutron] Authenticating user token {{(pid=93399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:17:11.201334 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-fbd3b605-3b6c-4de9-8dab-20b53908b57e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:17:11.295194 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3b605-3b6c-4de9-8dab-20b53908b57e service neutron] Validating token access rules against request {{(pid=93399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:17:11.357588 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861d582-e602-459b-be6f-429fdeb49d9c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f19f1385114fa5a921999747a6666b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c2da88af5714e619238772bde676a42', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:17:11.358202 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861d582-e602-459b-be6f-429fdeb49d9c service placement] REQUEST_METHOD: `GET` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:17:11.358482 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861d582-e602-459b-be6f-429fdeb49d9c service placement] SCRIPT_NAME: `/identity` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:17:11.358931 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861d582-e602-459b-be6f-429fdeb49d9c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:17:11.361379 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.fernet_utils [None req-8861d582-e602-459b-be6f-429fdeb49d9c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:17:11.373219 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8861d582-e602-459b-be6f-429fdeb49d9c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:17:11.374842 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8861d582-e602-459b-be6f-429fdeb49d9c service placement] RBAC: Authorization granted {{(pid=93399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:17:11.385166 dv-cinder-859191-1-smb devstack@keystone.service[93399]: [pid: 93399|app: 0|req: 1478/2948] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Sep 24 20:17:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:17:21.380654 dv-cinder-859191-1-smb devstack@keystone.service[93399]: DEBUG dbcounter [-] [93399] Writing DB stats keystone:SELECT=67 {{(pid=93399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}